Multi-camera synchronization core implemented on USB3 based FPGA platform

Ricardo M. Sousa; Martin Wäny; Pedro Santos; Morgado Dias

doi:10.1117/12.2082928

13 March 2015 Multi-camera synchronization core implemented on USB3 based FPGA platform

Ricardo M. Sousa, Martin Wäny, Pedro Santos, Morgado Dias

Proceedings Volume 9403, Image Sensors and Imaging Systems 2015; 940306 (2015) https://doi.org/10.1117/12.2082928
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

Centered on Awaiba’s NanEye CMOS image sensor family and a FPGA platform with USB3 interface, the aim of this paper is to demonstrate a new technique to synchronize up to 8 individual self-timed cameras with minimal error. Small form factor self-timed camera modules of 1 mm x 1 mm or smaller do not normally allow external synchronization. However, for stereo vision or 3D reconstruction with multiple cameras as well as for applications requiring pulsed illumination it is required to synchronize multiple cameras. In this work, the challenge of synchronizing multiple selftimed cameras with only 4 wire interface has been solved by adaptively regulating the power supply for each of the cameras. To that effect, a control core was created to constantly monitor the operating frequency of each camera by measuring the line period in each frame based on a well-defined sampling signal. The frequency is adjusted by varying the voltage level applied to the sensor based on the error between the measured line period and the desired line period. To ensure phase synchronization between frames, a Master-Slave interface was implemented. A single camera is defined as the Master, with its operating frequency being controlled directly through a PC based interface. The remaining cameras are setup in Slave mode and are interfaced directly with the Master camera control module. This enables the remaining cameras to monitor its line and frame period and adjust their own to achieve phase and frequency synchronization. The result of this work will allow the implementation of smaller than 3mm diameter 3D stereo vision equipment in medical endoscopic context, such as endoscopic surgical robotic or micro invasive surgery.

Citation Download Citation

Ricardo M. Sousa, Martin Wäny, Pedro Santos, and Morgado Dias "Multi-camera synchronization core implemented on USB3 based FPGA platform", Proc. SPIE 9403, Image Sensors and Imaging Systems 2015, 940306 (13 March 2015); https://doi.org/10.1117/12.2082928

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available