13 March 2015 Multi-camera synchronization core implemented on USB3 based FPGA platform
Author Affiliations +
Centered on Awaiba’s NanEye CMOS image sensor family and a FPGA platform with USB3 interface, the aim of this paper is to demonstrate a new technique to synchronize up to 8 individual self-timed cameras with minimal error. Small form factor self-timed camera modules of 1 mm x 1 mm or smaller do not normally allow external synchronization. However, for stereo vision or 3D reconstruction with multiple cameras as well as for applications requiring pulsed illumination it is required to synchronize multiple cameras. In this work, the challenge of synchronizing multiple selftimed cameras with only 4 wire interface has been solved by adaptively regulating the power supply for each of the cameras. To that effect, a control core was created to constantly monitor the operating frequency of each camera by measuring the line period in each frame based on a well-defined sampling signal. The frequency is adjusted by varying the voltage level applied to the sensor based on the error between the measured line period and the desired line period. To ensure phase synchronization between frames, a Master-Slave interface was implemented. A single camera is defined as the Master, with its operating frequency being controlled directly through a PC based interface. The remaining cameras are setup in Slave mode and are interfaced directly with the Master camera control module. This enables the remaining cameras to monitor its line and frame period and adjust their own to achieve phase and frequency synchronization. The result of this work will allow the implementation of smaller than 3mm diameter 3D stereo vision equipment in medical endoscopic context, such as endoscopic surgical robotic or micro invasive surgery.
© (2015) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Ricardo M. Sousa, Ricardo M. Sousa, Martin Wäny, Martin Wäny, Pedro Santos, Pedro Santos, Morgado Dias, Morgado Dias, } "Multi-camera synchronization core implemented on USB3 based FPGA platform", Proc. SPIE 9403, Image Sensors and Imaging Systems 2015, 940306 (13 March 2015); doi: 10.1117/12.2082928; https://doi.org/10.1117/12.2082928


A CMOS high speed imaging system design based on FPGA
Proceedings of SPIE (October 07 2015)
Random addressable active pixel image sensors
Proceedings of SPIE (December 18 1996)
Architecture of a multichannel multispectral imaging processor
Proceedings of SPIE (September 09 2001)
Development of the readout controller for KASINICS
Proceedings of SPIE (June 26 2006)

Back to Top