19 February 2018 Real-time integral imaging pickup system using camera array
Author Affiliations +
Proceedings Volume 10556, Advances in Display Technologies VIII; 105560D (2018) https://doi.org/10.1117/12.2286089
Event: SPIE OPTO, 2018, San Francisco, California, United States
Abstract
Three-dimensional (3D) information acquirement in integral imaging (II) is becoming popular with the development of inexpensive digital image sensors. In this study, we present a real-time II pickup system in which multiple video streams are recorded, compressed, transmitted, and synthesized for II display. The system consists of an 8×8 network camera array, three Gigabit Ethernet switches, a single PC, and an II display. With the help of multi-thread technology, multi-view video streams from the network camera array are first captured in real-time. Then, we adopt camera array calibration and image alignment methods based on planar parallax to achieve good image quality. Finally, the aligned video streams are interweaved to synthesize the elemental image array (EIA) for the II display. We also present a remapping algorithm to accelerate the generation of the EIA. In the remapping algorithm, the mapping matrices from original parallaxes to the EIA are directly calculated. Therefore, the camera array calibration process, the parallax alignment process and the synthesizing process are simplified into a simple remapping operation. The video stream processing is fully performed on a graphics processing unit (GPU). Our proposed system achieves high-quality II video rendering at up to 37fps depending on rendering parameters. Experimental results verify the feasibility of the proposed system and high-quality EIAs synthesized from dynamic 3D scene.
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yan Xing, Yan Xing, Zhao-Long Xiong, Zhao-Long Xiong, Min Zhao, Min Zhao, Qiong-Hua Wang, Qiong-Hua Wang, } "Real-time integral imaging pickup system using camera array", Proc. SPIE 10556, Advances in Display Technologies VIII, 105560D (19 February 2018); doi: 10.1117/12.2286089; https://doi.org/10.1117/12.2286089
PROCEEDINGS
7 PAGES


SHARE
RELATED CONTENT

3D holoscopic video imaging system
Proceedings of SPIE (February 17 2012)
Use of 3D techniques for virtual production
Proceedings of SPIE (December 22 2000)
Real-time 3D light field transmission
Proceedings of SPIE (May 04 2010)
A novel 3D hand-area space sharing system
Proceedings of SPIE (February 04 2010)

Back to Top