Effective integration of 3D acquisition, reconstruction (modeling) and display technologies into a seamless systems provides augmented experience of visualizing and analyzing real objects and scenes with realistic 3D sensation. Applications can be found in medical imaging, gaming, virtual or augmented reality and hybrid simulations. Although 3D acquisition, reconstruction, and display technologies have gained significant momentum in recent years, there seems a lack of attention on synergistically combining these components into a “end-to-end” 3D visualization system. We designed, built and tested an integrated 3D visualization system that is able to capture in real-time 3D light-field images, perform 3D reconstruction to build 3D model of the objects, and display the 3D model on a large autostereoscopic screen. In this article, we will present our system architecture and component designs, hardware/software implementations, and experimental results. We will elaborate on our recent progress on sparse camera array light-field 3D acquisition, real-time dense 3D reconstruction, and autostereoscopic multi-view 3D display. A prototype is finally presented with test results to illustrate the effectiveness of our proposed integrated 3D visualization system.
We propose a load-balancing multi-LCD light field display technology. The multiple LCD panels operate as a spatial light modulator. Each light ray is the combination of pixels located in multiple LCD panels. The challenging problem is how to decompose the light field into limited layer images and display the light field compressively. Each pixel, as a controllable unit, is in spatial-multiplexing which means one pixel needs to be responsible to modulate multiple target light rays at the same time. We analyze the load imposed on each pixel by casting the light field decomposition as an over-determined equation problem. We found each pixel works in the state of overload and single pixel couldn’t give consideration to all target light rays. In order to reduce the load on pixels and improve display fidelity, we develop a multi-layer and multi-zone joint optimization strategy. The target light field is divided into multiple subzones and each subzone is displayed by multiple LCD panels combining with a dynamic directional backlight. By resolving the target light field, our display system further explores the multi-LCD’s capability of displaying light field and higher quality of light field display is achieved. We test our load-balancing decomposition algorithm based on different scene. The parallax, occlusion and blur of out-of-focus are restored successfully. And a three-layer prototype is constructed to demonstrate that correct light field is displayed in indoor lighting environment.