3 November 2014 Explore spatial-temporal relations: transient super-resolution with PMD sensors
Author Affiliations +
Abstract
Transient imaging provides a direct view of how light travel in the scene, which leads to exciting applications such as looking around corners. Low-budget transient imagers, adapted from Time-of-Fight (ToF) cameras, reduce the barrier of entry for performing research of this new imaging modality. However, the image quality is far from satisfactory due to the limited resolution of PMD sensors. In this paper, we improve the resolution of transient images by modulating the illumination. We capture the scene under three linearly independent lighting conditions, and derive a theoretical model for the relationship between the time-profile and the corresponding 3D details of each pixel. Our key idea is that the light flight time in each pixel patch is proportional to the cross product of the illuminating direction and the surface normal. First we capture and reconstruct transient images by Fourier analysis at multiple illumination locations, and then fuse the data of acquired low-spatial resolution images to calculate the surface normal. Afterwards, we use an optimization procedure to split the pixels and finally enhance the image quality. We show that we can not only reveal the fine structure of the object but may also uncover the reflectance properties of different materials. We hope the idea of utilizing spatial-temporal relations will give new insights to the research and applications of transient imaging.
© (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Chaosheng Han, Chaosheng Han, Xing Lin, Xing Lin, Jingyu Lin, Jingyu Lin, Chenggang Yan, Chenggang Yan, Qionghai Dai, Qionghai Dai, } "Explore spatial-temporal relations: transient super-resolution with PMD sensors", Proc. SPIE 9273, Optoelectronic Imaging and Multimedia Technology III, 927338 (3 November 2014); doi: 10.1117/12.2071722; https://doi.org/10.1117/12.2071722
PROCEEDINGS
10 PAGES


SHARE
RELATED CONTENT

Accurate 3D reconstruction using multi-phase ToF camera
Proceedings of SPIE (November 04 2014)
Wide range time of flight camera design, analysis, and...
Proceedings of SPIE (March 12 2013)
Super-resolution PMD camera for applied metrology
Proceedings of SPIE (March 03 2016)
Three Dimensional Perception For Robot Vision
Proceedings of SPIE (December 13 1983)
Superresolution capabilities of 3D optical filters
Proceedings of SPIE (September 05 2008)

Back to Top