Multiview ToF sensor fusion technique for high-quality depth map

Deukhyeon Kim; Jinwook Choi; Kwanghoon Sohn

doi:10.1117/12.2001733

12 March 2013 Multiview ToF sensor fusion technique for high-quality depth map

Deukhyeon Kim, Jinwook Choi, Kwanghoon Sohn

Proceedings Volume 8650, Three-Dimensional Image Processing (3DIP) and Applications 2013; 865006 (2013) https://doi.org/10.1117/12.2001733
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

The Time-of-Flight (ToF) sensor has been widely used in computer vision fields since it can provide depth information in real time. However, the depth map obtained from ToF sensor is distressed with error, and has a lower resolution than general cameras. In this paper, we propose a novel framework to fuse and upsample multi-view depth maps obtained from multiple ToF sensors. The proposed method can be robust to the camera calibration error and effectively applied to the Multi-view Video plus Depth (MVD) system. For that, we perform depth balancing and confidence map based multi-view depth fusion. The depth balancing adjusts the distribution of depth values between multiple ToF sensors. It can provide a coherent depth for the corresponding points between depth maps. Confidence map based multi-view depth fusion technique can restore the depth acquisition error and align multiple depth maps well with the corresponding color image by using only reliable depth values. Experimental results show that the proposed method using multiple ToF sensors is superior to the conventional method based on the 2D-plus-depth system consisting of one color camera and one depth sensor.

Citation Download Citation

Deukhyeon Kim, Jinwook Choi, and Kwanghoon Sohn "Multiview ToF sensor fusion technique for high-quality depth map", Proc. SPIE 8650, Three-Dimensional Image Processing (3DIP) and Applications 2013, 865006 (12 March 2013); https://doi.org/10.1117/12.2001733

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available