Upsampling range camera depth maps using high-resolution vision camera and pixel-level confidence classification

Chao Tian; Vinay Vaishampayan; Yifu Zhang

doi:10.1117/12.872450

15 February 2011 Upsampling range camera depth maps using high-resolution vision camera and pixel-level confidence classification

Chao Tian, Vinay Vaishampayan, Yifu Zhang

Author Affiliations +

Proceedings Volume 7863, Stereoscopic Displays and Applications XXII; 78630H (2011) https://doi.org/10.1117/12.872450
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States

Abstract

We consider the problem of upsampling a low-resolution depth map generated by a range camera, by using information from one or more additional high-resolution vision cameras. The goal is to provide an accurate high resolution depth map from the viewpoint of one of the vision cameras. We propose an algorithm that first converts the low resolution depth map into a depth/disparity map through coordinate mappings into the coordinate frame of one vision camera, then classifies the pixels into regions according to whether the range camera depth map is trustworthy, and finally refine the depth values for the pixels in the untrustworthy regions. For the last refinement step, both a method based on graph cut optimization and that based on bilateral filtering are examined. Experimental results show that the proposed methods using classification are able to upsample the depth map by a factor of 10 x 10 with much improved depth details, with significantly better accuracy comparing to those without the classification. The improvements are visually perceptible on a 3D auto-stereoscopic display.

Citation Download Citation

Chao Tian, Vinay Vaishampayan, and Yifu Zhang "Upsampling range camera depth maps using high-resolution vision camera and pixel-level confidence classification", Proc. SPIE 7863, Stereoscopic Displays and Applications XXII, 78630H (15 February 2011); https://doi.org/10.1117/12.872450

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available