Depth estimation from multiple coded apertures for 3D interaction

Sungjoo Suh; Changkyu Choi; Dusik Park

doi:10.1117/12.2024845

26 September 2013 Depth estimation from multiple coded apertures for 3D interaction

Sungjoo Suh, Changkyu Choi, Dusik Park

Proceedings Volume 8856, Applications of Digital Image Processing XXXVI; 88560X (2013) https://doi.org/10.1117/12.2024845
Event: SPIE Optical Engineering + Applications, 2013, San Diego, California, United States

Abstract

In this paper, we propose a novel depth estimation method from multiple coded apertures for 3D interaction. A flat panel display is transformed into lens-less multi-view cameras which consist of multiple coded apertures. The sensor panel behind the display captures the scene in front of the display through the imaging pattern of the modified uniformly redundant arrays (MURA) on the display panel. To estimate the depth of an object in the scene, we first generate a stack of synthetically refocused images at various distances by using the shifting and averaging approach for the captured coded images. And then, an initial depth map is obtained by applying a focus operator to a stack of the refocused images for each pixel. Finally, the depth is refined by fitting a parametric focus model to the response curves near the initial depth estimates. To demonstrate the effectiveness of the proposed algorithm, we construct an imaging system to capture the scene in front of the display. The system consists of a display screen and an x-ray detector without a scintillator layer so as to act as a visible sensor panel. Experimental results confirm that the proposed method accurately determines the depth of an object including a human hand in front of the display by capturing multiple MURA coded images, generating refocused images at different depth levels, and refining the initial depth estimates.

Citation Download Citation

Sungjoo Suh, Changkyu Choi, and Dusik Park "Depth estimation from multiple coded apertures for 3D interaction", Proc. SPIE 8856, Applications of Digital Image Processing XXXVI, 88560X (26 September 2013); https://doi.org/10.1117/12.2024845

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Coded apertures

Sensors

LCDs

Coded aperture imaging

Flat panel displays

X-ray detectors

3D displays

Show All Keywords

Keywords/Phrases

Search In:

Publication Years