Real-time depth image-based rendering with layered dis-occlusion compensation and aliasing-free composition

Sergey Smirnov; Atanas Gotchev

doi:10.1117/12.2086895

16 March 2015 Real-time depth image-based rendering with layered dis-occlusion compensation and aliasing-free composition

Sergey Smirnov, Atanas Gotchev

Author Affiliations +

Proceedings Volume 9399, Image Processing: Algorithms and Systems XIII; 93990T (2015) https://doi.org/10.1117/12.2086895
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

Depth Image-based Rendering (DIBR) is a popular view synthesis technique which utilizes the RGB+D image format, also referred to as view-plus-depth scene representation. Classical DIBR is prone to dis-occlusion artefacts, caused by the lack of information in areas behind foreground objects, which appear visible in the synthesized images. A number of recently proposed compensation techniques have addressed the problem of hole filling. However, their computational complexity does not allow for real-time view synthesis and may require additional user input. In this work, we propose a hole-compensation technique, which works fully automatically and in a perceptually-correct manner. The proposed technique applies a two-layer model of the given RGB+D imagery, which is specifically tailored for rendering with free viewpoint selection. The main two components of the proposed technique are an adaptive layering of depth into relative 'foreground' and 'background' layers to be rendered separately and an additional blending filtering aimed at creating a blending function for aliasing cancellation during the process of view composition. The proposed real-time implementation turns ordinary view-plus-depth images to true 3D scene representations, which allow visualization in the y-around manner.

Citation Download Citation

Sergey Smirnov and Atanas Gotchev "Real-time depth image-based rendering with layered dis-occlusion compensation and aliasing-free composition", Proc. SPIE 9399, Image Processing: Algorithms and Systems XIII, 93990T (16 March 2015); https://doi.org/10.1117/12.2086895

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available