Mixed-resolution view synthesis using non-local means refined image merging

Thomas Richter; Michael Schöberl; Jürgen Seiler; Tobias Tröger; André Kaup

doi:10.1117/12.906552

25 February 2012 Mixed-resolution view synthesis using non-local means refined image merging

Thomas Richter, Michael Schöberl, Jürgen Seiler, Tobias Tröger, André Kaup

Proceedings Volume 8288, Stereoscopic Displays and Applications XXIII; 82881K (2012) https://doi.org/10.1117/12.906552
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Synthesizing novel views from originally available camera perspectives via depth maps is a key issue in the 3D video domain. Up to now, several high-resolution cameras are needed to obtain high-quality intermediate synthesized views. One possibility to reduce costs with regard to the used camera array is to replace some cameras by low-resolution cameras, which are cheaper on the one hand, but provide a much poorer image quality on the other hand. Unfortunately, some of the information inside the desired intermediate view may only be available in the low-resolution reference. Thus, the image quality of the low-resolution reference has a big influence on the visual quality of the synthesized view. This paper proposes a postprocessing step for the synthesized view, based on the non-local means algorithm. Thereby, all areas inserted from the low-resolution reference get efficiently adapted to their high-resolution environment. It is shown, that the non-local means refined image merging leads to a PSNR gain of up to 0.90 dB compared to an unrefined mixed-resolution setup. The approach can be easily extended to a hole-filling algorithm and yields a PSNR gain of up to 0.81 dB for hole areas compared to a reference hole-filling algorithm. The subjective image quality also increases convincingly in both applications.

Citation Download Citation

Thomas Richter, Michael Schöberl, Jürgen Seiler, Tobias Tröger, and André Kaup "Mixed-resolution view synthesis using non-local means refined image merging", Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, 82881K (25 February 2012); https://doi.org/10.1117/12.906552

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available