Mixed-resolution view synthesis using non-local means refined image merging

Thomas Richter; Michael Schöberl; Jürgen Seiler; Tobias Tröger; André Kaup

doi:10.1117/12.906552

25 February 2012 Mixed-resolution view synthesis using non-local means refined image merging

Thomas Richter; Michael Schöberl; Jürgen Seiler; Tobias Tröger; André Kaup

Author Affiliations +

Proceedings Volume 8288, Stereoscopic Displays and Applications XXIII; 82881K (2012) https://doi.org/10.1117/12.906552
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Synthesizing novel views from originally available camera perspectives via depth maps is a key issue in the 3D video domain. Up to now, several high-resolution cameras are needed to obtain high-quality intermediate synthesized views. One possibility to reduce costs with regard to the used camera array is to replace some cameras by low-resolution cameras, which are cheaper on the one hand, but provide a much poorer image quality on the other hand. Unfortunately, some of the information inside the desired intermediate view may only be available in the low-resolution reference. Thus, the image quality of the low-resolution reference has a big influence on the visual quality of the synthesized view. This paper proposes a postprocessing step for the synthesized view, based on the non-local means algorithm. Thereby, all areas inserted from the low-resolution reference get efficiently adapted to their high-resolution environment. It is shown, that the non-local means refined image merging leads to a PSNR gain of up to 0.90 dB compared to an unrefined mixed-resolution setup. The approach can be easily extended to a hole-filling algorithm and yields a PSNR gain of up to 0.81 dB for hole areas compared to a reference hole-filling algorithm. The subjective image quality also increases convincingly in both applications.

Citation Download Citation

Thomas Richter, Thomas Richter, Michael Schöberl, Michael Schöberl, Jürgen Seiler, Jürgen Seiler, Tobias Tröger, Tobias Tröger, André Kaup, André Kaup, } "Mixed-resolution view synthesis using non-local means refined image merging", Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, 82881K (25 February 2012); doi: 10.1117/12.906552; https://doi.org/10.1117/12.906552

ACCESS THE FULL ARTICLE

PERSONAL SIGN IN
Full access may be available with your subscription

Email or Username Forgot your username?

Password Forgot your password?

Show

Remember Email/Username on this computer

Remember Password

No SPIE account? Create an account
or Institutional Sign In via Shibboleth

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $14.40

Non-members: $18.00 ADD TO CART

Show All Keywords

Keywords/Phrases

Search In:

Publication Years