Mixed-resolution view synthesis using non-local means refined image merging

Thomas Richter; Michael Schöberl; Jürgen Seiler; Tobias Tröger; André Kaup

doi:10.1117/12.906552

25 February 2012 Mixed-resolution view synthesis using non-local means refined image merging

Thomas Richter; Michael Schöberl; Jürgen Seiler; Tobias Tröger; André Kaup;

Author Affiliations +

Proceedings Volume 8288, Stereoscopic Displays and Applications XXIII; 82881K (2012) https://doi.org/10.1117/12.906552
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Synthesizing novel views from originally available camera perspectives via depth maps is a key issue in the 3D video domain. Up to now, several high-resolution cameras are needed to obtain high-quality intermediate synthesized views. One possibility to reduce costs with regard to the used camera array is to replace some cameras by low-resolution cameras, which are cheaper on the one hand, but provide a much poorer image quality on the other hand. Unfortunately, some of the information inside the desired intermediate view may only be available in the low-resolution reference. Thus, the image quality of the low-resolution reference has a big influence on the visual quality of the synthesized view. This paper proposes a postprocessing step for the synthesized view, based on the non-local means algorithm. Thereby, all areas inserted from the low-resolution reference get efficiently adapted to their high-resolution environment. It is shown, that the non-local means refined image merging leads to a PSNR gain of up to 0.90 dB compared to an unrefined mixed-resolution setup. The approach can be easily extended to a hole-filling algorithm and yields a PSNR gain of up to 0.81 dB for hole areas compared to a reference hole-filling algorithm. The subjective image quality also increases convincingly in both applications.

Citation Download Citation

Thomas Richter, Michael Schöberl, Jürgen Seiler, Tobias Tröger, André Kaup, "Mixed-resolution view synthesis using non-local means refined image merging", Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, 82881K (25 February 2012); doi: 10.1117/12.906552; https://doi.org/10.1117/12.906552

ACCESS THE FULL ARTICLE

PERSONAL SIGN IN
Full access may be available with your subscription

Email or Username Forgot your username?

Password Forgot your password?

Show

Remember Email/Username on this computer

Remember Password

No SPIE account? Create an account
or Institutional Sign In via Shibboleth

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $14.40

Non-members: $18.00 ADD TO CART

Show All Keywords

Keywords/Phrases

Search In:

Publication Years