25 February 2012 Mixed-resolution view synthesis using non-local means refined image merging
Author Affiliations +
Synthesizing novel views from originally available camera perspectives via depth maps is a key issue in the 3D video domain. Up to now, several high-resolution cameras are needed to obtain high-quality intermediate synthesized views. One possibility to reduce costs with regard to the used camera array is to replace some cameras by low-resolution cameras, which are cheaper on the one hand, but provide a much poorer image quality on the other hand. Unfortunately, some of the information inside the desired intermediate view may only be available in the low-resolution reference. Thus, the image quality of the low-resolution reference has a big influence on the visual quality of the synthesized view. This paper proposes a postprocessing step for the synthesized view, based on the non-local means algorithm. Thereby, all areas inserted from the low-resolution reference get efficiently adapted to their high-resolution environment. It is shown, that the non-local means refined image merging leads to a PSNR gain of up to 0.90 dB compared to an unrefined mixed-resolution setup. The approach can be easily extended to a hole-filling algorithm and yields a PSNR gain of up to 0.81 dB for hole areas compared to a reference hole-filling algorithm. The subjective image quality also increases convincingly in both applications.
© (2012) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Thomas Richter, Thomas Richter, Michael Schöberl, Michael Schöberl, Jürgen Seiler, Jürgen Seiler, Tobias Tröger, Tobias Tröger, André Kaup, André Kaup, } "Mixed-resolution view synthesis using non-local means refined image merging", Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, 82881K (25 February 2012); doi: 10.1117/12.906552; https://doi.org/10.1117/12.906552

Back to Top