A layered inpainting method for virtual view synthesis

Seona Kim; Kyong Joon Lee; Chan Kim; Il Dong Yun; Sang Uk Lee

doi:10.1117/12.910412

Translator Disclaimer

28 February 2012 A layered inpainting method for virtual view synthesis

Seona Kim, Kyong Joon Lee, Chan Kim, Il Dong Yun, Sang Uk Lee

Author Affiliations +

Proceedings Volume 8288, Stereoscopic Displays and Applications XXIII; 82882A (2012) https://doi.org/10.1117/12.910412
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

In this paper, we presented a new approach in view synthesis based on the concept of missing area being filled with the background parts. Viewing synthesis is a method to generate a virtual scene in a desired view point. Previous approaches generally assumed that a virtual camera located between a pair of reference cameras. In contrast, we consider the case where the virtual camera located outside the reference cameras. The contents consist of two parts: layer separation and layer inpainting. In the layer separation, it extracts the background part from the images. The part is essential since layer inpainting inferred the result of it. After that, layer inpainting is implied to fill the occlusion region with the background layer. Therefore, it significantly improve the quality of inpainting in view synthesis. It should be noted that this research has only examined with image set from the Microsoft research yet. It has clear boundary between object and background, but patch based inpainting is applied in this framework. It is suggested that future studies can use better inpainting method in order to enhance the accuracy of indicator.

Citation Download Citation

Seona Kim, Kyong Joon Lee, Chan Kim, Il Dong Yun, and Sang Uk Lee "A layered inpainting method for virtual view synthesis", Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, 82882A (28 February 2012); https://doi.org/10.1117/12.910412

ACCESS THE FULL ARTICLE