Translator Disclaimer
30 January 2012 Establishing eye contact for home video communication using stereo analysis and free viewpoint synthesis
Author Affiliations +
Abstract
Eye contact has been proven to be an important visual cue in video communication applications. We present a method to re-establish eye contact in a home video communication scenario caused by misalignment between the camera and the communication window the participant looks at. Our method covers the complete algorithm chain from acquisition to rendering and uses a pixel-based 3D analysis and rendering approach to create a virtual view of a camera placed at the position of the communication window. The outcomes of a large scale subjective study identified the crucial problems of such an approach. Based on the significant observations during the study in this paper we address the most important problems. We propose a method that produces spatially consistent depth maps using cross-check based filling. We address aliasing artifacts during point rendering and present a method to enhance the virtual view by image inpainting based on robust contour warping.
© (2012) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Christian Weigel and Niklas Treutner "Establishing eye contact for home video communication using stereo analysis and free viewpoint synthesis", Proc. SPIE 8290, Three-Dimensional Image Processing (3DIP) and Applications II, 829003 (30 January 2012); https://doi.org/10.1117/12.906594
PROCEEDINGS
9 PAGES


SHARE
Advertisement
Advertisement
RELATED CONTENT


Back to Top