Refined facial disparity maps for automatic creation of 3D avatars

Rafael Pagés; Francisco Morán; Luis Salgado; Daniel Berjón

doi:10.1117/12.908259

Translator Disclaimer

30 January 2012 Refined facial disparity maps for automatic creation of 3D avatars

Rafael Pagés, Francisco Morán, Luis Salgado, Daniel Berjón

Author Affiliations +

Proceedings Volume 8290, Three-Dimensional Image Processing (3DIP) and Applications II; 82900J (2012) https://doi.org/10.1117/12.908259
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

We propose a new method to automatically refine a facial disparity map obtained with standard cameras and under conventional illumination conditions by using a smart combination of traditional computer vision and 3D graphics techniques. Our system inputs two stereo images acquired with standard (calibrated) cameras and uses dense disparity estimation strategies to obtain a coarse initial disparity map, and SIFT to detect and match several feature points in the subject's face. We then use these points as anchors to modify the disparity in the facial area by building a Delaunay triangulation of their convex hull and interpolating their disparity values inside each triangle. We thus obtain a refined disparity map providing a much more accurate representation of the the subject's facial features. This refined facial disparity map may be easily transformed, through the camera calibration parameters, into a depth map to be used, also automatically, to improve the facial mesh of a 3D avatar to match the subject's real human features.

Citation Download Citation

Rafael Pagés, Francisco Morán, Luis Salgado, and Daniel Berjón "Refined facial disparity maps for automatic creation of 3D avatars", Proc. SPIE 8290, Three-Dimensional Image Processing (3DIP) and Applications II, 82900J (30 January 2012); https://doi.org/10.1117/12.908259

ACCESS THE FULL ARTICLE