Synthesis and identification of three-dimensional faces from image(s) and three-dimensional generic models

Zexi Liu; Fernand Cohen

doi:10.1117/1.JEI.26.6.063005

8 November 2017 Synthesis and identification of three-dimensional faces from image(s) and three-dimensional generic models

Zexi Liu, Fernand Cohen

Author Affiliations +

Journal of Electronic Imaging, Vol. 26, Issue 6, 063005 (November 2017). https://doi.org/10.1117/1.JEI.26.6.063005

Abstract

We describe an approach for synthesizing a three-dimensional (3-D) face structure from an image or images of a human face taken at a priori unknown poses using gender and ethnicity specific 3-D generic models. The synthesis process starts with a generic model, which is personalized as images of the person become available using preselected landmark points that are tessellated to form a high-resolution triangular mesh. From a single image, two of the three coordinates of the model are reconstructed in accordance with the given image of the person, while the third coordinate is sampled from the generic model, and the appearance is made in accordance with the image. With multiple images, all coordinates and appearance are reconstructed in accordance with the observed images. This method allows for accurate pose estimation as well as face identification in 3-D rendering of a difficult two-dimensional (2-D) face recognition problem into a much simpler 3-D surface matching problem. The estimation of the unknown pose is achieved using the Levenberg–Marquardt optimization process. Encouraging experimental results are obtained in a controlled environment with high-resolution images under a good illumination condition, as well as for images taken in an uncontrolled environment under arbitrary illumination with low-resolution cameras.

Citation Download Citation

Zexi Liu and Fernand Cohen "Synthesis and identification of three-dimensional faces from image(s) and three-dimensional generic models," Journal of Electronic Imaging 26(6), 063005 (8 November 2017). https://doi.org/10.1117/1.JEI.26.6.063005

Received: 30 March 2017; Accepted: 11 October 2017; Published: 8 November 2017

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available