11 September 2019 Pose-invariant three-dimensional face reconstruction
Author Affiliations +
Abstract

Three-dimensional (3-D) face reconstruction is an important task in the field of computer vision. Although 3-D face reconstruction has been developing rapidly in recent years, large pose face reconstruction is still a challenge. That is because much of the information about a face in a large pose will be unknowable. In order to address this issue, we propose a 3-D face reconstruction algorithm (PIFR) based on 3-D morphable model. A model alignment formulation is developed in which the original image and a normalized frontal image are combined to define a weighted loss in a landmark fitting process, with the intuition that the original image provides more expression and pose information, whereas the normalized image provides more identity information. Our method solves the problem of face reconstruction of a single image of a traditional method in a large pose, works on arbitrary pose and expressions, and greatly improves the accuracy of reconstruction. Experiments on the challenging AFW, LFPW, and AFLW database show that our algorithm significantly improves the accuracy of 3-D face reconstruction even under extreme poses (±90 yaw angles).

© 2019 SPIE and IS&T 1017-9909/2019/$28.00 © 2019 SPIE and IS&T
Lei Jiang, Xiao-Jun Wu, and Josef Kittler "Pose-invariant three-dimensional face reconstruction," Journal of Electronic Imaging 28(5), 053003 (11 September 2019). https://doi.org/10.1117/1.JEI.28.5.053003
Received: 23 March 2019; Accepted: 5 August 2019; Published: 11 September 2019
Lens.org Logo
CITATIONS
Cited by 1 scholarly publication.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
3D modeling

3D image reconstruction

3D image processing

Reconstruction algorithms

Facial recognition systems

Data modeling

Microelectromechanical systems

Back to Top