Translator Disclaimer
11 September 2019 Pose-invariant three-dimensional face reconstruction
Author Affiliations +

Three-dimensional (3-D) face reconstruction is an important task in the field of computer vision. Although 3-D face reconstruction has been developing rapidly in recent years, large pose face reconstruction is still a challenge. That is because much of the information about a face in a large pose will be unknowable. In order to address this issue, we propose a 3-D face reconstruction algorithm (PIFR) based on 3-D morphable model. A model alignment formulation is developed in which the original image and a normalized frontal image are combined to define a weighted loss in a landmark fitting process, with the intuition that the original image provides more expression and pose information, whereas the normalized image provides more identity information. Our method solves the problem of face reconstruction of a single image of a traditional method in a large pose, works on arbitrary pose and expressions, and greatly improves the accuracy of reconstruction. Experiments on the challenging AFW, LFPW, and AFLW database show that our algorithm significantly improves the accuracy of 3-D face reconstruction even under extreme poses (±90 yaw angles).

© 2019 SPIE and IS&T 1017-9909/2019/$28.00 © 2019 SPIE and IS&T
Lei Jiang, Xiao-Jun Wu, and Josef Kittler "Pose-invariant three-dimensional face reconstruction," Journal of Electronic Imaging 28(5), 053003 (11 September 2019).
Received: 23 March 2019; Accepted: 5 August 2019; Published: 11 September 2019

Back to Top