Real-time face tracking and pose correction for face recognition using active appearance models

Jingu Heo; Marios Savvides

doi:10.1117/12.720978

12 April 2007 Real-time face tracking and pose correction for face recognition using active appearance models

Jingu Heo, Marios Savvides

Proceedings Volume 6539, Biometric Technology for Human Identification IV; 65390K (2007) https://doi.org/10.1117/12.720978
Event: Defense and Security Symposium, 2007, Orlando, Florida, United States

Abstract

This paper presents a fully automatic real-time face recognition system from video by using Active Appearance Models (AAM) for fitting and tracking facial fiducial landmarks and warping the non-frontal faces into a frontal pose. By implementing a face detector for locating suitable initialization step of the AAM shape searching and fitting process, new facial images are interpreted and tracked accurately in real time (15fps). Using an Active Appearance Model (AAM) for normalizing facial images under different poses and expressions is crucial to providing improved face recognition performance as most systems degrade matching performance with even smallest pose variation. Furthermore the AAM is a more robust feature registration tracking approach as most systems detect and locate the eyes while AAMs detect and track multiple fiducial points on the face holistically. We show examples of AAM fitting and tracking and pose normalization including an illumination pre-processing step to remove specular and cast shadow illumination artifacts on the face. We show example pose normalization images as well as example matching scores showing the improved performance of this pose correction method.

Citation Download Citation

Jingu Heo and Marios Savvides "Real-time face tracking and pose correction for face recognition using active appearance models", Proc. SPIE 6539, Biometric Technology for Human Identification IV, 65390K (12 April 2007); https://doi.org/10.1117/12.720978

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available