Translator Disclaimer
8 February 2012 Markerless 3D facial motion capture system
Author Affiliations +
We propose a novel markerless 3D facial motion capture system using only one common camera. This system is simple and easy to transfer facial expressions of a user's into virtual world. It has robustly tracking facial feature points associated with head movements. In addition, it estimates high accurate 3D points' locations. We designed novel approaches to the followings; Firstly, for precisely 3D head motion tracking, we applied 3D constraints using a 3D face model on conventional 2D feature points tracking approach, called Active Appearance Model (AAM). Secondly, for dealing with various expressions of a user's, we designed 2D face generic models from around 5000 images data and 3D shape data including symmetric and asymmetric facial expressions. Lastly, for accurately facial expression cloning, we invented a manifold space to successfully transfer 2D low dimensional feature points to 3D high dimensional points. The manifold space is defined by eleven facial expression bases.
© (2012) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Youngkyoo Hwang, Jung-Bae Kim, Xuetao Feng, Won-Chul Bang, Taehyun Rhee, James D.K. Kim, and ChangYeong Kim "Markerless 3D facial motion capture system", Proc. SPIE 8289, The Engineering Reality of Virtual Reality 2012, 828909 (8 February 2012);


BTF Potts compound texture model
Proceedings of SPIE (March 12 2015)
Model-based head tracking and 3D pose estimation
Proceedings of SPIE (September 23 1998)
Learning a statistical 3D geometric head model
Proceedings of SPIE (January 09 2003)
Volumetric apparel for visible female
Proceedings of SPIE (March 15 2000)
Shape, Depth, And Nonrigid Motion From Profiles
Proceedings of SPIE (March 28 1988)

Back to Top