17 January 2005 Virtual mirror based on 3D-shape reconstruction and real-time face tracking
Author Affiliations +
Proceedings Volume 5670, Internet Imaging VI; (2005); doi: 10.1117/12.585841
Event: Electronic Imaging 2005, 2005, San Jose, California, United States
Abstract
Human face gives various kinds of information such as feeling, age, physical condition and so on. Therefore it is important to acquire and reconstruct the facial pattern precisely for various kinds of applications. Our goal is to create the electronic cosmetics systems with real-time tracking of 3D facial pattern. A simple 3D virtual mirror interface system is proposed for acquisition and reconstruction of facial pattern, which enables a real time tracking of 3D facial pattern. The movement of lip in the face, which can be estimated based on mean shift and Kalman filter is introduced to recognize the rotation and parallel shift of face. Modified Photometric Stereo Method is also proposed to acquire the 3D shape without the influence of deficiency in shadow area of the object. It is shown that the proposed system is effective to acquire and reconstruct for the real-time tracking of 3D facial pattern image than traditional approaches. We consider that this interface can be applied to the electronic cosmetics systems that can simulate make-up, plastic surgery and color appearance under various illuminations.
© (2005) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Takao Makino, Toshiya Nakaguchi, Norimichi Tsumura, Yoichi Miyake, "Virtual mirror based on 3D-shape reconstruction and real-time face tracking", Proc. SPIE 5670, Internet Imaging VI, (17 January 2005); doi: 10.1117/12.585841; http://dx.doi.org/10.1117/12.585841
PROCEEDINGS
8 PAGES


SHARE
KEYWORDS
3D image processing

3D acquisition

Mirrors

Filtering (signal processing)

Laser induced plasma spectroscopy

Neck

3D image reconstruction

Back to Top