Videophone coding based on 3D modeling of facial muscles

Fabio Lavagetto; Sergio Curinga

doi:10.1117/12.131407

Translator Disclaimer

1 November 1992 Videophone coding based on 3D modeling of facial muscles

Fabio Lavagetto; Sergio Curinga

Author Affiliations +

Proceedings Volume 1818, Visual Communications and Image Processing '92; (1992) https://doi.org/10.1117/12.131407
Event: Applications in Optical Science and Engineering, 1992, Boston, MA, United States

Abstract

In this paper an innovative approach to videophone coding is described, based on a 3D model of a human face with a complex muscle structure capable to reproduce faithfully the basic facial expressions and mimics. The muscle structure is organized in a set of interconnected fibers covering the whole surface of the face and characterized by predefined mechanical properties. Muscles can be activated through the direct stimulation of each individual fiber or, indirectly, by interaction with adjacent stimulated fibers. Through the analysis algorithms performed at the transmitter, the input video sequence is processed to extract a set of suitable facial control features and to estimate the muscle parameters. These parameters, namely the value of the estimated muscle stimula, are then quantized, coded and transmitted to the receiver where they are applied to the model to synthesize the corresponding facial expression. In the paper the muscle structure is described together with the coding/decoding algorithms which have been implemented on a multiprocessor AT&T Pixel Machine. Some samples of the achieved experimental results are also presented to show the significant subjective quality of the reconstructed sequence.

Citation Download Citation

Fabio Lavagetto and Sergio Curinga "Videophone coding based on 3D modeling of facial muscles", Proc. SPIE 1818, Visual Communications and Image Processing '92, (1 November 1992); https://doi.org/10.1117/12.131407

ACCESS THE FULL ARTICLE