Text2Video: text-driven facial animation using MPEG-4

J. Rurainsky; P. Eisert

doi:10.1117/12.631413

24 June 2005 Text2Video: text-driven facial animation using MPEG-4

J. Rurainsky, P. Eisert

Proceedings Volume 5960, Visual Communications and Image Processing 2005; 59601H (2005) https://doi.org/10.1117/12.631413
Event: Visual Communications and Image Processing 2005, 2005, Beijing, China

Abstract

We present a complete system for the automatic creation of talking head video sequences from text messages. Our system converts the text into MPEG-4 Facial Animation Parameters and synthetic voice. A user selected 3D character will perform lip movements synchronized to the speech data. The 3D models created from a single image vary from realistic people to cartoon characters. A voice selection for different languages and gender as well as a pitch shift component enables a personalization of the animation. The animation can be shown on different displays and devices ranging from 3GPP players on mobile phones to real-time 3D render engines. Therefore, our system can be used in mobile communication for the conversion of regular SMS messages to MMS animations.

Citation Download Citation

J. Rurainsky and P. Eisert "Text2Video: text-driven facial animation using MPEG-4", Proc. SPIE 5960, Visual Communications and Image Processing 2005, 59601H (24 June 2005); https://doi.org/10.1117/12.631413

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available