15 November 2007 Audio-visual affective expression recognition
Author Affiliations +
Proceedings Volume 6788, MIPPR 2007: Pattern Recognition and Computer Vision; 678802 (2007) https://doi.org/10.1117/12.782299
Event: International Symposium on Multispectral Image Processing and Pattern Recognition, 2007, Wuhan, China
Abstract
Automatic affective expression recognition has attracted more and more attention of researchers from different disciplines, which will significantly contribute to a new paradigm for human computer interaction (affect-sensitive interfaces, socially intelligent environments) and advance the research in the affect-related fields including psychology, psychiatry, and education. Multimodal information integration is a process that enables human to assess affective states robustly and flexibly. In order to understand the richness and subtleness of human emotion behavior, the computer should be able to integrate information from multiple sensors. We introduce in this paper our efforts toward machine understanding of audio-visual affective behavior, based on both deliberate and spontaneous displays. Some promising methods are presented to integrate information from both audio and visual modalities. Our experiments show the advantage of audio-visual fusion in affective expression recognition over audio-only or visual-only approaches.
© (2007) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Thomas S. Huang, Thomas S. Huang, Zhihong Zeng, Zhihong Zeng, } "Audio-visual affective expression recognition", Proc. SPIE 6788, MIPPR 2007: Pattern Recognition and Computer Vision, 678802 (15 November 2007); doi: 10.1117/12.782299; https://doi.org/10.1117/12.782299
PROCEEDINGS
8 PAGES


SHARE
RELATED CONTENT

MetaSEEk: a content-based metasearch engine for images
Proceedings of SPIE (December 23 1997)
Learning to see, seeing to learn visual aspects of...
Proceedings of SPIE (June 17 2003)
An enquiry into VR interface design for medical training ...
Proceedings of SPIE (February 08 2008)
Body language user interface (BLUI)
Proceedings of SPIE (July 17 1998)
Battlespace situation awareness for Force XXI
Proceedings of SPIE (June 26 1997)

Back to Top