15 November 2007 Audio-visual affective expression recognition
Author Affiliations +
Proceedings Volume 6788, MIPPR 2007: Pattern Recognition and Computer Vision; 678802 (2007) https://doi.org/10.1117/12.782299
Event: International Symposium on Multispectral Image Processing and Pattern Recognition, 2007, Wuhan, China
Automatic affective expression recognition has attracted more and more attention of researchers from different disciplines, which will significantly contribute to a new paradigm for human computer interaction (affect-sensitive interfaces, socially intelligent environments) and advance the research in the affect-related fields including psychology, psychiatry, and education. Multimodal information integration is a process that enables human to assess affective states robustly and flexibly. In order to understand the richness and subtleness of human emotion behavior, the computer should be able to integrate information from multiple sensors. We introduce in this paper our efforts toward machine understanding of audio-visual affective behavior, based on both deliberate and spontaneous displays. Some promising methods are presented to integrate information from both audio and visual modalities. Our experiments show the advantage of audio-visual fusion in affective expression recognition over audio-only or visual-only approaches.
© (2007) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Thomas S. Huang, Zhihong Zeng, "Audio-visual affective expression recognition", Proc. SPIE 6788, MIPPR 2007: Pattern Recognition and Computer Vision, 678802 (15 November 2007); doi: 10.1117/12.782299; https://doi.org/10.1117/12.782299


Collaborative data analysis with smart tangible devices
Proceedings of SPIE (February 03 2014)
An investigation of digital creative of the Chih-Kan-Tower
Proceedings of SPIE (October 28 2011)
Video database system for studying animal behavior
Proceedings of SPIE (November 01 1996)
MetaSEEk: a content-based metasearch engine for images
Proceedings of SPIE (December 23 1997)
Body language user interface (BLUI)
Proceedings of SPIE (July 17 1998)
Battlespace situation awareness for Force XXI
Proceedings of SPIE (June 26 1997)

Back to Top