The classification of facial expressions with multi-cultural backgrounds: an event-related fMRI study

Sutao Song; Chunyu Liu; Lijie Huang; Zhiyuan Cao; Jiacai Zhang; Shuhua Wei; Jimei Dong

doi:10.1117/12.2539251

27 November 2019 The classification of facial expressions with multi-cultural backgrounds: an event-related fMRI study

Sutao Song, Chunyu Liu, Lijie Huang, Zhiyuan Cao, Jiacai Zhang, Shuhua Wei, Jimei Dong

Proceedings Volume 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence; 113211S (2019) https://doi.org/10.1117/12.2539251
Event: The Second International Conference on Image, Video Processing and Artifical Intelligence, 2019, Shanghai, China

Abstract

Expression recognition is important for our social interaction and communications, but the role of face-selective regions in discriminating various facial expressions remain unclear, especially when the expressions came from multi-cultural backgrounds. In this study, 800 facial expressions collected from 5 different facial expression databases with western or eastern cultural backgrounds were shown to the subjects in a slow event-related fMRI experiment. The subjects were instructed to indicate the category of facial expressions (happy, disgust, angry or neutral) by pressing different buttons. One multivariate pattern analysis method, support vector machine was trained to predict the categories of facial expressions. Results showed that: (1) the face selective regions differed in their ability for expression decoding, but a similar pattern was observed, with a predominance to classify facial expressions with opposite valence, i.e. happy vs. fear and happy vs. disgust. Besides, angry vs. disgust and happy vs. neutral achieved the lowest results. (2) the accuracies of facial expression classification cross-databases were as high as the accuracy of the generalization across runs withindatabase. These results provided evidence for the consistency of the representation of facial expressions in human brain with different culture backgrounds.

Citation Download Citation

Sutao Song, Chunyu Liu, Lijie Huang, Zhiyuan Cao, Jiacai Zhang, Shuhua Wei, and Jimei Dong "The classification of facial expressions with multi-cultural backgrounds: an event-related fMRI study", Proc. SPIE 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence, 113211S (27 November 2019); https://doi.org/10.1117/12.2539251

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Functional magnetic resonance imaging

Databases

Image classification

Amygdala

Brain

Picosecond phenomena

Facial recognition systems

Show All Keywords

Keywords/Phrases

Search In:

Publication Years