iFER: facial expression recognition using automatically selected geometric eye and eyebrow features

Ismail Oztel; Gozde Yolcu; Cemil Öz; Serap Kazan; Filiz Bunyak

doi:10.1117/1.JEI.27.2.023003

5 March 2018 iFER: facial expression recognition using automatically selected geometric eye and eyebrow features

Ismail Oztel, Gozde Yolcu, Cemil Öz, Serap Kazan, Filiz Bunyak

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 2, 023003 (March 2018). https://doi.org/10.1117/1.JEI.27.2.023003

Abstract

Facial expressions have an important role in interpersonal communications and estimation of emotional states or intentions. Automatic recognition of facial expressions has led to many practical applications and became one of the important topics in computer vision. We present a facial expression recognition system that relies on geometry-based features extracted from eye and eyebrow regions of the face. The proposed system detects keypoints on frontal face images and forms a feature set using geometric relationships among groups of detected keypoints. Obtained feature set is refined and reduced using the sequential forward selection (SFS) algorithm and fed to a support vector machine classifier to recognize five facial expression classes. The proposed system, iFER (eye–eyebrow only facial expression recognition), is robust to lower face occlusions that may be caused by beards, mustaches, scarves, etc. and lower face motion during speech production. Preliminary experiments on benchmark datasets produced promising results outperforming previous facial expression recognition studies using partial face features, and comparable results to studies using whole face information, only slightly lower by ∼ 2.5 % compared to the best whole face facial recognition system while using only ∼ 1 / 3 of the facial region.

Citation Download Citation

Ismail Oztel, Gozde Yolcu, Cemil Öz, Serap Kazan, and Filiz Bunyak "iFER: facial expression recognition using automatically selected geometric eye and eyebrow features," Journal of Electronic Imaging 27(2), 023003 (5 March 2018). https://doi.org/10.1117/1.JEI.27.2.023003

Received: 19 September 2017; Accepted: 9 February 2018; Published: 5 March 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available