RGB-D dynamic facial dataset capture for visual speech recognition

Naveed Ahmed

doi:10.1117/12.2538762

27 November 2019 RGB-D dynamic facial dataset capture for visual speech recognition

Naveed Ahmed

Proceedings Volume 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence; 1132108 (2019) https://doi.org/10.1117/12.2538762
Event: The Second International Conference on Image, Video Processing and Artifical Intelligence, 2019, Shanghai, China

Abstract

We present a new comprehensive RGB-D dynamic facial dataset capturing system that can be used for facial recognition, emotion recognition, or visual speech processing. Our facial dataset uses an RGB-D (Kinect) camera to record 20 individuals saying 20 common English words or phrases. Using Kinect facial tracking, we not only record the facial features, but also facial outline, RGB data, depth data, mapping between RGB and depth data, facial animation units, facial shape units, and finally 2D and 3D face representations of the face along with the 3D head orientation. The captured RGBD dynamic facial dataset can be employed in several applications. We demonstrate its effectiveness by presenting a new visual speech recognition that employs three-dimensional spatial and temporal data of different facial feature points. The results demonstrate the our RGB-D dynamic facial dataset can be effectively employed in a visual speech recognition system.

Citation Download Citation

Naveed Ahmed "RGB-D dynamic facial dataset capture for visual speech recognition", Proc. SPIE 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence, 1132108 (27 November 2019); https://doi.org/10.1117/12.2538762

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available