Kinect-based sign language recognition of static and dynamic hand movements

Rando C. Dalawis; Kenneth Deniel R. Olayao; Evan Geoffrey I. Ramos; Mary Jane C. Samonte

doi:10.1117/12.2266729

8 February 2017 Kinect-based sign language recognition of static and dynamic hand movements

Rando C. Dalawis, Kenneth Deniel R. Olayao, Evan Geoffrey I. Ramos, Mary Jane C. Samonte

Proceedings Volume 10225, Eighth International Conference on Graphic and Image Processing (ICGIP 2016); 102250I (2017) https://doi.org/10.1117/12.2266729
Event: Eighth International Conference on Graphic and Image Processing, 2016, Tokyo, Japan

Abstract

A different approach of sign language recognition of static and dynamic hand movements was developed in this study using normalized correlation algorithm. The goal of this research was to translate fingerspelling sign language into text using MATLAB and Microsoft Kinect. Digital input image captured by Kinect devices are matched from template samples stored in a database. This Human Computer Interaction (HCI) prototype was developed to help people with communication disability to express their thoughts with ease. Frame segmentation and feature extraction was used to give meaning to the captured images. Sequential and random testing was used to test both static and dynamic fingerspelling gestures. The researchers explained some factors they encountered causing some misclassification of signs.

Citation Download Citation

Rando C. Dalawis, Kenneth Deniel R. Olayao, Evan Geoffrey I. Ramos, and Mary Jane C. Samonte "Kinect-based sign language recognition of static and dynamic hand movements ", Proc. SPIE 10225, Eighth International Conference on Graphic and Image Processing (ICGIP 2016), 102250I (8 February 2017); https://doi.org/10.1117/12.2266729

ACCESS THE FULL ARTICLE