An improved faster R-CNN approach for robust hand detection and classification in sign language

Jinwei Wang; Zhongfu Ye

doi:10.1117/12.2503080

9 August 2018 An improved faster R-CNN approach for robust hand detection and classification in sign language

Jinwei Wang, Zhongfu Ye

Proceedings Volume 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018); 108061B (2018) https://doi.org/10.1117/12.2503080
Event: Tenth International Conference on Digital Image Processing (ICDIP 2018), 2018, Shanghai, China

Abstract

Robust hand detection and classification is one of the most essential tasks in sign language recognition. However, the problem is very challenging due to the complexity of hands in sign language. The performance of existing approaches can be easily affected by the numerous variations of sign language gestures, small and unobtrusive hand areas, and ever changing of hand locations. In this paper, to detect and classify the hands in sign language robustly, such kind of small objects that contain rich information, we propose an improved Faster R-CNN approach, namely Multi-scale Faster RCNN. Our approach extends the framework of the Faster R-CNN and a multi-scale strategy is adopted to incorporate hierarchical convolution feature maps. We evaluate our approach on the self-built sign language dataset and the experimental results demonstrate the effectiveness of our proposed approach.

Citation Download Citation

Jinwei Wang and Zhongfu Ye "An improved faster R-CNN approach for robust hand detection and classification in sign language", Proc. SPIE 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018), 108061B (9 August 2018); https://doi.org/10.1117/12.2503080

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available