Twenty-one degrees of freedom model based hand pose tracking using a monocular RGB camera

Junyeong Choi; Jong-Il Park; Hanhoon Park

doi:10.1117/1.OE.55.1.013101

4 January 2016 Twenty-one degrees of freedom model based hand pose tracking using a monocular RGB camera

Junyeong Choi, Jong-Il Park, Hanhoon Park

Author Affiliations +

Optical Engineering, Vol. 55, Issue 1, 013101 (January 2016). https://doi.org/10.1117/1.OE.55.1.013101

Abstract

It is difficult to visually track a user’s hand because of the many degrees of freedom (DOF) a hand has. For this reason, most model-based hand pose tracking methods have relied on the use of multiview images or RGB-D images. This paper proposes a model-based method that accurately tracks three-dimensional hand poses using monocular RGB images in real time. The main idea of the proposed method is to reduce hand tracking ambiguity by adopting a step-by-step estimation scheme consisting of three steps performed in consecutive order: palm pose estimation, finger yaw motion estimation, and finger pitch motion estimation. In addition, this paper proposes highly effective algorithms for each step. With the assumption that a human hand can be considered as an assemblage of articulated planes, the proposed method uses a piece-wise planar hand model which enables hand model regeneration. The hand model regeneration modifies the hand model to fit the current user’s hand and improves the accuracy of the hand pose estimation results. Above all, the proposed method can operate in real time using only CPU-based processing. Consequently, it can be applied to various platforms, including egocentric vision devices such as wearable glasses. The results of several experiments conducted verify the efficiency and accuracy of the proposed method.

Citation Download Citation

Junyeong Choi, Jong-Il Park, and Hanhoon Park "Twenty-one degrees of freedom model based hand pose tracking using a monocular RGB camera," Optical Engineering 55(1), 013101 (4 January 2016). https://doi.org/10.1117/1.OE.55.1.013101

Published: 4 January 2016

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available