Handheld pose tracking using vision-inertial sensors with occlusion handling

Juan Li; Maarten Slembrouck; Francis Deboeverie; Ana M. Bernardos; Juan A. Besada; Peter Veelaert; Hamid K. Aghajan; José R. Casar; Wilfried Philips

doi:10.1117/1.JEI.25.4.041012

12 July 2016 Handheld pose tracking using vision-inertial sensors with occlusion handling

Juan Li, Maarten Slembrouck, Francis Deboeverie, Ana M. Bernardos, Juan A. Besada, Peter Veelaert, Hamid K. Aghajan, José R. Casar, Wilfried Philips

Author Affiliations +

Journal of Electronic Imaging, Vol. 25, Issue 4, 041012 (July 2016). https://doi.org/10.1117/1.JEI.25.4.041012

Abstract

Tracking of a handheld device’s three-dimensional (3-D) position and orientation is fundamental to various application domains, including augmented reality (AR), virtual reality, and interaction in smart spaces. Existing systems still offer limited performance in terms of accuracy, robustness, computational cost, and ease of deployment. We present a low-cost, accurate, and robust system for handheld pose tracking using fused vision and inertial data. The integration of measurements from embedded accelerometers reduces the number of unknown parameters in the six-degree-of-freedom pose calculation. The proposed system requires two light-emitting diode (LED) markers to be attached to the device, which are tracked by external cameras through a robust algorithm against illumination changes. Three data fusion methods have been proposed, including the triangulation-based stereo-vision system, constraint-based stereo-vision system with occlusion handling, and triangulation-based multivision system. Real-time demonstrations of the proposed system applied to AR and 3-D gaming are also included. The accuracy assessment of the proposed system is carried out by comparing with the data generated by the state-of-the-art commercial motion tracking system OptiTrack. Experimental results show that the proposed system has achieved high accuracy of few centimeters in position estimation and few degrees in orientation estimation.

Citation Download Citation

Juan Li, Maarten Slembrouck, Francis Deboeverie, Ana M. Bernardos, Juan A. Besada, Peter Veelaert, Hamid K. Aghajan, José R. Casar, and Wilfried Philips "Handheld pose tracking using vision-inertial sensors with occlusion handling," Journal of Electronic Imaging 25(4), 041012 (12 July 2016). https://doi.org/10.1117/1.JEI.25.4.041012

Published: 12 July 2016

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available