14 February 2013 iHand: an interactive bare-hand-based augmented reality interface on commercial mobile phones
Author Affiliations +
The performance of mobile phones has rapidly improved, and they are emerging as a powerful platform. In many vision-based applications, human hands play a key role in natural interaction. However, relatively little attention has been paid to the interaction between human hands and the mobile phone. Thus, we propose a vision- and hand gesture-based interface in which the user holds a mobile phone in one hand but sees the other hand’s palm through a built-in camera. The virtual contents are faithfully rendered on the user’s palm through palm pose estimation, and reaction with hand and finger movements is achieved that is recognized by hand shape recognition. Since the proposed interface is based on hand gestures familiar to humans and does not require any additional sensors or markers, the user can freely interact with virtual contents anytime and anywhere without any training. We demonstrate that the proposed interface works at over 15 fps on a commercial mobile phone with a 1.2-GHz dual core processor and 1 GB RAM.
© 2013 Society of Photo-Optical Instrumentation Engineers (SPIE)
Junyeong Choi, Junyeong Choi, Jungsik Park, Jungsik Park, Hanhoon Park, Hanhoon Park, Jong-II Park, Jong-II Park, } "iHand: an interactive bare-hand-based augmented reality interface on commercial mobile phones," Optical Engineering 52(2), 027206 (14 February 2013). https://doi.org/10.1117/1.OE.52.2.027206 . Submission:


3D scene reconstruction from multi-aperture images
Proceedings of SPIE (April 15 2014)
Cell phones as imaging sensors
Proceedings of SPIE (April 27 2010)

Back to Top