Artificial intelligence-based interactive virtual reality-assisted gaming system for hand rehabilitation

Mayaank Pillai; Yilin Yang; Corey Ditmars; Hrebesh Subhash

doi:10.1117/12.2549372

2 March 2020 Artificial intelligence-based interactive virtual reality-assisted gaming system for hand rehabilitation

Mayaank Pillai, Yilin Yang, Corey Ditmars, Hrebesh Subhash

Proceedings Volume 11318, Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications; 113180J (2020) https://doi.org/10.1117/12.2549372
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

Over the past few years, the use of the off-the-shelf video game platform as a rehabilitation tool has gained much interest in physiotherapy. In this paper, we describe an avenue for the integration of virtual reality (VR) and artificial intelligence (AI) based game tracking techniques applied for the purposes of improving the effectiveness of home-care hand physical therapy. We provide an overview of the software and hardware implementation of the prototype based on a LEAP motion sensor input device, which provides two 850nm wavelength infrared (IR) tracking cameras, and an Oculus virtual reality headset. In this initial study, an interactive game is developed on the Unity VR gaming platform that dynamically adjusts the levels of the game to the player performance based on adaptive hand gesture tracking and analysis Al algorithms. A preliminary game evaluation study is conducted on a human subject that showcases the efficiency of the proposed method.

Conference Presentation

Citation Download Citation

Mayaank Pillai, Yilin Yang, Corey Ditmars, and Hrebesh Subhash "Artificial intelligence-based interactive virtual reality-assisted gaming system for hand rehabilitation", Proc. SPIE 11318, Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications, 113180J (2 March 2020); https://doi.org/10.1117/12.2549372

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available