Improving motion sickness severity classification through multi-modal data fusion

Mark Dennison Jr.; Mike D'Zmura; Andre Harrison; Michael Lee; Adrienne Raglin

doi:10.1117/12.2519085

10 May 2019 Improving motion sickness severity classification through multi-modal data fusion

Mark Dennison Jr., Mike D'Zmura, Andre Harrison, Michael Lee, Adrienne Raglin

Proceedings Volume 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications; 110060T (2019) https://doi.org/10.1117/12.2519085
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

Head mounted displays (HMD) may prove useful for synthetic training and augmentation of military C5ISR decisionmaking. Motion sickness caused by such HMD use is detrimental, resulting in decreased task performance or total user dropout. The genesis of sickness symptoms is often measured using paper surveys, which are difficult to deploy in live scenarios. Here, we demonstrate a new way to track sickness severity using machine learning on data collected from heterogeneous, non-invasive sensors worn by users who navigated a virtual environment while remaining stationary in reality. We discovered that two models, one trained on heterogeneous sensor data and another trained only on electroencephalography (EEG) data, were able to classify sickness severity with over 95% accuracy and were statistically comparable in performance. Greedy feature optimization was used to maximize accuracy while minimizing the feature subspace. We found that across models, the features with the most weight were previously reported in the literature as being related to motion sickness severity. Finally, we discuss how models constructed on heterogeneous vs homogeneous sensor data may be useful in different real-world scenarios.

Conference Presentation

Citation Download Citation

Mark Dennison Jr., Mike D'Zmura, Andre Harrison, Michael Lee, and Adrienne Raglin "Improving motion sickness severity classification through multi-modal data fusion", Proc. SPIE 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, 110060T (10 May 2019); https://doi.org/10.1117/12.2519085

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available