Natural interaction for unmanned systems

Glenn Taylor; Ben Purman; Paul Schermerhorn; Guillermo Garcia-Sampedro; Matt Lanting; Michael Quist; Chris Kawatsu

doi:10.1117/12.2180008

Translator Disclaimer

22 May 2015 Natural interaction for unmanned systems

Glenn Taylor, Ben Purman, Paul Schermerhorn, Guillermo Garcia-Sampedro, Matt Lanting, Michael Quist, Chris Kawatsu

Author Affiliations +

Proceedings Volume 9468, Unmanned Systems Technology XVII; 946805 (2015) https://doi.org/10.1117/12.2180008
Event: SPIE Defense + Security, 2015, Baltimore, Maryland, United States

Abstract

Military unmanned systems today are typically controlled by two methods: tele-operation or menu-based, search-andclick interfaces. Both approaches require the operator’s constant vigilance: tele-operation requires constant input to drive the vehicle inch by inch; a menu-based interface requires eyes on the screen in order to search through alternatives and select the right menu item. In both cases, operators spend most of their time and attention driving and minding the unmanned systems rather than on being a warfighter. With these approaches, the platform and interface become more of a burden than a benefit. The availability of inexpensive sensor systems in products such as Microsoft Kinect™ or Nintendo Wii™ has resulted in new ways of interacting with computing systems, but new sensors alone are not enough. Developing useful and usable human-system interfaces requires understanding users and interaction in context: not just what new sensors afford in terms of interaction, but how users want to interact with these systems, for what purpose, and how sensors might enable those interactions. Additionally, the system needs to reliably make sense of the user’s inputs in context, translate that interpretation into commands for the unmanned system, and give feedback to the user. In this paper, we describe an example natural interface for unmanned systems, called the Smart Interaction Device (SID), which enables natural two-way interaction with unmanned systems including the use of speech, sketch, and gestures. We present a few example applications SID to different types of unmanned systems and different kinds of interactions.

Citation Download Citation

Glenn Taylor, Ben Purman, Paul Schermerhorn, Guillermo Garcia-Sampedro, Matt Lanting, Michael Quist, and Chris Kawatsu "Natural interaction for unmanned systems", Proc. SPIE 9468, Unmanned Systems Technology XVII, 946805 (22 May 2015); https://doi.org/10.1117/12.2180008

ACCESS THE FULL ARTICLE