22 May 2015 Multi-modal interaction for UAS control
Author Affiliations +
Abstract
Unmanned aircraft systems (UASs) have seen a dramatic increase in military operations over the last two decades. The increased demand for their capabilities on the battlefield has resulted in quick fielding with user interfaces that are designed more for engineers in mind than for UAS operators. UAS interfaces tend to support tele-operation with a joystick or complex, menu-driven interfaces that have a steep learning curve. These approaches to control require constant attention to manage a single UAS and require increased heads-down time in an interface to search for and click on the right menus to invoke commands. The time and attention required by these interfaces makes it difficult to increase a single operator’s span of control to encompass multiple UAS or the control of sensor systems. In this paper, we explore an alternative interface to the standard menu-based control interfaces. Our approach in this work was to first study how operators might want to task a UAS if they were not constrained by a typical menu interface. Based on this study, we developed a prototype multi-modal dialogue interface for more intuitive control of multiple unmanned aircraft and their sensor systems using speech and map-based gesture/sketch. The system we developed is a two-way interface that allows a user to draw on a map while speaking commands to the system, and which provides feedback to the user to ensure the user knows what the system is doing. When the system does not understand the user for some reason – for example, because speech recognition failed or because the user did not provide enough information – the system engages with the user in a dialogue to gather the information needed to perform the command. With the help of UAS operators, we conducted a user study to compare the performance of our prototype system against a representative menu-based control interface in terms of usability, time on task, and mission effectiveness. This paper describes a study to gather data about how people might use a natural interface, the system itself, and the results of the user study. Keywords: UAS control, natural interfaces, multi-modal interaction.
© (2015) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Glenn Taylor, Glenn Taylor, Ben Purman, Ben Purman, Paul Schermerhorn, Paul Schermerhorn, Guillermo Garcia-Sampedro, Guillermo Garcia-Sampedro, Robert Hubal, Robert Hubal, Kathleen Crabtree, Kathleen Crabtree, Allen Rowe, Allen Rowe, Sarah Spriggs, Sarah Spriggs, } "Multi-modal interaction for UAS control", Proc. SPIE 9468, Unmanned Systems Technology XVII, 946802 (22 May 2015); doi: 10.1117/12.2180020; https://doi.org/10.1117/12.2180020
PROCEEDINGS
8 PAGES


SHARE
RELATED CONTENT

Natural interaction for unmanned systems
Proceedings of SPIE (May 21 2015)
Dynamic networked combat capability
Proceedings of SPIE (May 25 2005)
Delegating responsibilities in human-robot teams
Proceedings of SPIE (May 08 2006)
RIPE: a robot independent programming environment
Proceedings of SPIE (January 31 1992)

Back to Top