10 July 2000 Using a natural language and gesture interface for unmanned vehicles
Author Affiliations +
Unmanned vehicles, such as mobile robots, must exhibit adjustable autonomy. They must be able to be self-sufficient when the situation warrants; however, as they interact with each other and with humans, they must exhibit an ability to dynamically adjust their independence or dependence as co-operative agents attempting to achieve some goal. This is what we mean by adjustable autonomy. We have been investigating various modes of communication that enhance a robot's capability to work interactively with other robots and with humans. Specifically, we have been investigating how natural language and gesture can provide a user- friendly interface to mobile robots. We have extended this initial work to include semantic and pragmatic procedures that allow humans and robots to act co-operatively, based on whether or not goals have been achieved by the various agents in the interaction. By processing commands that are either spoken or initiated by clicking buttons on a Personal Digital Assistant and by gesturing either naturally or symbolically, we are tracking the various goals of the interaction, the agent involved in the interaction, and whether or not the goal has been achieved. The various agents involved in achieving the goals are each aware of their own and others' goals and what goals have been stated or accomplished so that eventually any member of the group, be it robot or a human, if necessary, can interact with the other members to achieve the stated goals of a mission.
© (2000) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Dennis Perzanowski, Dennis Perzanowski, Alan C. Schultz, Alan C. Schultz, William Adams, William Adams, Elaine Marsh, Elaine Marsh, } "Using a natural language and gesture interface for unmanned vehicles", Proc. SPIE 4024, Unmanned Ground Vehicle Technology II, (10 July 2000); doi: 10.1117/12.391644; https://doi.org/10.1117/12.391644


Mobility Systems For Robotic Vehicles
Proceedings of SPIE (February 24 1987)
Minimum-resource distributed navigation and mapping
Proceedings of SPIE (March 01 2001)
Evolutionary strategy for achieving autonomous navigation
Proceedings of SPIE (January 07 1999)
Object-oriented methods for modular robotic systems
Proceedings of SPIE (October 29 1996)
Towards A Modular Robotic Architecture
Proceedings of SPIE (March 09 1989)

Back to Top