30 September 2003 Teleoperation of a robot manipulator from 3D human hand-arm motion
Author Affiliations +
Proceedings Volume 5264, Optomechatronic Systems IV; (2003) https://doi.org/10.1117/12.515683
Event: Photonics Technologies for Robotics, Automation, and Manufacturing, 2003, Providence, RI, United States
The control of a robot manipulator by a human operator is often necessary in unstructured dynamic environments with unfamiliar objects. Remote teleoperation is required when human presence at the robot site is undesirable or difficult, such as in handling hazardous materials and operating in dangerous or inaccessible environments. Previous approaches have employed mechanical or other contacting interfaces which require unnatural motions for object manipulation tasks or hinder dexterous human motion. This paper presents a non-contacting method of teleoperating a robot manipulator by having the human operator perform the 3D human hand-arm motion that would naturally be used to compete an object manipulation task and tracking the motion with a stereo-camera system at a local site. The 3D human hand-arm motion is reconstructed at the remote robot site and is used to control the position and orientation of the robot manipulator end-effector in real-time. Images captured of the robot interacting with objects at the remote site provide visual feedback to the human operator. Tests in teleoperation of the robot manipulator have demonstrated the ability of the human to carry out object manipulator tasks remotely and the teleoperated robot manipulator system to copy human-arm motions in real-time.
© (2003) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jonathan Kofman, Jonathan Kofman, Siddharth Verma, Siddharth Verma, Xianghai Wu, Xianghai Wu, Timothy Luu, Timothy Luu, } "Teleoperation of a robot manipulator from 3D human hand-arm motion", Proc. SPIE 5264, Optomechatronic Systems IV, (30 September 2003); doi: 10.1117/12.515683; https://doi.org/10.1117/12.515683


Back to Top