Neural-network approach to determine operator hand orientation for teleoperated control of a robot manipulator

Cedric Cocaud; Jonathan Kofman; Amor Jnifene

doi:10.1117/12.580349

25 October 2004 Neural-network approach to determine operator hand orientation for teleoperated control of a robot manipulator

Cedric Cocaud, Jonathan Kofman, Amor Jnifene

Author Affiliations +

Proceedings Volume 5602, Optomechatronic Sensors, Actuators, and Control; (2004) https://doi.org/10.1117/12.580349
Event: Optics East, 2004, Philadelphia, Pennsylvania, United States

Abstract

In robot-manipulator teleoperation, vision-based tracking of the human operator motion offers a non-contacting approach that permits unhindered operator motion. To control the robot manipulator, the three-dimensional (3D) position and orientation of the arm of the operator is required. This paper presents a neural-network (NN) based method of determining the orientation of the human hand using non-invasive markerless vision-based tracking. The tracking method uses images of the hand from two fixed cameras to determine three angles of hand orientation. The neural network processing to determine the hand orientation consists of five procedures. First, a preprocessing system performs basic transformations on the input images to prepare them to be interpreted by the neural network. Secondly, an unsupervised neural network extracts relevant local features necessary to recognize the input patterns. Thirdly, a self-organizing neural network combines the local features of the previous network to identify the global pattern. Next, a modified radial-basis function (RBF) neural network calculates the probabilities that a given input pattern corresponds to each basic pattern, for which the RBF NN was trained. Finally, the orientation of the hand is interpolated between these basic patterns by calculating the weighted average of the most probable configurations identified by the RBF NN.

Citation Download Citation

Cedric Cocaud, Jonathan Kofman, and Amor Jnifene "Neural-network approach to determine operator hand orientation for teleoperated control of a robot manipulator", Proc. SPIE 5602, Optomechatronic Sensors, Actuators, and Control, (25 October 2004); https://doi.org/10.1117/12.580349

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Neural networks

Sensors

Image segmentation

Neurons

Cameras

Image filtering

Visualization

Show All Keywords

Keywords/Phrases

Search In:

Publication Years