Fusion Of Vision And Touch For Spatio-Temporal Reasoning In Learning Manipulation Tasks

Jan M. Zytkow; Peter W. Pachowicz

doi:10.1117/12.969994

1 March 1990 Fusion Of Vision And Touch For Spatio-Temporal Reasoning In Learning Manipulation Tasks

Jan M. Zytkow, Peter W. Pachowicz

Proceedings Volume 1198, Sensor Fusion II: Human and Machine Strategies; (1990) https://doi.org/10.1117/12.969994
Event: 1989 Symposium on Visual Communications, Image Processing, and Intelligent Robotics Systems, 1989, Philadelphia, PA, United States

Abstract

This paper presents a framework for the fusion of vision and touch, useful in learning various manipulation tasks by a robot arm. Initially the robot has poor knowledge of the laws that govern the behavior of objects, and incomplete knowledge about physical features of individual objects. We analyse the fusion of vision and touch for learning object manipulation tasks, various methods of features acquisition, and an architecture of the system that provides feedback between sensing, manipulating and learning. Simple control loops allow the system to execute the manipulation tasks and to learn such a selection of the values of control parameters that prevents faults and object damage. The main emphasis is on learning. In sections 5 and 6 we demonstrate how the system discovers new regularities, how it recognizes new and useful object properties, and how the performance on similar tasks can be improved by application of newly acquired knowledge. Sections 1-4 describe a preliminary design of an architecture that allows for application of sensor fusion and for learning by improving manipulation skills by a robot arm.

Citation Download Citation

Jan M. Zytkow and Peter W. Pachowicz "Fusion Of Vision And Touch For Spatio-Temporal Reasoning In Learning Manipulation Tasks", Proc. SPIE 1198, Sensor Fusion II: Human and Machine Strategies, (1 March 1990); https://doi.org/10.1117/12.969994

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available