Knowledge-based scene analysis with saccadic eye movements

Kerstin Schill; Elisabeth Umkehrer; Stephan Beinlich; Gerhard Krieger; Christoph Zetzsche

doi:10.1117/12.348483

19 May 1999 Knowledge-based scene analysis with saccadic eye movements

Kerstin Schill, Elisabeth Umkehrer, Stephan Beinlich, Gerhard Krieger, Christoph Zetzsche

Proceedings Volume 3644, Human Vision and Electronic Imaging IV; (1999) https://doi.org/10.1117/12.348483
Event: Electronic Imaging '99, 1999, San Jose, CA, United States

Abstract

The perception of an image by a human observer is usually modeled as a parallel process in which all parts of the image are treated more or less equivalently, but in reality the analysis of scenes is a highly selective procedure, in which only a small subset of image locations is processed by the precise and efficient neural machinery of foveal vision. To understand the principles behind this selection of the 'informative' regions of images we have developed a hybrid system, which consists of a combination of a knowledge-based reasoning system wit a low-level preprocessing by linear and nonlinear neural operators. This hybrid system is intended as a first step towards a compete model of the sensorimotor system of saccadic scene analysis. In the analysis of a scene, the system calculates in each step which eye movement has to be made to reach a maximum of information about the scene. The possible information gain is calculated by means of a parallel strategy which is suitable for adaptive reasoning. The output of the system is a fixation sequence, and finally, a hypothesis about the scene.

Citation Download Citation

Kerstin Schill, Elisabeth Umkehrer, Stephan Beinlich, Gerhard Krieger, and Christoph Zetzsche "Knowledge-based scene analysis with saccadic eye movements", Proc. SPIE 3644, Human Vision and Electronic Imaging IV, (19 May 1999); https://doi.org/10.1117/12.348483

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available