Using a model of the human visual system to identify features for the indexing and retrieval of images

John Arthur Black Jr.; Sethuraman Panchanathan

doi:10.1117/12.360417

24 August 1999 Using a model of the human visual system to identify features for the indexing and retrieval of images

John Arthur Black Jr., Sethuraman Panchanathan

Proceedings Volume 3846, Multimedia Storage and Archiving Systems IV; (1999) https://doi.org/10.1117/12.360417
Event: Photonics East '99, 1999, Boston, MA, United States

Abstract

The ability to characterize the important features of images is vital when responding to queries directed to an image database. Ideally, to produce results that are satisfactory to a human user, the system should employ methods for characterizing the image that are similar to those used by the human visual systems. However, global mathematical techniques such as histogram or frequency-based transforms bear little resemblance to the early processing steps performed on the visual stream by the hum,na visual system, as it is passed from the eye into the brain. This paper presents a model that employs a sequence of spatial convolutions and thresholding operations to mimic the neural behavior of the visual pathway, including the bipolar cells, the horizontal cells, and the retinal ganglion cells of the retina, the Lateral Geniculate Nucleus and the simple cells of the primary visual cortex. hen this model is applied to an image, the result is a 2D pattern of excitation similar to that observed by neural scientist in the primary visual cortex of primates. Given the fact that the excitation pattern in the primary visual cortex is the basis for virtually all higher-level visual processing, this pattern represents the visual system's selection of the most important feature in the image. By processing this 2D pattern in ways similar to the later stages of the human visual system, an image archiving system could characterize an image in ways that are similar to the human visual system. To demonstrate one use for the model, this paper uses the patterns generated from images of several complex 3D textures to determine the direction of the light falling on each of them.

Citation Download Citation

John Arthur Black Jr. and Sethuraman Panchanathan "Using a model of the human visual system to identify features for the indexing and retrieval of images", Proc. SPIE 3846, Multimedia Storage and Archiving Systems IV, (24 August 1999); https://doi.org/10.1117/12.360417

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Visualization

Visual system

Visual process modeling

Retina

Convolution

Image processing

Light sources

Show All Keywords

Keywords/Phrases

Search In:

Publication Years