ISee: perceptual features for image library navigation

Aleksandra Mojsilovic; Jose Gomes; Bernice E. Rogowitz

doi:10.1117/12.469523

30 May 2002 ISee: perceptual features for image library navigation

Aleksandra Mojsilovic, Jose Gomes, Bernice E. Rogowitz

Proceedings Volume 4662, Human Vision and Electronic Imaging VII; (2002) https://doi.org/10.1117/12.469523
Event: Electronic Imaging, 2002, San Jose, California, United States

Abstract

To develop more satisfying image navigation systems, we need tools to construct a semantic bridge between the user and the database. In this paper we present an image indexing scheme and a query language, which allow the user to introduce a cognitive dimension to the search. At an abstract level, this approach consists of: 1) learning the natural language that humans speak to communicate their semantic experience of images, 2) understand the relationships between this language and objective measurable image attributes, and then 3) develop the corresponding feature extraction schemes. In our previous work we have conducted a number of subjective experiments in which we asked human subjects to group images, and then explain verbally why they did so. The results of this study indicated that part of the abstraction involved in image interpretation is often driven by semantic categories, which can be broken into more tangible semantic entities, i.e. objective semantic indicators. By analyzing our experimental data, we identified some candidate semantic categories (i.e. portraits, people, crowds, cityscapes, landscapes, etc.), discovered their underlying semantic indicators (i.e. skin, sky, water, object, etc.), and derived important low-level image descriptors accounting for our perception of these indicators. In our recent work we have used these findings to develop a set of image features that match the way humans communicate image meaning, and a semantic-friendly query language for browsing and searching diverse collections of images. We have implemented our approach into an Internet search engine, ISee, and tested it on a large number of images. The results we obtained are very promising.

Citation Download Citation

Aleksandra Mojsilovic, Jose Gomes, and Bernice E. Rogowitz "ISee: perceptual features for image library navigation", Proc. SPIE 4662, Human Vision and Electronic Imaging VII, (30 May 2002); https://doi.org/10.1117/12.469523

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available