Video scene retrieval with symbol sequence based on integrated audio and visual features

Keisuke Morisawa; Naoko Nitta; Noboru Babaguchi

doi:10.1117/12.643586

16 January 2006 Video scene retrieval with symbol sequence based on integrated audio and visual features

Keisuke Morisawa, Naoko Nitta, Noboru Babaguchi

Proceedings Volume 6073, Multimedia Content Analysis, Management, and Retrieval 2006; 607307 (2006) https://doi.org/10.1117/12.643586
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

In this paper, we propose a method to retrieve semantically similar scenes to a query video from large scale video databases at high speed. Our method uses the audio features and the color histogram as the visual feature because the audio signal is closely related with the semantic content of videos and the color is an extensively used feature for content-based image retrieval systems. The feature vectors are extracted from video segments called packets and clustered in the feature vector space and transformed into symbols that represent the cluster IDs. Consequently, a video is expressed as a symbol sequence based on audio and visual features. Quick retrieval of similar scenes can be realized by symbol sequence matching. We conduct some experiments using audio, visual, and both features, and examine the effect of each feature on videos of various genres.

Citation Download Citation

Keisuke Morisawa, Naoko Nitta, and Noboru Babaguchi "Video scene retrieval with symbol sequence based on integrated audio and visual features", Proc. SPIE 6073, Multimedia Content Analysis, Management, and Retrieval 2006, 607307 (16 January 2006); https://doi.org/10.1117/12.643586

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available