Translator Disclaimer
16 January 2006 Video scene retrieval with symbol sequence based on integrated audio and visual features
Author Affiliations +
Abstract
In this paper, we propose a method to retrieve semantically similar scenes to a query video from large scale video databases at high speed. Our method uses the audio features and the color histogram as the visual feature because the audio signal is closely related with the semantic content of videos and the color is an extensively used feature for content-based image retrieval systems. The feature vectors are extracted from video segments called packets and clustered in the feature vector space and transformed into symbols that represent the cluster IDs. Consequently, a video is expressed as a symbol sequence based on audio and visual features. Quick retrieval of similar scenes can be realized by symbol sequence matching. We conduct some experiments using audio, visual, and both features, and examine the effect of each feature on videos of various genres.
© (2006) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Keisuke Morisawa, Naoko Nitta, and Noboru Babaguchi "Video scene retrieval with symbol sequence based on integrated audio and visual features", Proc. SPIE 6073, Multimedia Content Analysis, Management, and Retrieval 2006, 607307 (16 January 2006); https://doi.org/10.1117/12.643586
PROCEEDINGS
10 PAGES


SHARE
Advertisement
Advertisement
Back to Top