24 August 1999 Video abstraction based on asymmetric similarity values
Author Affiliations +
Proceedings Volume 3846, Multimedia Storage and Archiving Systems IV; (1999) https://doi.org/10.1117/12.360422
Event: Photonics East '99, 1999, Boston, MA, United States
The paper addresses visual similarity measuring and hierarchical groping of the most representative frames for the purpose of video abstraction. Our approach concentrates on measuring similarity of image regions. To produce a visual similarity measure we used as primary information the color histograms in the YUV color space. The difference from previous histogram based approaches is that we divide the input images into rectangles whose sizes depend on the local 'structure' of the image. We assume that similar regions in two different images would have approximately the same rectangle structure. Therefore, it should ge enough to compare the color histogram of the pixels within these rectangles in order to determine the similarity of two regions in two different images. We measure similarity between regions by a similarity score that is asymmetric. Such a measure cannot be used in classical clustering techniques for grouping representative frames. Our approach is therefore based on graph theoretic techniques. First, we construct an oriented weighted graph having as vertices the original set of key-frames. Next, we construct the set of weighted edges, according to the similarity values computed for each ordered pair of key-frames. Finally, we transform this graph into a collection of two-level trees, whose root key-frames form an abstract of the original ones. For graph construction and transformation, we present here two algorithms. The experiments we performed with the proposed technique showed improvements with respect to the way the visual content is represented. This conclusion is based on subjective assessment of the result groupings and the selection of the most representative key-frame.
© (1999) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Sorin Marcel Iacob, Sorin Marcel Iacob, Reginald L. Lagendijk, Reginald L. Lagendijk, M. E. Iacob, M. E. Iacob, } "Video abstraction based on asymmetric similarity values", Proc. SPIE 3846, Multimedia Storage and Archiving Systems IV, (24 August 1999); doi: 10.1117/12.360422; https://doi.org/10.1117/12.360422

Back to Top