1 July 2007 New benchmark for image segmentation evaluation
Author Affiliations +
Image segmentation and its performance evaluation are very difficult but important problems in computer vision. A major challenge in segmentation evaluation comes from the fundamental conflict between generality and objectivity: For general-purpose segmentation, the ground truth and segmentation accuracy may not be well defined, while embedding the evaluation in a specific application, the evaluation results may not be extensible to other applications. We present a new benchmark to evaluate five different image segmentation methods according to their capability to separate a perceptually salient structure from the background with a relatively small number of segments. This way, we not only find a large variety of images that satisfy the requirement of good generality, but also construct ground-truth segmentations to achieve good objectivity. We also present a special strategy to address two important issues underlying this benchmark: (1) most image-segmentation methods are not developed to directly extract a single salient structure; (2) many real images have multiple salient structures. We apply this benchmark to evaluate and compare the performance of several state-of-the-art image segmentation methods, including the normalized-cut method, the watershed method, the efficient graph-based method, the mean-shift method, and the ratio-cut method.
© (2007) Society of Photo-Optical Instrumentation Engineers (SPIE)
Feng Ge, Feng Ge, Song Wang, Song Wang, Tiecheng Liu, Tiecheng Liu, } "New benchmark for image segmentation evaluation," Journal of Electronic Imaging 16(3), 033011 (1 July 2007). https://doi.org/10.1117/1.2762250 . Submission:


Patch forest a hybrid framework of random forest...
Proceedings of SPIE (March 20 2016)
Computer vision based room interior design
Proceedings of SPIE (December 07 2015)
AWM: Adaptive Weight Matting for medical image segmentation
Proceedings of SPIE (February 23 2017)
Vehicle tracking for urban surveillance
Proceedings of SPIE (April 14 2008)
Finding regions of interest for content extraction
Proceedings of SPIE (December 16 1998)

Back to Top