All medical image segmentation algorithms need to be validated and compared, and yet no evaluation framework
is widely accepted within the imaging community. Collections of segmentation results often need to be compared
and ranked by their effectiveness. Evaluation measures which are popular in the literature are based on region
overlap or boundary distance. None of these are consistent in the way they rank segmentation results: they
tend to be sensitive to one or another type of segmentation error (size, location, shape) but no single measure
covers all error types. We introduce a new family of measures, with hybrid characteristics. These measures
quantify similarity/difference of segmented regions by considering their overlap around the region boundaries.
This family is more sensitive than other measures in the literature to combinations of segmentation error types.
We compare measure performance on collections of segmentation results sourced from carefully compiled 2D
synthetic data, and also on 3D medical image volumes. We show that our new measure: (1) penalises errors
successfully, especially those around region boundaries; (2) gives a low similarity score when existing measures
disagree, thus avoiding overly inflated scores; and (3) scores segmentation results over a wider range of values. We
consider a representative measure from this family and the effect of its only free parameter on error sensitivity,
typical value range, and running time.
Varduhi Yeghiazaryan and Irina Voiculescu, "Boundary overlap for medical image segmentation evaluation," Proc. SPIE 10135, Medical Imaging 2017: Image-Guided Procedures, Robotic Interventions, and Modeling, 101351J (Presented at SPIE Medical Imaging: February 16, 2017; Published: 3 March 2017); https://doi.org/10.1117/12.2254496.
Conference Presentations are recordings of oral presentations given at SPIE conferences and published as part of the conference proceedings. They include the speaker's narration along with a video recording of the presentation slides and animations. Many conference presentations also include full-text papers. Search and browse our growing collection of more than 12,000 conference presentations, including many plenary and keynote presentations.