Family of boundary overlap metrics for the evaluation of medical image segmentation

Varduhi Yeghiazaryan; Irina D. Voiculescu

doi:10.1117/1.JMI.5.1.015006

Translator Disclaimer

19 February 2018 Family of boundary overlap metrics for the evaluation of medical image segmentation

Varduhi Yeghiazaryan, Irina D. Voiculescu

Author Affiliations +

J. of Medical Imaging, 5(1), 015006 (2018). https://doi.org/10.1117/1.JMI.5.1.015006

Abstract

All medical image segmentation algorithms need to be validated and compared, yet no evaluation framework is widely accepted within the imaging community. None of the evaluation metrics that are popular in the literature are consistent in the way they rank segmentation results: they tend to be sensitive to one or another type of segmentation error (size, location, and shape) but no single metric covers all error types. We introduce a family of metrics, with hybrid characteristics. These metrics quantify the similarity or difference of segmented regions by considering their average overlap in fixed-size neighborhoods of points on the boundaries of those regions. Our metrics are more sensitive to combinations of segmentation error types than other metrics in the existing literature. We compare the metric performance on collections of segmentation results sourced from carefully compiled two-dimensional synthetic data and three-dimensional medical images. We show that our metrics: (1) penalize errors successfully, especially those around region boundaries; (2) give a low similarity score when existing metrics disagree, thus avoiding overly inflated scores; and (3) score segmentation results over a wider range of values. We analyze a representative metric from this family and the effect of its free parameter on error sensitivity and running time.

Citation Download Citation

Varduhi Yeghiazaryan and Irina D. Voiculescu "Family of boundary overlap metrics for the evaluation of medical image segmentation," Journal of Medical Imaging 5(1), 015006 (19 February 2018). https://doi.org/10.1117/1.JMI.5.1.015006

Received: 3 May 2017; Accepted: 11 January 2018; Published: 19 February 2018

ACCESS THE FULL ARTICLE