Family of boundary overlap metrics for the evaluation of medical image segmentation

Varduhi Yeghiazaryan; Irina D. Voiculescu

doi:10.1117/1.JMI.5.1.015006

19 February 2018 Family of boundary overlap metrics for the evaluation of medical image segmentation

Varduhi Yeghiazaryan, Irina D. Voiculescu

Author Affiliations +

Journal of Medical Imaging, Vol. 5, Issue 1, 015006 (February 2018). https://doi.org/10.1117/1.JMI.5.1.015006

Abstract

All medical image segmentation algorithms need to be validated and compared, yet no evaluation framework is widely accepted within the imaging community. None of the evaluation metrics that are popular in the literature are consistent in the way they rank segmentation results: they tend to be sensitive to one or another type of segmentation error (size, location, and shape) but no single metric covers all error types. We introduce a family of metrics, with hybrid characteristics. These metrics quantify the similarity or difference of segmented regions by considering their average overlap in fixed-size neighborhoods of points on the boundaries of those regions. Our metrics are more sensitive to combinations of segmentation error types than other metrics in the existing literature. We compare the metric performance on collections of segmentation results sourced from carefully compiled two-dimensional synthetic data and three-dimensional medical images. We show that our metrics: (1) penalize errors successfully, especially those around region boundaries; (2) give a low similarity score when existing metrics disagree, thus avoiding overly inflated scores; and (3) score segmentation results over a wider range of values. We analyze a representative metric from this family and the effect of its free parameter on error sensitivity and running time.

Citation Download Citation

Varduhi Yeghiazaryan and Irina D. Voiculescu "Family of boundary overlap metrics for the evaluation of medical image segmentation," Journal of Medical Imaging 5(1), 015006 (19 February 2018). https://doi.org/10.1117/1.JMI.5.1.015006

Received: 3 May 2017; Accepted: 11 January 2018; Published: 19 February 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available