Classification of mammographic microcalcification clusters with machine learning confidence levels

Andrik Rampun; Hui Wang; Bryan Scotney; Philip Morrow; Reyer Zwiggelaar

doi:10.1117/12.2318058

6 July 2018 Classification of mammographic microcalcification clusters with machine learning confidence levels

Andrik Rampun, Hui Wang, Bryan Scotney, Philip Morrow, Reyer Zwiggelaar

Proceedings Volume 10718, 14th International Workshop on Breast Imaging (IWBI 2018); 107181B (2018) https://doi.org/10.1117/12.2318058
Event: The Fourteenth International Workshop on Breast Imaging, 2018, Atlanta, Georgia, United States

Abstract

This paper presents a novel investigation of machine learning performance by examining probability outputs in conjunction with classification accuracy (CA) and area under the curve (AUC). One of the main issues in the deployment of computer-aided detection/diagnosis (CAD) systems is lack of ‘trust’ of clinicians in the CAD system, increasing the possibility of the system not being used. Whilst most authors evaluate the performance of their breast CAD systems based on CA and AUC, we study the distribution of the classifiers’ probability outputs and use it as an additional confidence level metric to indicate the reliability of a computer system. Experimental results suggest that although most classifiers produce similar results in terms of CA and AUC (less than 2% variation), their performances are significantly different when considering confidence level (10 to 25% difference). This study may provide opportunities for refining radiologists’ interaction with CAD systems and improving the reliability of CAD systems as well as diagnostic decision making in medicine with high CA or AUC with high degree of certainty.

Citation Download Citation

Andrik Rampun, Hui Wang, Bryan Scotney, Philip Morrow, and Reyer Zwiggelaar "Classification of mammographic microcalcification clusters with machine learning confidence levels", Proc. SPIE 10718, 14th International Workshop on Breast Imaging (IWBI 2018), 107181B (6 July 2018); https://doi.org/10.1117/12.2318058

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available