Repeatability and classifier bias in computer-aided diagnosis for breast ultrasound

K. Drukker; L. L. Pesce; M. L. Giger

doi:10.1117/12.844889

9 March 2010 Repeatability and classifier bias in computer-aided diagnosis for breast ultrasound

K. Drukker, L. L. Pesce, M. L. Giger

Proceedings Volume 7624, Medical Imaging 2010: Computer-Aided Diagnosis; 76242B (2010) https://doi.org/10.1117/12.844889
Event: SPIE Medical Imaging, 2010, San Diego, California, United States

Abstract

The purpose was to investigate the repeatability and bias of the output of two classifiers commonly used in computeraided diagnosis for the task of distinguishing benign from malignant lesions. Classifier training and testing were performed within a bootstrap approach using a dataset of 125 sonographic breast lesions (54 malignant, 71 benign). The classifiers investigated were linear discriminant analysis (LDA) and a Bayesian Neural Net (BNN) with 5 hidden units. Both used the same 4 input lesion features. The bootstrap .632plus area under the ROC curve (AUC) was used as a summary performance metric. On an individual case basis, the variability of the classifier output was used in a detailed performance evaluation of repeatability and bias. The LDA obtained an AUC value of 0.87 with 95% confidence interval [0.81; 0.92]. For the BNN, those values were 0.86 and [.76; .93], respectively. The classifier outputs for individual cases displayed better repeatability (less variability) for the LDA than for the BNN and for the LDA the maximum repeatability (lowest variability) lied in the middle of the range of possible outputs, while the BNN was least repeatable (highest variability) in this region. There was a small but significant systematic bias in the LDA output, however, while for the BNN the bias appeared to be weak. In summary, while ROC analysis suggested similar classifier performance, there were substantial differences in classifier behavior on a by-case basis. Knowledge of this behavior is crucial for successful translation and implementation of computer-aided diagnosis in clinical decision making.

Citation Download Citation

K. Drukker, L. L. Pesce, and M. L. Giger "Repeatability and classifier bias in computer-aided diagnosis for breast ultrasound", Proc. SPIE 7624, Medical Imaging 2010: Computer-Aided Diagnosis, 76242B (9 March 2010); https://doi.org/10.1117/12.844889

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available