29 April 2005 A novel technique for assessing the case-specific reliability of decisions made by CAD tools
Author Affiliations +
We present a novel technique that provides a case-specific confidence measure for artificial neural network (ANN) based computer-assisted diagnostic (CAD) decisions. The technique relies on the analysis of the feature space neighborhood for each query case and dynamically creates a validation set that allows estimation of a local accuracy of the decisions made by the network. Then a case-specific reliability measure is assigned to each system's response, which can be used to stratify network's predictions according to the acceptable validation error value. The study was performed using a database containing 1,337 mammographic regions of interest (ROIs) with biopsy-proven diagnosis (681 with masses, 656 with normal parenchyma). Two types of neural networks (1) a feed forward network with error back propagation (BPNN) and (2) a generalized regression neural network with RBF nodes (GRNN) were developed to detect masses based on 8 morphological features automatically extracted from each ROI. The performance of the networks was evaluated with Receiver Operating Characteristics (ROC) analysis. The study shows that as the threshold on the acceptable validation error declines, the technique rejects more CAD decisions as not reliable enough. However, the ROC performance for the reliable results steadily improves (from Az = 0.88 to Az = 0.98 for BPNN, from Az = 0.86 to Az = 0.97 for GRNN). The proposed technique provides a stratification strategy for predictions made by CAD tools and can be applied to any type of decision algorithms.
© (2005) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Piotr A. Habas, Georgia D. Tourassi, Nevine H. Eltonsy, Adel S. Elmaghraby, Jacek M Zurada, "A novel technique for assessing the case-specific reliability of decisions made by CAD tools", Proc. SPIE 5747, Medical Imaging 2005: Image Processing, (29 April 2005); doi: 10.1117/12.595597; https://doi.org/10.1117/12.595597

Back to Top