Analysis of confidence level scores from an ROC study: comparison of three mammographic systems for detection of simulated calcifications

Chao-Jen Lai; Chris C. Shaw; Gary J. Whitman; Wei T. Yang; Peter J. Dempsey M.D.

doi:10.1117/12.597212

20 April 2005 Analysis of confidence level scores from an ROC study: comparison of three mammographic systems for detection of simulated calcifications

Chao-Jen Lai, Chris C. Shaw, Gary J. Whitman, Wei T. Yang, Peter J. Dempsey M.D.

Author Affiliations +

Proceedings Volume 5745, Medical Imaging 2005: Physics of Medical Imaging; (2005) https://doi.org/10.1117/12.597212
Event: Medical Imaging, 2005, San Diego, California, United States

Abstract

The purpose of this study is to compare the detection performance of three different mammography systems: screen/film (SF) combination, a-Si/CsI flat-panel (FP-), and charge-coupled device (CCD-) based systems. A 5-cm thick 50% adipose/50% glandular breast tissue equivalent slab phantom was used to provide an uniform background. Calcium carbonate grains of three different size groups were used to simulate microcalcifications (MCs): 112-125, 125-140, and 140-150 μm overlapping with the uniform background. Calcification images were acquired with the three mammography systems. Digital images were printed on hardcopy films. All film images were displayed on a mammographic viewer and reviewed by 5 mammographers. The visibility of the MC was rated with a 5-point confidence rating scale for each detection task, including the negative controls. Scores were averaged over all readers for various detectors and size groups. Receiver operating characteristic (ROC) analysis was performed and the areas under the ROC curves (Az’s) were computed for various imaging conditions. The results shows that (1) the FP-based system performed significantly better than the SF and CCD-based systems for individual size groups using ROC analysis (2) the FP-based system also performed significantly better than the SF and CCD-based systems for individual size groups using averaged confidence scale, and (3) the results obtained from the Az’s were largely correlated with these from confidence level scores. However, the correlation varied slightly among different imaging conditions.

Citation Download Citation

Chao-Jen Lai, Chris C. Shaw, Gary J. Whitman, Wei T. Yang, and Peter J. Dempsey M.D. "Analysis of confidence level scores from an ROC study: comparison of three mammographic systems for detection of simulated calcifications", Proc. SPIE 5745, Medical Imaging 2005: Physics of Medical Imaging, (20 April 2005); https://doi.org/10.1117/12.597212

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Imaging systems

Mammography

CCD cameras

Control systems

Charge-coupled devices

Digital mammography

Sensors

Show All Keywords

Keywords/Phrases

Search In:

Publication Years