Going from double to single reading for screening exams labeled as likely normal by AI: what is the impact?

Christiana Balta; Alejandro Rodriguez-Ruiz; Christoph Mieskes; Nico Karssemeijer; Sylvia H. Heywang-Köbrunner

doi:10.1117/12.2564179

22 May 2020 Going from double to single reading for screening exams labeled as likely normal by AI: what is the impact?

Christiana Balta, Alejandro Rodriguez-Ruiz, Christoph Mieskes, Nico Karssemeijer, Sylvia H. Heywang-Köbrunner

Proceedings Volume 11513, 15th International Workshop on Breast Imaging (IWBI2020); 115130D (2020) https://doi.org/10.1117/12.2564179
Event: Fifteenth International Workshop on Breast Imaging, 2020, Leuven, Belgium

Abstract

We investigated whether a deep learning-based artificial intelligence (AI) system can be used to improve breast cancer screening workflow efficiency by making a pre-selection of likely normal screening mammograms where double-reading could be safely replaced with single-reading. We collected 18,015 consecutively acquired screening exams, the independent reading assessments by each radiologist of the double reading process, and the information about whether the case was recalled and if so the recall outcome. The AI system assigned a 1-10 score to each screening exam denoting the likelihood of cancer. We simulated the impact on recall rate, cancer detection rate, and workload if single-reading would have been performed for the mammograms with the lowest AI scores. After evaluating all possible AI score thresholds, it was found that when AI scores 1 to 7 are single read instead of double read, the cancer detection rate would have remained the same (no screen-detected cancers missed –the AI score is low but the single-reader would recall the exam), recall rate would have decreased by 11.8% (from 5.35% to 4.79%), and screen reading workload would have decreased by 32.6%. In conclusion, using an AI system could improve breast cancer screening efficiency by pre-selecting likely normal exams where double-reading might not be needed.

Citation Download Citation

Christiana Balta, Alejandro Rodriguez-Ruiz, Christoph Mieskes, Nico Karssemeijer, and Sylvia H. Heywang-Köbrunner "Going from double to single reading for screening exams labeled as likely normal by AI: what is the impact?", Proc. SPIE 11513, 15th International Workshop on Breast Imaging (IWBI2020), 115130D (22 May 2020); https://doi.org/10.1117/12.2564179

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available