Exploring FROC paradigm: initial experience with clinical applications

Lana Volokh; Chi Liu; Benjamin M. W. Tsui

doi:10.1117/12.653247

17 March 2006 Exploring FROC paradigm: initial experience with clinical applications

Lana Volokh, Chi Liu, Benjamin M. W. Tsui

Proceedings Volume 6146, Medical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment; 61460D (2006) https://doi.org/10.1117/12.653247
Event: Medical Imaging, 2006, San Diego, California, United States

Abstract

Design of receiver-operating characteristic (ROC)-based paradigm and data analysis methods that capture and adequately address the complexity of clinical decision-making will facilitate the development and evaluation of new image acquisition, reconstruction and processing techniques. We compare the JAFROC (Jackknife free-response ROC) to traditional ROC paradigm and analysis in two image evaluation studies. The first study is designed to address advantages of "free response" features of JAFROC paradigm in a breast lesion detection task. We developed tools allowing the acquisition of FROC-type rating data and use them on a set of simulated scintimammography images. Four observers participated in a small preliminary study. Rating data are then analyzed using traditional ROC and JAFROC techniques. The second study is aimed at comparing the diagnostic quality of myocardial perfusion SPECT (MPS) images obtained with different quantitative image reconstruction and compensation methods in an ongoing clinical trial. The observer assesses status of each of the three main vascular territories for each patient. This experimental set-up uses standardized locations of vascular territories on myocardial polar plot images, and a fixed number of three rating scores per patient. We compare results from the newly available JAFROC versus the traditional ROC analysis technique previously applied in similar studies, using a set of data from an on-going clinical trial. Comparison of two analysis methodologies reveals generally consistent behavior, corresponding to theoretical predictions.

Citation Download Citation

Lana Volokh, Chi Liu, and Benjamin M. W. Tsui "Exploring FROC paradigm: initial experience with clinical applications", Proc. SPIE 6146, Medical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment, 61460D (17 March 2006); https://doi.org/10.1117/12.653247

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available