17 March 2006 Exploring FROC paradigm: initial experience with clinical applications
Author Affiliations +
Design of receiver-operating characteristic (ROC)-based paradigm and data analysis methods that capture and adequately address the complexity of clinical decision-making will facilitate the development and evaluation of new image acquisition, reconstruction and processing techniques. We compare the JAFROC (Jackknife free-response ROC) to traditional ROC paradigm and analysis in two image evaluation studies. The first study is designed to address advantages of "free response" features of JAFROC paradigm in a breast lesion detection task. We developed tools allowing the acquisition of FROC-type rating data and use them on a set of simulated scintimammography images. Four observers participated in a small preliminary study. Rating data are then analyzed using traditional ROC and JAFROC techniques. The second study is aimed at comparing the diagnostic quality of myocardial perfusion SPECT (MPS) images obtained with different quantitative image reconstruction and compensation methods in an ongoing clinical trial. The observer assesses status of each of the three main vascular territories for each patient. This experimental set-up uses standardized locations of vascular territories on myocardial polar plot images, and a fixed number of three rating scores per patient. We compare results from the newly available JAFROC versus the traditional ROC analysis technique previously applied in similar studies, using a set of data from an on-going clinical trial. Comparison of two analysis methodologies reveals generally consistent behavior, corresponding to theoretical predictions.
© (2006) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Lana Volokh, Lana Volokh, Chi Liu, Chi Liu, Benjamin M. W. Tsui, Benjamin M. W. Tsui, } "Exploring FROC paradigm: initial experience with clinical applications", Proc. SPIE 6146, Medical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment, 61460D (17 March 2006); doi: 10.1117/12.653247; https://doi.org/10.1117/12.653247

Back to Top