1 August 1990 Training observers for receiver operating characteristic studies
Author Affiliations +
Abstract
In an ongoing, multi-reader, multi-project program dealing with the interpretation of radiological images, we have examined several issues of methodology which have not as yet been addressed that may impact on the determination of reader performance as measured by receiver operating characteristic (ROC) analysis. Among these are issues associated with the training of observers prior to such studies. We employed three types of observer training that we found to be necessary for the successful performance of such studies: 1) a general instructional session for observers on the study protocol and system operation; 2) practice with an interactive computerized feedback teaching file that demonstrates the imaging systems and familiarized readers with an idea of the types of cases that were used in the study along with their correct diagnoses; and 3) training sessions in which readers were taught the manner in which to distribute answer ratings over an ordinal confidence scale. The possible effect of such types of training on the performance and results of ROC studies should be carefully considered prior to their commencement.
© (1990) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
William H. Straub, William H. Straub, Howard E. Rockette, Howard E. Rockette, Jill L. King, Jill L. King, Nancy A. Obuchowski, Nancy A. Obuchowski, Walter F. Good, Walter F. Good, John H. Feist, John H. Feist, Barbara C. Good, Barbara C. Good, Charles E. Metz, Charles E. Metz, } "Training observers for receiver operating characteristic studies", Proc. SPIE 1234, Medical Imaging IV: PACS Systems Design and Evaluation, (1 August 1990); doi: 10.1117/12.18953; https://doi.org/10.1117/12.18953
PROCEEDINGS
5 PAGES


SHARE
Back to Top