Translator Disclaimer
21 April 1998 Quantifying the limitations of the use of consensus expert committees in ROC studies
Author Affiliations +
Many receiver operating characteristic (ROC) studies rely on establishing 'truth' about lesion absence/presence on the agreement of a panel of experts. In addition, in the consensus committee methodology, images where the members of the committee did not reach any agreement about the lesion absence/presence are discarded from the ROC study. But how reliable are 'gold standards' established by these expert committees. And does discarding images where no agreement was reached bias the spectrum of difficulty of the test image set for the ROC study. Computer simulated lesions of different strengths were embedded in real x-ray coronary angiogram background in order to measure the agreement among the decisions of members of the committee as a function of signal strength, to establish the accuracy of the decisions of the consensus expert committee and to compare it to individual more inexperienced readers.
© (1998) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Miguel P. Eckstein, Thomas D. Wickens, Gal Aharonov, George Ruan, Craig A. Morioka, and James Stuart Whiting "Quantifying the limitations of the use of consensus expert committees in ROC studies", Proc. SPIE 3340, Medical Imaging 1998: Image Perception, (21 April 1998);

Back to Top