Development of discordant likelihood metrics for use in evaluation of 'double reviewer' performance in blinded independent central review (BICR) RECIST imaging studies

J. Michael O'Connor; Manish Sharma; Anitha Singareddy; Annette Schmid

doi:10.1117/12.2255753

Translator Disclaimer

10 March 2017 Development of discordant likelihood metrics for use in evaluation of 'double reviewer' performance in blinded independent central review (BICR) RECIST imaging studies

J. Michael O'Connor, Manish Sharma, Anitha Singareddy, Annette Schmid

Author Affiliations +

Proceedings Volume 10136, Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment; 1013609 (2017) https://doi.org/10.1117/12.2255753
Event: SPIE Medical Imaging, 2017, Orlando, Florida, United States

Abstract

Purpose: Perform a retrospective review of a number studies (n=20) for the purpose of proposing basic likelihood metrics for evaluation of discordance between two reviewers performing RECIST (Response Evaluation Criteria in Solid Tumors) assessments in a Blinded Independent Central Review (BICR)

Methods: Retrospective data analysis using R programming scripts to determine discordance subsets of interest and analyze these datasets for both time point discordance and case discordance.

Results: We present a basic time point discordant ratio and a cases discordance ratio based on a range of aggregated time points per case for RECIST datasets.

Conclusions: We propose basic ratios that that might be useful to improve reviewer performance monitoring models

Conference Presentation

Citation Download Citation

J. Michael O'Connor, Manish Sharma, Anitha Singareddy, and Annette Schmid "Development of discordant likelihood metrics for use in evaluation of 'double reviewer' performance in blinded independent central review (BICR) RECIST imaging studies", Proc. SPIE 10136, Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment, 1013609 (10 March 2017); https://doi.org/10.1117/12.2255753

ACCESS THE FULL ARTICLE