Development of discordant likelihood metrics for use in evaluation of 'double reviewer' performance in blinded independent central review (BICR) RECIST imaging studies

J. Michael O'Connor; Manish Sharma; Anitha Singareddy; Annette Schmid

doi:10.1117/12.2255753

10 March 2017 Development of discordant likelihood metrics for use in evaluation of 'double reviewer' performance in blinded independent central review (BICR) RECIST imaging studies

J. Michael O'Connor, Manish Sharma, Anitha Singareddy, Annette Schmid

Author Affiliations +

Proceedings Volume 10136, Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment; 1013609 (2017) https://doi.org/10.1117/12.2255753
Event: SPIE Medical Imaging, 2017, Orlando, Florida, United States

Abstract

Purpose: Perform a retrospective review of a number studies (n=20) for the purpose of proposing basic likelihood metrics for evaluation of discordance between two reviewers performing RECIST (Response Evaluation Criteria in Solid Tumors) assessments in a Blinded Independent Central Review (BICR)

Methods: Retrospective data analysis using R programming scripts to determine discordance subsets of interest and analyze these datasets for both time point discordance and case discordance.

Results: We present a basic time point discordant ratio and a cases discordance ratio based on a range of aggregated time points per case for RECIST datasets.

Conclusions: We propose basic ratios that that might be useful to improve reviewer performance monitoring models

Conference Presentation

Citation Download Citation

J. Michael O'Connor, Manish Sharma, Anitha Singareddy, and Annette Schmid "Development of discordant likelihood metrics for use in evaluation of 'double reviewer' performance in blinded independent central review (BICR) RECIST imaging studies", Proc. SPIE 10136, Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment, 1013609 (10 March 2017); https://doi.org/10.1117/12.2255753

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available