Content-based image retrieval in radiology: analysis of variability in human perception of similarity

Jessica Faruque; Christopher F. Beaulieu; Jarrett Rosenberg; Daniel Rubin; Dorcas Yao; Sandy Napel

doi:10.1117/1.JMI.2.2.025501

3 April 2015 Content-based image retrieval in radiology: analysis of variability in human perception of similarity

Jessica Faruque, Christopher F. Beaulieu, Jarrett Rosenberg, Daniel Rubin, Dorcas Yao, Sandy Napel

Author Affiliations +

Journal of Medical Imaging, Vol. 2, Issue 2, 025501 (April 2015). https://doi.org/10.1117/1.JMI.2.2.025501

Abstract

We aim to develop a better understanding of perception of similarity in focal computed tomography (CT) liver images to determine the feasibility of techniques for developing reference sets for training and validating content-based image retrieval systems. In an observer study, four radiologists and six nonradiologists assessed overall similarity and similarity in 5 image features in 136 pairs of focal CT liver lesions. We computed intra- and inter-reader agreements in these similarity ratings and viewed the distributions of the ratings. The readers’ ratings of overall similarity and similarity in each feature primarily appeared to be bimodally distributed. Median Kappa scores for intra-reader agreement ranged from 0.57 to 0.86 in the five features and from 0.72 to 0.82 for overall similarity. Median Kappa scores for inter-reader agreement ranged from 0.24 to 0.58 in the five features and were 0.39 for overall similarity. There was no significant difference in agreement for radiologists and nonradiologists. Our results show that developing perceptual similarity reference standards is a complex task. Moderate to high inter-reader variability precludes ease of dividing up the workload of rating perceptual similarity among many readers, while low intra-reader variability may make it possible to acquire large volumes of data by asking readers to view image pairs over many sessions.

Citation Download Citation

Jessica Faruque, Christopher F. Beaulieu, Jarrett Rosenberg, Daniel Rubin, Dorcas Yao, and Sandy Napel "Content-based image retrieval in radiology: analysis of variability in human perception of similarity," Journal of Medical Imaging 2(2), 025501 (3 April 2015). https://doi.org/10.1117/1.JMI.2.2.025501

Published: 3 April 2015

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available