Comparative study of computational visual attention models on two-dimensional medical images

Gezheng Wen; Brenda Rodriguez-Niño; Furkan Y. Pecen; David J. Vining M.D.; Naveen Garg M.D.; Mia K. Markey

doi:10.1117/1.JMI.4.2.025503

10 May 2017 Comparative study of computational visual attention models on two-dimensional medical images

Gezheng Wen, Brenda Rodriguez-Niño, Furkan Y. Pecen, David J. Vining M.D., Naveen Garg M.D., Mia K. Markey

Author Affiliations +

Journal of Medical Imaging, Vol. 4, Issue 2, 025503 (May 2017). https://doi.org/10.1117/1.JMI.4.2.025503

Abstract

Computational modeling of visual attention is an active area of research. These models have been successfully employed in applications such as robotics. However, most computational models of visual attention are developed in the context of natural scenes, and their role with medical images is not well investigated. As radiologists interpret a large number of clinical images in a limited time, an efficient strategy to deploy their visual attention is necessary. Visual saliency maps, highlighting image regions that differ dramatically from their surroundings, are expected to be predictive of where radiologists fixate their gaze. We compared 16 state-of-art saliency models over three medical imaging modalities. The estimated saliency maps were evaluated against radiologists’ eye movements. The results show that the models achieved competitive accuracy using three metrics, but the rank order of the models varied significantly across the three modalities. Moreover, the model ranks on the medical images were all considerably different from the model ranks on the benchmark MIT300 dataset of natural images. Thus, modality-specific tuning of saliency models is necessary to make them valuable for applications in fields such as medical image compression and radiology education.

Citation Download Citation

Gezheng Wen, Brenda Rodriguez-Niño, Furkan Y. Pecen, David J. Vining M.D., Naveen Garg M.D., and Mia K. Markey "Comparative study of computational visual attention models on two-dimensional medical images," Journal of Medical Imaging 4(2), 025503 (10 May 2017). https://doi.org/10.1117/1.JMI.4.2.025503

Received: 24 February 2017; Accepted: 18 April 2017; Published: 10 May 2017

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available