Complementary cumulative precision distribution: a new graphical metric for medical image retrieval system

Jatindra Kumar Dash; Sudipta Mukhopadhyay; Niranjan Khandelwal

doi:10.1117/12.2043156

11 March 2014 Complementary cumulative precision distribution: a new graphical metric for medical image retrieval system

Jatindra Kumar Dash, Sudipta Mukhopadhyay, Niranjan Khandelwal

Author Affiliations +

Proceedings Volume 9037, Medical Imaging 2014: Image Perception, Observer Performance, and Technology Assessment; 90371S (2014) https://doi.org/10.1117/12.2043156
Event: SPIE Medical Imaging, 2014, San Diego, California, United States

Abstract

Several single valued measures have been proposed by researchers for the quantitative performance evaluation of medical image retrieval systems. Precision and recall are the most common evaluation measures used by researchers. Amongst graphical measures proposed, precision vs. recall graph is the most common evaluation measure. Precision vs. recall graph evaluates di®erent systems by varying the operating points (number of top retrieval considered). However, in real life the operating point for di®erent applications are known. Therefore, it is essential to evaluate di®erent retrieval systems at a particular operating point set by the user. None of the graphical metric provides the variation of performance of query images over the entire database at a particular operating point. This paper proposes a graphical metric called Complementary Cumulative Precision Distribution (CCPD) that evaluates di®erent systems at a particular operating point considering each images in the database for query. The strength of the metric is its ability to represent all these measures pictorially. The proposed metric (CCPD) pictorially represents the di®erent possible values of precision and the fraction of query images at those precision values considering number of top retrievals constant. Di®erent scalar measures are derived from the proposed graphical metric (CCPD) for e®ective evaluation of retrieval systems. It is also observed that the proposed metric can be used as a tie breaker when the performance of di®erent methods are very close to each other in terms of average precision.

Citation Download Citation

Jatindra Kumar Dash, Jatindra Kumar Dash, Sudipta Mukhopadhyay, Sudipta Mukhopadhyay, Niranjan Khandelwal, Niranjan Khandelwal, "Complementary cumulative precision distribution: a new graphical metric for medical image retrieval system", Proc. SPIE 9037, Medical Imaging 2014: Image Perception, Observer Performance, and Technology Assessment, 90371S (11 March 2014); doi: 10.1117/12.2043156; https://doi.org/10.1117/12.2043156

ACCESS THE FULL ARTICLE

PERSONAL SIGN IN
Full access may be available with your subscription

Email or Username Forgot your username?

Password Forgot your password?

Show

Remember Email/Username on this computer

Remember Password

No SPIE account? Create an account
or Institutional Sign In via Shibboleth

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $14.40

Non-members: $18.00 ADD TO CART

Show All Keywords

Keywords/Phrases

Search In:

Publication Years