A theoretical treatment of the sources of variability in the output of pattern classifiers

Shalini Gupta; Mia K. Markey

doi:10.1117/12.811744

12 March 2009 A theoretical treatment of the sources of variability in the output of pattern classifiers

Shalini Gupta; Mia K. Markey

Author Affiliations +

Proceedings Volume 7263, Medical Imaging 2009: Image Perception, Observer Performance, and Technology Assessment; 72630Y (2009) https://doi.org/10.1117/12.811744
Event: SPIE Medical Imaging, 2009, Lake Buena Vista (Orlando Area), Florida, United States

Abstract

Previously, several instances of variability in the output of pattern classifiers that have the same Receiver Operating Characteristic (ROC) curve have been observed. We present a theoretical framework for understanding some sources of this variability, which result in classifiers with monotonically related outputs. We restrict our analysis to pattern classifiers that discriminate between two linearly separable classes. We show that variability in the output of pattern classifiers can arise due to differences in the functional mappings between their inputs and outputs. We further identify some practical situations wherein such variability in the output of such pattern classifiers arises. These include situations in which there are differences in (a) the datasets employed for training and evaluation of classifiers, (b) the a priori probabilities of the two classes, or (c) the stochastic processes employed for training the different pattern classifiers. Previously, we proposed a technique based on the matching of the histograms of differently distributed classifier output to reduce the variability in their diagnostic performance and their output values. Here, we prove theoretically and demonstrate empirically on simulated data, that for monotonically related classifier outputs, this technique successfully learns the true monotonic transformation function that exists between different pattern classifier outputs.

Citation Download Citation

Shalini Gupta, Shalini Gupta, Mia K. Markey, Mia K. Markey, } "A theoretical treatment of the sources of variability in the output of pattern classifiers", Proc. SPIE 7263, Medical Imaging 2009: Image Perception, Observer Performance, and Technology Assessment, 72630Y (12 March 2009); doi: 10.1117/12.811744; https://doi.org/10.1117/12.811744

ACCESS THE FULL ARTICLE

PERSONAL SIGN IN
Full access may be available with your subscription

Email or Username Forgot your username?

Password Forgot your password?

Show

Remember Email/Username on this computer

Remember Password

No SPIE account? Create an account
or Institutional Sign In via Shibboleth

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $14.40

Non-members: $18.00 ADD TO CART

Show All Keywords

Keywords/Phrases

Search In:

Publication Years