Confidence of a ROC manifold

Mark E. Oxley; Christine M. Schubert; Steven N. Thorsen

doi:10.1117/12.850892

27 April 2010 Confidence of a ROC manifold

Mark E. Oxley, Christine M. Schubert, Steven N. Thorsen

Proceedings Volume 7697, Signal Processing, Sensor Fusion, and Target Recognition XIX; 76970T (2010) https://doi.org/10.1117/12.850892
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

A Classification system such as an Automatic Target Recognition (ATR) system with N possible output labels (or decisions) will have N(N-1) possible errors. The Receiver Operating Characteristic (ROC) manifold was created to quantify all of these errors. Finite truth data will produce an approximation to a ROC manifold. How well does the approximate ROC manifold approximate the TRUE ROC manifold? Several metrics exist that quantify the approximation ability, but researchers really wish to quantify the confidence in the approximate ROC manifold. This paper will review different confidence definitions for ROC curves and will derive an expression for confidence of a ROC manifold. The foundation of the confidence expression is based upon the Chebychev inequality..

Citation Download Citation

Mark E. Oxley, Christine M. Schubert, and Steven N. Thorsen "Confidence of a ROC manifold", Proc. SPIE 7697, Signal Processing, Sensor Fusion, and Target Recognition XIX, 76970T (27 April 2010); https://doi.org/10.1117/12.850892

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available