Significance test in operational ROC analysis

Jin Chu Wu; Alvin F. Martin; Raghu N. Kacker; Charles R. Hagwood

doi:10.1117/12.849529

14 April 2010 Significance test in operational ROC analysis

Jin Chu Wu, Alvin F. Martin, Raghu N. Kacker, Charles R. Hagwood

Proceedings Volume 7667, Biometric Technology for Human Identification VII; 76670I (2010) https://doi.org/10.1117/12.849529
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

To evaluate the performance of fingerprint-image matching algorithms on large datasets, a receiver operating characteristic (ROC) curve is applied. From the operational perspective, the true accept rate (TAR) of the genuine scores at a specified false accept rate (FAR) of the impostor scores and/or the equal error rate (EER) are often employed. Using the standard errors of these metrics computed using the nonparametric two-sample bootstrap based on our studies of bootstrap variability on large fingerprint datasets, the significance test is performed to determine whether the difference between the performance of one algorithm and a hypothesized value, or the difference between the performances of two algorithms where the correlation is taken into account is statistically significant. In the case that the alternative hypothesis is accepted, the sign of the difference is employed to determine which is better than the other. Examples are provided.

Citation Download Citation

Jin Chu Wu, Alvin F. Martin, Raghu N. Kacker, and Charles R. Hagwood "Significance test in operational ROC analysis", Proc. SPIE 7667, Biometric Technology for Human Identification VII, 76670I (14 April 2010); https://doi.org/10.1117/12.849529

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available