4 November 2005 3D ROC analysis for detection software used in water monitoring
Author Affiliations +
Proceedings Volume 5995, Chemical and Biological Standoff Detection III; 59950A (2005) https://doi.org/10.1117/12.626611
Event: Optics East 2005, 2005, Boston, MA, United States
Under the U.S. Army sponsored Joint Service Agent Water Monitor (JSAWM) program, developing hand-held assays using tickets for chemical/biological agent detection has been of major interest. One of keys to success is to develop detection algorithms that not only can effectively detect the presence of various agents, but also can quantify the detected agents. This paper presents a recent development of detection software that can perform 3-dimensional (3D) receiver operating characteristics (ROC) analysis which is based on quantified agent concentration. The ROC curves have been widely used in communications, signal processing and medical communities to evaluate the effectiveness of a detection technique. It generally formulates a signal detection problem as a binary composite hypothesis testing problem with the null hypothesis and the alternative hypothesis represents the case of no signal and the case of signal presence respectively. The ROC curve is then plotted based on the detection probability (power) PD versus the false alarm probability, PF. Unfortunately, such a two-dimensional (2D) (PD,PF)-based ROC curve does not factor in the concentration detected in an agent signal which is a crucial parameter in chemical/biological agent detection. The proposed 3D ROC analysis is developed from such a need. It includes an additional parameter, referred to as threshold t, which is used to threshold the detected agent signal concentration. Consequently, a different value of t results in a different 2D ROC curve. In order to take into account the thresholding factor t, a 3D ROC curve is derived and plotted based on three parameters, (PD,PF,t). As a result of the 3D ROC curve, three 2D ROC curves can be also derived. One is the conventional 2D (PD,PF)-ROC curve. Another is a 2D (PD,t)-ROC curve which describes the relationship between PD and the threshold value t. A third one is a 2D (PF,t)-ROC curve which shows the effect of the threshold value t on PF. The utility of the proposed 3D ROC analysis will be demonstrated by the detection software developed by the UMBC for the tickets used in HHA for water monitoring.
© (2005) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Wei-min Liu, Wei-min Liu, Su Wang, Su Wang, Chein-I Chang, Chein-I Chang, Janet L. Jensen, Janet L. Jensen, James O. Jensen, James O. Jensen, Harlan Knapp, Harlan Knapp, Robert Daniel, Robert Daniel, Ray Yin, Ray Yin, } "3D ROC analysis for detection software used in water monitoring", Proc. SPIE 5995, Chemical and Biological Standoff Detection III, 59950A (4 November 2005); doi: 10.1117/12.626611; https://doi.org/10.1117/12.626611

Back to Top