8 November 2002 Quality and automation metrics for spectral classification algorithms
Author Affiliations +
Quantitative and robust metrics are required to objectively compare the performance of algorithms within a general functional class. This is especially true for classification algorithms that cluster and label data using spectral features. This is because spectral algorithms are usually based on a finite set of assumptions about the radiative transfer phenomenology. Thus, a suite of algorithms is needed to achieve a generalized and robust processing chain that performs well under all operational scenarios of interest. An adaptive processing chain that automatically selects the optimal combination of algorithms to generate a product of prescribed quality provides a framework for operational applications. To this end, we have developed Measures of Effectiveness (MOE's) and Figures of Merit (FOM's) that can quantitatively and objectively select the appropriate algorithm automatically. The FOM's are a weighted sum of MOE's, which are performance metrics such as the tightness and dissimilarity of clusters. We have also defined scene and sensor parameters that quantify a subset of factors that affect algorithm performance. Functional relationships between FOM's and MOE's and between the FOM's/MOE's and the scene/sensor parameters were also established. These functional relationships allow users to predict the expected classification product quality given a specific operational scenario based on a performance model that also automates the processing chain. Initial results of an application of this approach to hyperspectral data indicate that FOM's can be predicted with high accuracy with choices made correctly as high as 89% of the time depending on the FOM definitions. The results were obtained over a wide range of operational scenarios.
© (2002) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Erich D. Hernandez-Baquero, Erich D. Hernandez-Baquero, Robert V. Opalecky, Robert V. Opalecky, } "Quality and automation metrics for spectral classification algorithms", Proc. SPIE 4816, Imaging Spectrometry VIII, (8 November 2002); doi: 10.1117/12.451657; https://doi.org/10.1117/12.451657


Ocean color estimation by Himawari-8/AHI
Proceedings of SPIE (May 06 2016)
Hyperpyramids For Vision-Driven Navigation
Proceedings of SPIE (March 28 1988)
The Autonomous Helicopter System
Proceedings of SPIE (June 13 1984)
Contextual Analysis Of Tactical Scenes
Proceedings of SPIE (June 13 1984)
Invariance Techniques And High-Resolution Null Steering
Proceedings of SPIE (February 22 1988)

Back to Top