1 November 1991 Divergence as a measure of visual recognition: bias and errors caused by small samples
Author Affiliations +
Total divergence has been shown to be a useful measure of performance of visual recognition processes. Measurement and comparison of divergences using samples require statistical processing and sample size becomes an important factor in practical applications when sample sizes are small. We recently completed a numerical study on the applicability of total divergence to a medical Pap test process in small samples. This study suggested that in order to keep measurement biases within +/- 0.5 decits, 100 - 200 samples of cytology- histology pairs were required in the best classifications of 3, 4, and 5 category-states. At these sample sizes, measurement errors (standard errors) were also contained within +/- 0.5 decits. This study also confirmed that previously reported, over-estimated propagated errors in small samples were in fact over-estimation, and that their use for testing a null hypothesis was valid. The number of samples with indefinable statistics due to a zero denominator can be as high as 30% when the sample sizes were 500 for 3, 4, and 5 category-state classifications. Biases due to small samples were positive for most category-states except for the optimum 3 category-states, in which bias changed to negative (bias inversion), and observed errors of total divergence paradoxically decreased as N decreased (error-sample paradox) for a small sample size (N < 700).
© (1991) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Manhot Lau, Manhot Lau, Takashi Okagaki, Takashi Okagaki, } "Divergence as a measure of visual recognition: bias and errors caused by small samples", Proc. SPIE 1606, Visual Communications and Image Processing '91: Image Processing, (1 November 1991); doi: 10.1117/12.50368; https://doi.org/10.1117/12.50368


Back to Top