Translator Disclaimer
1 April 1992 Imagery test suites and their implication on the testability of computer vision algorithms
Author Affiliations +
A fundamental question in the ability to determine the effectiveness of any computer vision algorithm is the construction and application of proper test data suites. The purpose of this paper is to develop an understanding of the underlying requirements necessary in forming test suites, and the limitations that restricted sample sizes have on determining the testability of computer vision algorithms. With the relatively recent emergence of high performance computing, it is now highly desirable to perform statistically significant testing of algorithms using a test suite containing a full range of data, from simple binary images to textured images and multi-scale images. Additionally, a common database of test suites would enable direct comparisons of competing imagery exploitation algorithms. The initial step necessary in building a test suite is the selection of adequate measures necessary to estimate the subjective attributes of images, similar to the quantitative measures from speech quality. We will discuss image measures, their relation to the construction of test suites and the use of real sensor data or computer generated synthetic images. By using the latest technology in computer graphics, synthetically generated images varying in degrees of distortion both from sensors models and other noise source models can be formed if ground-truth information of the images is known. Our eventual goal is to intelligently construct statistically significant test suites which would allow for A/B comparisons between various computer vision algorithms.
© (1992) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Andrew C. Segal, Richard Greene, Robert Kero, and Daniel Steuer "Imagery test suites and their implication on the testability of computer vision algorithms", Proc. SPIE 1623, The 20th AIPR Workshop: Computer Vision Applications: Meeting the Challenges, (1 April 1992);


Correspondence, Partial Matching And Image Understanding
Proceedings of SPIE (March 27 1987)
Database representation for scene simulation
Proceedings of SPIE (April 13 1993)
Geometric hashing for query localization in image databases
Proceedings of SPIE (November 01 1996)
Three-Dimensional Object Recognition Using Range Data
Proceedings of SPIE (March 27 1989)
Robust computational vision
Proceedings of SPIE (August 20 1993)

Back to Top