13 April 2009 Field-based data collection techniques for the evaluation of information fusion systems
Author Affiliations +
In order to effectively evaluate information fusion systems or emerging technologies, it is critical to quickly, efficient, and accurately collect functional and observational data about such systems. One of the best ways to test a system's capabilities is to have an end user operate it in controlled but realistic field-based situations. Evaluation data of the systems' performance as well as observational data of the user's interactions can then be collected and analyzed. This analysis often gives insight into how the system may perform in the intended environment and of any potential areas for improvement. One common method for collection of this data involves an evaluator/observer generating hand-written notes, comments, and sketches. This often proves to be inefficient in complex sensor technology field-based evaluation environments. Personnel at the National Institute of Standards and Technology (NIST) have been tasked with collecting such evaluation data for emerging soldier-worn sensor systems. Lessons learned from the on-going development of efficient field-based evaluation data collection techniques will be discussed. The most recent evaluation data collection using a personal digital assistant (PDA)-style system and details of its use during an evaluation of a multi-team study will also be described.
© (2009) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Brian Antonishek, Brian A. Weiss, Craig Schlenoff, "Field-based data collection techniques for the evaluation of information fusion systems", Proc. SPIE 7345, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2009, 73450M (13 April 2009); doi: 10.1117/12.818565; https://doi.org/10.1117/12.818565

Back to Top