14 March 2011 Foibles, follies, and fusion: assessment of statistical label fusion techniques for web-based collaborations using minimal training
Author Affiliations +
Proceedings Volume 7962, Medical Imaging 2011: Image Processing; 79623G (2011) https://doi.org/10.1117/12.877471
Event: SPIE Medical Imaging, 2011, Lake Buena Vista (Orlando), Florida, United States
Labeling or parcellation of structures of interest on magnetic resonance imaging (MRI) is essential in quantifying and characterizing correlation with numerous clinically relevant conditions. The use of statistical methods with automated techniques or complete data sets from several different raters has been proposed to simultaneously estimate both rater reliability and true labels. An extension to these statistical based methodologies was proposed that allowed for missing labels, repeated labels and training trials. Herein, we present and demonstrate the viability of these statistical based methodologies using real world data contributed by minimally trained human raters. The consistency of the statistical estimates, the accuracy compared to the individual observations and the variability of both the estimates and the individual observations with respect to the number of labels are discussed. It is demonstrated that the Gaussian based statistical approach using the previously presented extensions successfully performs label fusion in a variety of contexts using data from online (Internet-based) collaborations among minimally trained raters. This first successful demonstration of a statistically based approach using "wild-type" data opens numerous possibilities for very large scale efforts in collaboration. Extension and generalization of these technologies for new application spaces will certainly present fascinating areas for continuing research.
© (2011) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Andrew J. Asman, Andrew J. Asman, Andrew G. Scoggins, Andrew G. Scoggins, Jerry L. Prince, Jerry L. Prince, Bennett A. Landman, Bennett A. Landman, } "Foibles, follies, and fusion: assessment of statistical label fusion techniques for web-based collaborations using minimal training", Proc. SPIE 7962, Medical Imaging 2011: Image Processing, 79623G (14 March 2011); doi: 10.1117/12.877471; https://doi.org/10.1117/12.877471

Back to Top