Paper
12 March 2010 Simultaneous truth and performance level estimation with incomplete, over-complete, and ancillary data
Author Affiliations +
Abstract
Image labeling and parcellation are critical tasks for the assessment of volumetric and morphometric features in medical imaging data. The process of image labeling is inherently error prone as images are corrupted by noise and artifact. Even expert interpretations are subject to subjectivity and the precision of the individual raters. Hence, all labels must be considered imperfect with some degree of inherent variability. One may seek multiple independent assessments to both reduce this variability as well as quantify the degree of uncertainty. Existing techniques exploit maximum a posteriori statistics to combine data from multiple raters. A current limitation with these approaches is that they require each rater to generate a complete dataset, which is often impossible given both human foibles and the typical turnover rate of raters in a research or clinical environment. Herein, we propose a robust set of extensions that allow for missing data, account for repeated label sets, and utilize training/catch trial data. With these extensions, numerous raters can label small, overlapping portions of a large dataset, and rater heterogeneity can be robustly controlled while simultaneously estimating a single, reliable label set and characterizing uncertainty. The proposed approach enables parallel processing of labeling tasks and reduces the otherwise detrimental impact of rater unavailability.
© (2010) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Bennett A. Landman, John A. Bogovic, and Jerry L. Prince "Simultaneous truth and performance level estimation with incomplete, over-complete, and ancillary data", Proc. SPIE 7623, Medical Imaging 2010: Image Processing, 76231N (12 March 2010); https://doi.org/10.1117/12.844182
Lens.org Logo
CITATIONS
Cited by 12 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Reliability

Monte Carlo methods

Data modeling

Image processing

3D modeling

Computer simulations

Medical imaging

RELATED CONTENT

A simulation model of IT risk on program trading
Proceedings of SPIE (December 03 2015)
Re use of pilot data and interim analysis of pivotal...
Proceedings of SPIE (March 10 2017)
Bootstrapped MRMC confidence intervals
Proceedings of SPIE (April 06 2005)

Back to Top