Presentation + Paper
3 March 2017 Effective user guidance in online interactive semantic segmentation
Jens Petersen, Martin Bendszus, Jürgen Debus, Sabine Heiland, Klaus H. Maier-Hein
Author Affiliations +
With the recent success of machine learning based solutions for automatic image parsing, the availability of reference image annotations for algorithm training is one of the major bottlenecks in medical image segmentation. We are interested in interactive semantic segmentation methods that can be used in an online fashion to generate expert segmentations. These can be used to train automated segmentation techniques or, from an application perspective, for quick and accurate tumor progression monitoring.

Using simulated user interactions in a MRI glioblastoma segmentation task, we show that if the user possesses knowledge of the correct segmentation it is significantly (p ≤ 0.009) better to present data and current segmentation to the user in such a manner that they can easily identify falsely classified regions compared to guiding the user to regions where the classifier exhibits high uncertainty, resulting in differences of mean Dice scores between +0.070 (Whole tumor) and +0.136 (Tumor Core) after 20 iterations. The annotation process should cover all classes equally, which results in a significant (p ≤ 0.002) improvement compared to completely random annotations anywhere in falsely classified regions for small tumor regions such as the necrotic tumor core (mean Dice +0.151 after 20 it.) and non-enhancing abnormalities (mean Dice +0.069 after 20 it.). These findings provide important insights for the development of efficient interactive segmentation systems and user interfaces.
Conference Presentation
© (2017) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jens Petersen, Martin Bendszus, Jürgen Debus, Sabine Heiland, and Klaus H. Maier-Hein "Effective user guidance in online interactive semantic segmentation", Proc. SPIE 10134, Medical Imaging 2017: Computer-Aided Diagnosis, 101341V (3 March 2017); Logo
Cited by 2 scholarly publications.
Get copyright permission  Get copyright permission on Copyright Marketplace
Image segmentation


Medical imaging

Magnetic resonance imaging



Machine learning


Back to Top