BrainTumorNet: multi-task learning for joint segmentation of high-grade glioma and brain metastases from MR images

Satrajit Chakrabarty; Aristeidis Sotiras; Mikhail Milchenko; Pamela LaMontagne; Christopher Abraham; Clifford Robinson; Daniel Marcus

doi:10.1117/12.2580100

15 February 2021 BrainTumorNet: multi-task learning for joint segmentation of high-grade glioma and brain metastases from MR images

Satrajit Chakrabarty, Aristeidis Sotiras, Mikhail Milchenko, Pamela LaMontagne, Christopher Abraham, Clifford Robinson, Daniel Marcus

Author Affiliations +

Proceedings Volume 11596, Medical Imaging 2021: Image Processing; 115960K (2021) https://doi.org/10.1117/12.2580100
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

Detection and segmentation of primary and secondary brain tumors are crucial in Radiation Oncology. Significant efforts have been dedicated to devising deep learning models for this purpose. However, development of a unified model for the segmentation of multiple types of tumors is nontrivial due to high heterogeneity across different pathologies. In this work, we propose BrainTumorNet, a multi-task learning (MTL) scheme for the joint segmentation of high-grade gliomas (HGG) and brain metastases (METS) from multimodal magnetic resonance imaging (MRI) scans. We augment the state-of-the-art DeepMedic1 architecture using this scheme and evaluate its performance on a highly unbalanced hybrid dataset comprising 259 HGG and 58 METS patient-cases. For the HGG segmentation task, the network produces a Dice score of 86.74% for whole tumor segmentation, which is comparable to 87.35% and 87.19% by the task-specific and single-task joint training baselines, respectively. For the METS segmentation task, BrainTumorNet produces an average Dice score of 62.60% thus outperforming the scores of 19.85%, 57.99%, 59.74%, and 44.17% by the two transfer-learned, task-specific, and single-task joint training baseline models, respectively. The trained network retains knowledge across segmentation tasks by exploiting the underlying correlation between pathologies. At the same time, it is discriminative enough to produce competitive segmentations for each task. The hard parameter sharing in the network reduces the computational overhead compared to training task-specific models for multiple tumor types. To our knowledge, this is the first attempt towards developing a single overarching model for the segmentation of different types of brain tumors.

Conference Presentation

Citation Download Citation

Satrajit Chakrabarty, Aristeidis Sotiras, Mikhail Milchenko, Pamela LaMontagne, Christopher Abraham, Clifford Robinson, and Daniel Marcus "BrainTumorNet: multi-task learning for joint segmentation of high-grade glioma and brain metastases from MR images", Proc. SPIE 11596, Medical Imaging 2021: Image Processing, 115960K (15 February 2021); https://doi.org/10.1117/12.2580100

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available