Paper
16 March 2020 Automatic detection of brain metastases using 3D mask R-CNN for stereotactic radiosurgery
Yang Lei, Zhen Tian, Shannon Kahn, Walter J. Curran, Tian Liu, Xiaofeng Yang
Author Affiliations +
Abstract
Brain metastases are one of the most common neurologic complications of cancers, occurring in about 30% of all patients with cancer. Moreover, about 40% of brain metastases patients have more than three metastases. Stereotactic radiosurgery (SRS) is a well-established treatment for brain metastases, which requires accurate detection and delineation of the brain metastases. However, manually detecting and locating all the brain metastases can be very time-consuming and laborintensive, which is a big efficiency bottleneck in this typical one-day outpatient SRS procedure. Developing a fast automatic detection tool of brain metastases is highly desirable, but is very challenging given the large number of brain metastases that a patient can have and the small size that a brain metastasis can be. In this work, we propose to use a 3D Mask R-CNN method to automatically and quickly detect the brain metastases on magnetic resonance (MR) images for SRS. At the training stage, coarse feature maps were extracted from 3D MR image patches using pretrained ResNet. Then, a region proposal network (RPN) was used to predict the locations and sizes of the rough candidate tumor ROIs from the coarse feature maps. By using a uniformed fully convolution network (FCN), the metastases within ROI was segmented. The segmentation loss, classification loss (metastases or non-metastases), as well as ROI location and size regression loss were used to supervise the proposed networks. For a new query patient, candidate ROIs and predicted probability maps within ROIs were obtained from our trained model. By aggregating ROIs and the tumor probability maps and performing a consolidation via weighted cluster scoring, the final ROIs of the brain metastases was obtained. We have tested our method on 20 patients’ brain contrast T1-weighted MR images, and achieved 86.5%±3.2% sensitivity and 89.7%±4.8% specificity. For each patient, it took our trained model a few seconds to detect the brain metastases on the 3D MR images. The results of our preliminary study have demonstrated its efficacy and clinical feasibility. This auto-detection method could be a useful tool to significantly improve the efficiency of SRS treatment planning and hence ultimately improve the clinical outcome.
© (2020) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yang Lei, Zhen Tian, Shannon Kahn, Walter J. Curran, Tian Liu, and Xiaofeng Yang "Automatic detection of brain metastases using 3D mask R-CNN for stereotactic radiosurgery", Proc. SPIE 11314, Medical Imaging 2020: Computer-Aided Diagnosis, 113142X (16 March 2020); https://doi.org/10.1117/12.2549860
Lens.org Logo
CITATIONS
Cited by 1 scholarly publication.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Brain

Magnetic resonance imaging

Image segmentation

Brain mapping

Tumors

Cancer

3D image processing

Back to Top