Multi-organ segmentation in pelvic CT images with CT-based synthetic MRI

Yang Lei; Xue Dong; Sibo Tian; Tonghe Wang; Pretesh Patel; Walter J. Curran; Ashesh B. Jani; Tian Liu; Xiaofeng Yang

doi:10.1117/12.2548470

Translator Disclaimer

28 February 2020 Multi-organ segmentation in pelvic CT images with CT-based synthetic MRI

Yang Lei, Xue Dong, Sibo Tian, Tonghe Wang, Pretesh Patel, Walter J. Curran, Ashesh B. Jani, Tian Liu, Xiaofeng Yang

Author Affiliations +

Proceedings Volume 11317, Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging; 113171S (2020) https://doi.org/10.1117/12.2548470
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

We propose a hybrid deep learning-based method, which includes a cycle consistent generative adversarial network (CycleGAN) and deep attention fully convolution network implemented by a U-Net (DAUnet), to perform volumetric multi-organ segmentation for pelvic computed tomography (CT). The proposed method first utilized CycleGAN to generate synthetic MRI (sMRI) to provide superior soft tissue contrast. Then, the proposed method fed the sMRI into the DAUnet to obtain the volumetric segmentation of bladder, prostate and rectum, simultaneously, via a multi-channel output. The deep attention strategy was introduced to retrieve the most relevant features to identify organ boundaries. Deep supervision was incorporated into the DAUnet to enhance the features’ discriminative ability. Segmented contours of a patient were obtained by feeding the CT image into the trained CycleGAN to generate sMRI, which was then fed to the trained DAUnet to generate the organ contours. A retrospective studied was performed with data sets from 45 patients with prostate cancer. The Dice similarity coefficient and mean surface distance indices for bladder, prostate, and rectum contours were 0.94, 0.47 mm; 0.86, 0.78 mm; and 0.89, 0.85 mm, respectively. The proposed network provides accurate and consistent prostate, bladder and rectum segmentation without the need of additional MRIs. With further evaluation and clinical implementation, this method has the potential to facilitate routine prostate-cancer radiotherapy treatment planning.

Citation Download Citation

Yang Lei, Xue Dong, Sibo Tian, Tonghe Wang, Pretesh Patel, Walter J. Curran, Ashesh B. Jani, Tian Liu, and Xiaofeng Yang "Multi-organ segmentation in pelvic CT images with CT-based synthetic MRI", Proc. SPIE 11317, Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging, 113171S (28 February 2020); https://doi.org/10.1117/12.2548470

ACCESS THE FULL ARTICLE