Deep learning for tissue microarray image-based outcome prediction in patients with colorectal cancer

Dmitrii Bychkov; Riku Turkki; Caj Haglund; Nina Linder M.D.; Johan Lundin M.D.

doi:10.1117/12.2217072

Translator Disclaimer

23 March 2016 Deep learning for tissue microarray image-based outcome prediction in patients with colorectal cancer

Dmitrii Bychkov, Riku Turkki, Caj Haglund, Nina Linder M.D., Johan Lundin M.D.

Author Affiliations +

Proceedings Volume 9791, Medical Imaging 2016: Digital Pathology; 979115 (2016) https://doi.org/10.1117/12.2217072
Event: SPIE Medical Imaging, 2016, San Diego, California, United States

Abstract

Recent advances in computer vision enable increasingly accurate automated pattern classification. In the current study we evaluate whether a convolutional neural network (CNN) can be trained to predict disease outcome in patients with colorectal cancer based on images of tumor tissue microarray samples. We compare the prognostic accuracy of CNN features extracted from the whole, unsegmented tissue microarray spot image, with that of CNN features extracted from the epithelial and non-epithelial compartments, respectively. The prognostic accuracy of visually assessed histologic grade is used as a reference. The image data set consists of digitized hematoxylin-eosin (H and E) stained tissue microarray samples obtained from 180 patients with colorectal cancer. The patient samples represent a variety of histological grades, have data available on a series of clinicopathological variables including long-term outcome and ground truth annotations performed by experts. The CNN features extracted from images of the epithelial tissue compartment significantly predicted outcome (hazard ratio (HR) 2.08; CI95% 1.04-4.16; area under the curve (AUC) 0.66) in a test set of 60 patients, as compared to the CNN features extracted from unsegmented images (HR 1.67; CI95% 0.84-3.31, AUC 0.57) and visually assessed histologic grade (HR 1.96; CI95% 0.99-3.88, AUC 0.61). As a conclusion, a deep-learning classifier can be trained to predict outcome of colorectal cancer based on images of H and E stained tissue microarray samples and the CNN features extracted from the epithelial compartment only resulted in a prognostic discrimination comparable to that of visually determined histologic grade.

Citation Download Citation

Dmitrii Bychkov, Riku Turkki, Caj Haglund, Nina Linder M.D., and Johan Lundin M.D. "Deep learning for tissue microarray image-based outcome prediction in patients with colorectal cancer ", Proc. SPIE 9791, Medical Imaging 2016: Digital Pathology, 979115 (23 March 2016); https://doi.org/10.1117/12.2217072

ACCESS THE FULL ARTICLE