In this study we present a deep learning based classification algorithm for discriminating morphological patterns that appear in RCM mosaics of melanocytic lesions collected at the dermal epidermal junction (DEJ). These patterns are classified into 6 distinct types in the literature: background, meshwork, ring, clod, mixed, and aspecific. Clinicians typically identify these morphological patterns by examination of their textural appearance at 10X magnification. To mimic this process we divided mosaics into smaller regions, which we call tiles, and classify each tile in a deep learning framework. We used previously acquired DEJ mosaics of lesions deemed clinically suspicious, from 20 different patients, which were then labelled according to those 6 types by 2 expert users. We tried three different approaches for classification, all starting with a publicly available convolutional neural network (CNN) trained on natural image, consisting of a series of convolutional layers followed by a series of fully connected layers: (1) We fine-tuned this network using training data from the dataset. (2) Instead, we added an additional fully connected layer before the output layer network and then re-trained only last two layers, (3) We used only the CNN convolutional layers as a feature extractor, encoded the features using a bag of words model, and trained a support vector machine (SVM) classifier. Sensitivity and specificity were generally comparable across the three methods, and in the same ranges as our previous work using SURF features with SVM . Approach (3) was less computationally intensive to train but more sensitive to unbalanced representation of the 6 classes in the training data. However we expect CNN performance to improve as we add more training data because both the features and the classifier are learned jointly from the data.
*First two authors share first authorship.
Kivanc Kose, Alican Bozkurt, Setareh Ariafar, Christi A. Alessi-Fox, Melissa Gill, Jennifer G. Dy, Dana H. Brooks, and Milind Rajadhyaksha, "Deep learning based classification of morphological patterns in RCM to guide noninvasive diagnosis of melanocytic lesions (Conference Presentation)," Proc. SPIE 10037, Photonics in Dermatology and Plastic Surgery, 100370C (Presented at SPIE BiOS: January 28, 2017; Published: 19 April 2017); https://doi.org/10.1117/12.2253076.5369740740001.
Conference Presentations are recordings of oral presentations given at SPIE conferences and published as part of the conference proceedings. They include the speaker's narration along with a video recording of the presentation slides and animations. Many conference presentations also include full-text papers. Search and browse our growing collection of more than 12,000 conference presentations, including many plenary and keynote presentations.
Monte Carlo based light propagation models to improve efficacy of biophotonics based therapeutics of hollow organs and solid tumours including photodynamic therapy and photobiomodulation (Conference Presentation)