Machine learning approach to synthesizing multiphoton microscopic images from reflectance confocal (Conference Presentation)

Arya Chowdhury Mugdha; Jesse W. Wilson

doi:10.1117/12.2510473

4 March 2019 Machine learning approach to synthesizing multiphoton microscopic images from reflectance confocal (Conference Presentation)

Arya Chowdhury Mugdha, Jesse W. Wilson

Author Affiliations +

Proceedings Volume 10851, Photonics in Dermatology and Plastic Surgery 2019; 1085106 (2019) https://doi.org/10.1117/12.2510473
Event: SPIE BiOS, 2019, San Francisco, California, United States

Abstract

Multiphoton microscopy imaging techniques provide molecule specific contrast and can produce in vivo histopathology with clearly recognizable features such as cellular and nuclear morphology, collagen, etc. Despite this advantage, high cost, risk of damage from high-intensity pulses, and lack of FDA approval prevents widespread adoption of multiphoton microscopy techniques in conventional clinical scenario. Reflectance confocal microscopy, on the other hand, is much more affordable for clinical scenario, as it is FDA approved, can perform in vivo, non-invasive imaging of specimens with less risk of DNA damage, and even has been granted insurance reimbursement codes. However, the images obtained by reflectance confocal have little resemblance to traditional histopathology due to graininess in the images, and lack molecule specific contrast which makes the images more challenging to interpret and determine a diagnosis,. We propose brining multiphoton-like contrast to confocal instruments by a neural network trained on a set of co-registered reflectance confocal and multiphoton images. We assume that the local reflectance texture of cytoplasm, nuclei, melanin and cytoplasm are distinct within a cell. Once the neural network has been trained, it would be able to distinguish these structures, and produce clear histology-like images from the grainy confocal reflectance data. Our preliminary training results show a successful estimation of multiphoton images from reflectance confocal images by training a 3 layer neural network on a set of 1000 32x32 image patches.

Conference Presentation

Citation Download Citation

Arya Chowdhury Mugdha and Jesse W. Wilson "Machine learning approach to synthesizing multiphoton microscopic images from reflectance confocal (Conference Presentation)", Proc. SPIE 10851, Photonics in Dermatology and Plastic Surgery 2019, 1085106 (4 March 2019); https://doi.org/10.1117/12.2510473

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
PRESENTATION

WATCH
PRESENTATION SAVE TO MY LIBRARY

GET CITATION

KEYWORDS

Confocal microscopy

Reflectivity

Machine learning

In vivo imaging

Neural networks

Molecules

Multiphoton microscopy

Show All Keywords

Keywords/Phrases

Search In:

Publication Years