A web-based multiresolution viewer to measure expert search patterns in large microscopy images: towards machine-based dimensionality reduction (Conference Presentation)

Huimin Zhuge; Jonathon Q. Brown

doi:10.1117/12.2510459

7 March 2019 A web-based multiresolution viewer to measure expert search patterns in large microscopy images: towards machine-based dimensionality reduction (Conference Presentation)

Huimin Zhuge, Jonathon Q. Brown

Author Affiliations +

Proceedings Volume 10868, Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XVII; 1086816 (2019) https://doi.org/10.1117/12.2510459
Event: SPIE BiOS, 2019, San Francisco, California, United States

Abstract

In traditional histopathology images, and emerging ex vivo microscopy techniques that generate large (gigapixel) image data, new strategies are needed to efficiently search the images to identify salient areas for human recognition or computer-aided diagnosis, to aid in rapid and efficient review workflows. One strategy is to learn from pathologists to develop model observers that can predict the most significant areas of an image for human review or application of computationally-expensive diagnostic algorithms. To get further understanding of the pathologists’ perception and cognition, we developed a custom web-based multiresolution viewer based on OpenSeadragon, which can record view coordinate, zoom level, coordinate dwell time, and coordinate scan path of users viewing images, under the assumption that the view coordinate represents the real-time visual area. We conducted experiments on two types of data with multiple reviewers: 1) traditional histopathology images of radical prostatectomy specimens, and 2) whole surface images of prostate margins collected on intact organs using structured illumination microscopy. Overall error rate, viewing pattern, saliency maps, dwell time and zoom level on fixation clusters were analyzed on normal tissue and cancer loci/positive margins. The result of the pilot experiments demonstrates that saliency maps correspond well with known areas of tumor in histopathology images and residual cancer in tumor margin images. These data will be used to predict saliency maps on new images based on low-level image features and to test accuracy vs. expert reviewers. This tool has promise for automated image dimensionality reduction and diagnosis of histopathology images.

Conference Presentation

Citation Download Citation

Huimin Zhuge and Jonathon Q. Brown "A web-based multiresolution viewer to measure expert search patterns in large microscopy images: towards machine-based dimensionality reduction (Conference Presentation)", Proc. SPIE 10868, Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XVII, 1086816 (7 March 2019); https://doi.org/10.1117/12.2510459

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
PRESENTATION

WATCH
PRESENTATION SAVE TO MY LIBRARY

GET CITATION

KEYWORDS

Microscopy

Algorithm development

Cancer

Tumors

Zoom lenses

Cognitive modeling

Computer aided diagnosis and therapy

Show All Keywords

Keywords/Phrases

Search In:

Publication Years