Automated Visual Evaluation (AVE) of cervical precancerous lesions with integrated patient meta-information: an initial study

Ishan Shah; Matthew Horning; Liming Hu

doi:10.1117/12.2653285

6 March 2023 Automated Visual Evaluation (AVE) of cervical precancerous lesions with integrated patient meta-information: an initial study

Ishan Shah, Matthew Horning, Liming Hu

Author Affiliations +

Proceedings Volume 12369, Optics and Biophotonics in Low-Resource Settings IX; 1236909 (2023) https://doi.org/10.1117/12.2653285
Event: SPIE BiOS, 2023, San Francisco, California, United States

Abstract

Cervical precancer – a major threat in low- and middle-income countries (LMICs) – is often screened through Visual Inspection with acetic Acid (VIA) but suffers from limited reproducibility and inaccuracy. Automatic Visual Evaluation (AVE) utilizes deep learning algorithms based on cervigram or digital images to detect cervical precancer accurately and efficiently. However, important patient data and test results that can provide additional context to the images have not been integrated into the AVE workflow. The NCI ALTS dataset provides over 30,000 cervigram images with hundreds of histopathology-verified positive cases, paired with HPV, cytology, colposcopy, and histology results. To take advantage of both the images and other data, we designed a deep learning image classification algorithm, then modified its architecture to integrate age, HPV status, and cytology result with two methods – concatenation, and multiplication via an added “MetaNet”. We then proposed a two-stage training process that maximized the predictive power of both the images and meta-information while allowing flexibility for missing data. This enabled us to run concurrent inference on a patient's images, test results, and age, and return a binary cervical precancer prediction. The experiments demonstrated that in certain scenarios, the MetaNet model produced a synergistic effect between the images and meta-information by outperformingmodels that only use each component individually, increasing specificity and maintaining high sensitivity. This work provides a direction for the integration of patient meta-information into an end-to-end AVE prediction model, and generally for other medical imaging data, to potentially increase prediction power andmore precisely calibrate patient risk.

Conference Presentation

Citation Download Citation

Ishan Shah, Matthew Horning, and Liming Hu "Automated Visual Evaluation (AVE) of cervical precancerous lesions with integrated patient meta-information: an initial study", Proc. SPIE 12369, Optics and Biophotonics in Low-Resource Settings IX, 1236909 (6 March 2023); https://doi.org/10.1117/12.2653285

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available