Generation of RGB EVG stained image from hyperspectral H&E stained image using generative adversarial network (GAN)

Tanwi Biswas; Hiroyuki Suzuki; Masahiro Ishikawa; Naoki Kobayashi; Takashi Obi

doi:10.1117/12.2653491

6 April 2023 Generation of RGB EVG stained image from hyperspectral H&E stained image using generative adversarial network (GAN)

Tanwi Biswas, Hiroyuki Suzuki, Masahiro Ishikawa, Naoki Kobayashi, Takashi Obi

Author Affiliations +

Proceedings Volume 12471, Medical Imaging 2023: Digital and Computational Pathology; 124710D (2023) https://doi.org/10.1117/12.2653491
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Abstract

Quantifying elastic fiber in the tissue specimen is an important aspect of diagnosing different diseases. In conventional pathology, special staining technique such as EVG (Verhoeff’s Van Gieson) is applied physically for this purpose which is expensive and time-consuming procedure. Though H&E (Hematoxylin and Eosin) staining is routinely used, less expensive and most common tissue staining technique, elastic and collagen fibers cannot be differentiated using it. This study proposes a modified CycleGAN based unsupervised method for the computerized generation of RGB EVG stained tissue from hyperspectral H&E stained one to save the time and cost of conventional EVG staining procedure. Our proposed method is designed to utilize the sufficient spectral information provided by the H&E hyperspectral image (HSI) without reducing the spectral dimension. For doing so, we have faced challenges to calculate one of the training losses (identity loss) of CycleGAN that requires reducing the channel dimension of H&E HSI to be the same as RGB EVG stained image. We have addressed the issue by adopting intentionally designed three basis functions that can reduce the channel dimension of HSI into three without losing the essential color of elastic fibers. The set of this function includes Linear Discriminant Function (LDF) and the transmittance spectrum of Eosin and Hematoxylin which has proved to best preserve the underlying important features of EVG stained image while reducing the dimensionality of hyperspectral H&E. The experimental result proves the feasibility of our proposed method to generate realistic EVG stained image from its corresponding H&E stained one.

Conference Presentation

Citation Download Citation

Tanwi Biswas, Hiroyuki Suzuki, Masahiro Ishikawa, Naoki Kobayashi, and Takashi Obi "Generation of RGB EVG stained image from hyperspectral H&E stained image using generative adversarial network (GAN)", Proc. SPIE 12471, Medical Imaging 2023: Digital and Computational Pathology, 124710D (6 April 2023); https://doi.org/10.1117/12.2653491

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available