3D PET image generation with tumour masks using TGAN

Robert V. Bergen; Jean-Francois Rajotte; Fereshteh Yousefirizi; Ivan S. Klyuzhin; Arman Rahmim; Raymond T. Ng

doi:10.1117/12.2611292

4 April 2022 3D PET image generation with tumour masks using TGAN

Robert V. Bergen, Jean-Francois Rajotte, Fereshteh Yousefirizi, Ivan S. Klyuzhin, Arman Rahmim, Raymond T. Ng

Proceedings Volume 12032, Medical Imaging 2022: Image Processing; 120321P (2022) https://doi.org/10.1117/12.2611292
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

Training computer-vision related algorithms on medical images for disease diagnosis or image segmentation is difficult due to the lack of training data, labeled samples, and privacy concerns. For this reason, a robust generative method to create synthetic data is highly sought after. However, most three-dimensional image generators require additional image input or are extremely memory intensive. To address these issues we propose adapting video generation techniques for 3- D image generation. Using the temporal GAN (TGAN) architecture, we show we are able to generate realistic head and neck PET images. We also show that by conditioning the generator on tumour masks, we are able to control the geometry and location of the tumour in the generated images. To test the utility of the synthetic images, we train a segmentation model using the synthetic images. Synthetic images conditioned on real tumour masks are automatically segmented, and the corresponding real images are also segmented. We evaluate the segmentations using the Dice score and find the segmentation algorithm performs similarly on both datasets (0.65 synthetic data, 0.70 real data). Various radionomic features are then calculated over the segmented tumour volumes for each data set. A comparison of the real and synthetic feature distributions show that seven of eight feature distributions had statistically insignificant differences (𝑝 < 0.05). Correlation coefficients were also calculated between all radionomic features and it is shown that all of the strong statistical correlations in the real data set are preserved in the synthetic data set.

Conference Presentation

Citation Download Citation

Robert V. Bergen, Jean-Francois Rajotte, Fereshteh Yousefirizi, Ivan S. Klyuzhin, Arman Rahmim, and Raymond T. Ng "3D PET image generation with tumour masks using TGAN", Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 120321P (4 April 2022); https://doi.org/10.1117/12.2611292

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available