An improved fusion method of infrared and visible images based on FusionGAN

Zhiqiang Yao; Huinan Guo; Long Ren

doi:10.1117/12.2599559

30 June 2021 An improved fusion method of infrared and visible images based on FusionGAN

Zhiqiang Yao, Huinan Guo, Long Ren

Proceedings Volume 11878, Thirteenth International Conference on Digital Image Processing (ICDIP 2021); 118781H (2021) https://doi.org/10.1117/12.2599559
Event: Thirteenth International Conference on Digital Image Processing, 2021, Singapore, Singapore

Abstract

Convolutional neural network is widely used in image fusion. However, the deep learning framework is only applied in some part of the fusion process in most existing methods. To generate a full end-to-end image fusion pipeline, a Yshaped Generator model based on Generative Adversarial Network for infrared and visible image fusion is proposed. The idea of this method is to establish an adversarial game between the generator and the discriminator. The generator consisting of two Pyramid networks and three convolutional layers works as an autoencoder to improve the characteristic information of the fused images. As for the discriminator, it adopts a network structure similar to the Visual Geometry Group (VGG) network. The loss function uses the ratio loss to control the trade-off among generation loss and reconstruction loss. Results on publicly available datasets demonstrate that our method can improve the quality of detail information and sharpen the edge of infrared targets.

Citation Download Citation

Zhiqiang Yao, Huinan Guo, and Long Ren "An improved fusion method of infrared and visible images based on FusionGAN", Proc. SPIE 11878, Thirteenth International Conference on Digital Image Processing (ICDIP 2021), 118781H (30 June 2021); https://doi.org/10.1117/12.2599559

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available