An unsupervised fusion method for infrared and visible image fusion under low-light condition

Shuai Yang; Yuan Gao; Shiwei Ma; Kaihua Huang

doi:10.1117/12.3014572

8 December 2023 An unsupervised fusion method for infrared and visible image fusion under low-light condition

Shuai Yang, Yuan Gao, Shiwei Ma, Kaihua Huang

Proceedings Volume 12943, International Workshop on Signal Processing and Machine Learning (WSPML 2023); 129430O (2023) https://doi.org/10.1117/12.3014572
Event: International Workshop on Signal Processing and Machine Learning (WSPML 2023), 2023, Hangzhou, ZJ, China

Abstract

The aim of fusing infrared and visible images is to achieve high-quality images by enhancing textural details and obtaining complementary benefits. Since the details of the visible images are not obvious in low light, it is difficult for the current fusion methods to complete the complementary contours and texture details. With the intention of addressing the challenge of poor quality of infrared and visible light fusion images under low light conditions, a novel fusion method for infrared and visible light is presented in this study utilizing generative adversarial networks (referred to as UFIVL). Specifically, based on the existing densely connected decoder, pruning is introduced to reduce the network complexity without quality loss. A new overall optimization objective includes the adaptive limit contrast histogram equalization loss and the joint gradient loss are designed to deal with the defects of high contrast and brightness loss of the fused image, and the difficulty of capturing detailed features in low light scenes, respectively. Experimental results on LLVIP datasets show that compared with other state-of-the-art methods, the fused image generated by the proposed method has better subjective and objective performances.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Shuai Yang, Yuan Gao, Shiwei Ma, and Kaihua Huang "An unsupervised fusion method for infrared and visible image fusion under low-light condition", Proc. SPIE 12943, International Workshop on Signal Processing and Machine Learning (WSPML 2023), 129430O (8 December 2023); https://doi.org/10.1117/12.3014572

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available