PS-GAN: a single image snow removal framework using pseudo-Siamese GANs

Shifeng Yan; Shili Liang; Xiuping Li; Lei Zhang; Suqiu Wang; Changan Dong

doi:10.1117/12.2611394

22 October 2021 PS-GAN: a single image snow removal framework using pseudo-Siamese GANs

Shifeng Yan, Shili Liang, Xiuping Li, Lei Zhang, Suqiu Wang, Changan Dong

Proceedings Volume 11928, International Conference on Image Processing and Intelligent Control (IPIC 2021); 119280P (2021) https://doi.org/10.1117/12.2611394
Event: International Conference on Image Processing and Intelligent Control (IPIC 2021), 2021, Lanzhou, China

Abstract

In this article, we innovatively use Pearson correlation coefficient, etc. to analyze the components of the snowy image (the snow-free image and the mask image), and then create an effective and accurate snow-free model using the relationship between the components of the snowy image. For the snow-free model, we innovatively consider the similarity in the generation of the snow-free image and the mask image; we also consider this relationship in our neural network framework. We set the generator model in the generative adversarial network as the pseudo-siamese network with the same structure but the different parameters. Each branch of the pseudo-siamese network adopts the autoencoder and the multi-scale perception structure. The former can guarantee the acquisition of high-resolution images, and the latter can perceive context information at different scales. We restore the mask image first and then restore the snow-free image because the mask image has a simpler background than the snow-free image and the mask image is easier to recover than the snow-free image. The results show that our (PS-GAN) pseudo-siamese generative adversarial network not only has better performance on the data set, but also has good results in the real world which greatly improves the effect of using the yolov5 to detect.

Citation Download Citation

Shifeng Yan, Shili Liang, Xiuping Li, Lei Zhang, Suqiu Wang, and Changan Dong "PS-GAN: a single image snow removal framework using pseudo-Siamese GANs", Proc. SPIE 11928, International Conference on Image Processing and Intelligent Control (IPIC 2021), 119280P (22 October 2021); https://doi.org/10.1117/12.2611394

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available