Restoration of turbulence-degraded images based on deep convolutional network

Xiangyu Bai; Ming Liu; Chuan He; Liquan Dong; Yuejin Zhao; Xiaohua Liu

doi:10.1117/12.2527593

6 September 2019 Restoration of turbulence-degraded images based on deep convolutional network

Xiangyu Bai, Ming Liu, Chuan He, Liquan Dong, Yuejin Zhao, Xiaohua Liu

Proceedings Volume 11139, Applications of Machine Learning; 111390B (2019) https://doi.org/10.1117/12.2527593
Event: SPIE Optical Engineering + Applications, 2019, San Diego, California, United States

Abstract

Atmospheric turbulence is an irregular form of motion in the atmosphere. Because of turbulence interference, when the optical system through the atmosphere of the target imaging, the observed image will appear point intensity diffusion, image blur, image drift and other turbulence effects. Digital recovery of the turbulence-degraded images technique is a classical ill-conditioned problem by removing the blurring effect and suppressing the noise. Traditional approaches relying on image heuristics suffer from high frequency noise amplification and processing artifacts. In this paper, the image degradation models of the turbulent flow are given, the point spread function of turbulence is simulated by the similar Gaussian function model, and investigated a general framework of neural networks for restoring turbulence-degraded images. The blur and additive noise are considered simultaneously. Two solutions respectively exploiting fully convolutional networks (FCN) and conditional Generative Adversarial Networks (CGAN) are presented. The FCN based on minimizing the mean squared reconstruction error (MSE) in pixel space gets high PSNR. On the other side, the CGAN based on perceptual loss optimization criterion retrieves more textures. We conduct comparison experiments to demonstrate the performance at different degree of turbulence intensity from the training configuration. The results indicate that the proposed networks outperform traditional approaches for restoring high frequency details and suppressing noise effectively.

Citation Download Citation

Xiangyu Bai, Ming Liu, Chuan He, Liquan Dong, Yuejin Zhao, and Xiaohua Liu "Restoration of turbulence-degraded images based on deep convolutional network", Proc. SPIE 11139, Applications of Machine Learning, 111390B (6 September 2019); https://doi.org/10.1117/12.2527593

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available