A variety of neural networks architectures are being studied to tackle blur in images and videos caused by a non-steady camera and objects being captured. In this paper, we present an overview of these existing networks and perform experiments to remove the blur caused by atmospheric turbulence. Our experiments aim to examine the reusability of existing networks and identify desirable aspects of the architecture in a system that is geared specifically towards atmospheric turbulence mitigation. We compare five different architectures, including a network trained in an end-to-end fashion, thereby removing the need for a stabilization step.
In this work, we extract the optical flow field corresponding to moving objects from an image sequence of a scene impacted by atmospheric turbulence and captured from a moving camera. Our procedure first computes the optical flow field and creates a motion model to compensate for the flow field induced by camera motion. After subtracting the motion model from the optical flow, we proceed with our previous work, Gilles et al,1 where a spatial-temporal cartoon+texture inspired decomposition is performed on the motion-compensated flow field in order to separate flows corresponding to atmospheric turbulence and object motion. Finally, the geometric component is processed with the detection and tracking method and is compared against a ground truth. All of the sequences and code used in this work are open source and are available by contacting the authors.
We investigate the extension of the recently proposed weighted Fourier burst accumulation (FBA) method into the wavelet domain. The purpose of FBA is to reconstruct a clean and sharp image from a sequence of blurred frames. This concept lies in the construction of weights to amplify dominant frequencies in the Fourier spectrum of each frame. The reconstructed image is then obtained by taking the inverse Fourier transform of the average of all processed spectra. We first suggest replacing the rigid registration step used in the original algorithm with a nonrigid registration in order to process sequences acquired through atmospheric turbulence. Second, we propose to work in a wavelet domain instead of the Fourier one. This leads us to the construction of two types of algorithms. Finally, we propose an alternative approach to replace the weighting idea by an approach promoting the sparsity in the used space. Several experiments are provided to illustrate the efficiency of the proposed methods.
Automated detection of chemical plumes presents a segmentation challenge. The segmentation problem for gas plumes is difficult due to the diffusive nature of the cloud. The advantage of considering hyperspectral images in the gas plume detection problem over the conventional RGB imagery is the presence of non-visual data, allowing for a richer representation of information. In this paper we present an effective method of visualizing hyperspectral video sequences containing chemical plumes and investigate the effectiveness of segmentation techniques on these post-processed videos. Our approach uses a combination of dimension reduction and histogram equalization to prepare the hyperspectral videos for segmentation. First, Principal Components Analysis (PCA) is used to reduce the dimension of the entire video sequence. This is done by projecting each pixel onto the first few Principal Components resulting in a type of spectral filter. Next, a Midway method for histogram equalization is used. These methods redistribute the intensity values in order to reduce icker between frames. This properly prepares these high-dimensional video sequences for more traditional segmentation techniques. We compare the ability of various clustering techniques to properly segment the chemical plume. These include K-means, spectral clustering, and the Ginzburg-Landau functional.
We propose a new way to correct for the non-uniformity (NU) and the noise in uncooled infrared-type images.
This method works on static images, needs no registration, no camera motion and no model for the non uniformity.
The proposed method uses an hybrid scheme including an automatic locally-adaptive contrast adjustment and a
state-of-the-art image denoising method. It permits to correct for a fully non-linear NU and the noise efficiently
using only one image. We compared it with total variation on real raw and simulated NU infrared images. The
strength of this approach lies in its simplicity, low computational cost. It needs no test-pattern or calibration
and produces no "ghost-artefact".
We recently developed a new approach to get a stabilized image from a sequence of frames acquired through
atmospheric turbulence. The goal of this algorihtm is to remove the geometric distortions due by the atmosphere
movements. This method is based on a variational formulation and is efficiently solved by the use of Bregman
iterations and the operator splitting method. In this paper we propose to study the influence of the choice
of the regularizing term in the model. Then we proposed to experiment some of the most used regularization
constraints available in the litterature.
In this paper we present a new approach to deblur the effect of atmospheric turbulence in the case of long range
imaging. Our method is based on an analytical formulation, the Fried kernel, of the atmosphere modulation
transfer function (MTF) and a framelet based deconvolution algorithm. An important parameter is the refractive
index structure which requires specific measurements to be known. Then we propose a method which provides a
good estimation of this parameter from the input blurred image. The final algorithms are very easy to implement
and show very good results on both simulated blur and real images.
This paper introduces a new way to correct the non-uniformity (NU) in uncooled infrared-type images. The main
defect of these uncooled images is the lack of a column (resp. line) time-dependent cross-calibration, resulting
in a strong column (resp. line) and time dependent noise. This problem can be considered as a 1D flicker of the
columns inside each frame. Thus, classic movie deflickering algorithms can be adapted, to equalize the columns
(resp. the lines). The proposed method therefore applies to the series formed by the columns of an infrared
image a movie deflickering algorithm. The obtained single image method works on static images, and therefore
requires no registration, no camera motion compensation, and no closed aperture sensor equalization. Thus, the
method has only one camera dependent parameter, and is landscape independent. This simple method will be
compared to a state of the art total variation single image correction on raw real and simulated images. The
method is real time, requiring only two operations per pixel. It involves no test-pattern calibration and produces
no "ghost artifacts".
This paper deals with two fields related to active imaging system. First, we begin to explore image processing
algorithms to restore the artefacts like speckle, scintillation and image dancing caused by atmospheric turbulence.
Next, we examine how to evaluate the performance of this kind of systems. To do this task, we propose a modified
version of the german TRM3 metric which permits to get MTF-like measures. We use the database acquired
during NATO-TG40 field trials to make our tests.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.