2.1.

Structure-Texture Image Decomposition

Main information of an image is encoded in its edges, details, and textures. These components need to be represented in suitable spaces to capture their special characteristics in the image.

For a given image [TeX:] \documentclass[12pt]{minimal}\begin{document}$f(x): \Omega \subset \bf {R}^2 \rightarrow \bf {R}$\end{document} $f\left(x\right):\Omega \subset {\mathbf{R}}^{\mathbf{2}}\to \mathbf{R}$ , we decompose f into the form f = u + v, where u is the structure part including edges, details, and flat areas in BV(Ω),¹ and v is the oscillating part including textures and noise in G(Ω).⁷ In this letter, we adopt the following decomposition model:⁸

In a discrete framework Aujol proved the existence and uniqueness of a solution to Eq. 1, and the approximation of Eq. 1 to Meyer's model.⁸

2.2.

Other Related Work

In a report⁵ the special idea and technique developed in numerical solution of nonlinear hyperbolic equation were applied to feature-oriented image restoration for the first time. Then, Osher and Rudin introduced a novel edge sharpening technique called shock filter.⁵

In order to avoid unnatural artifacts of the shock-type processing,¹⁰ we introduced a soft edge sharpening algorithm in a coupled bidirectional diffusion (CBD) equation:⁹

Another effective image denoising technique is the neighborhood filter,^{6, 11} which considers some similarity both in spatial location and in gray level of two pixels. Buades proposed the following nonlocal means (NL-means) filter:⁶

2.3.

Proposed Mixed Model

In order to better preserve image details and textures, we propose an adaptive mixed method based on image decomposition (AM-ID) for image restoration, which fuses different advantages of previously mentioned methods, such as the excellent capability of the shock filter in edge sharpening and that of the neighborhood filter in image texture denoising. This method decomposes a given image f into two components: geometric structure u such as edge and detail, and oscillating pattern v including texture and noise according to Eq. 1. Then, the coupled bidirectional diffusion [Eq. 2] is used to restore the structure part, and the nonlocal means filter [Eq. 3] is used to remove noise in the oscillating part. For the sake of clarity, the AM-ID method is illustrated in Fig. 1.

Fig. 1

The proposed mixed method.

Therefore, for a given degraded image f, we solve the following problem to reconstruct its restored version g:

3.1.

Numerical Implementation

In order to solve the model 4, we need to numerically compute Eqs. 1, 2, 3. For Eq. 1, we use the alternate projection algorithm.⁸ For Eq. 2, we use the numerically coupled scheme.⁹ Finally, for Eq. 3, a simple accelerating trick is adopted.¹² On denoising oscillating patterns by the NL-means method, a smaller parameter h should be chosen to better preserve image textures.

3.2.

Experimental Results

In this section we give some experimental results to show the performance of the proposed method. Although many test images are used, we only show experiments on two typical images (Barbara and Lena) because of the imposed page limit. The test images contain rich details, textures, and large scale features. The corrupted versions are obtained by adding a Gaussian noise.

In Fig. 2, we compare the proposed method (AM-ID) with the anisotropic diffusion (AD) on a noisy Barbara (256 × 256 pixels) image. It is clear that, the given image has been successfully decomposd into the structure u and oscillating patterns v (texture and noise). At the same time, one can observe the edge sharpening of the CBD method in [TeX:] \documentclass[12pt]{minimal}\begin{document}$\tilde{u}$\end{document} $\tilde{u}$ , and the powerful denoising of the NL-means method in [TeX:] \documentclass[12pt]{minimal}\begin{document}$\tilde{v}$\end{document} $\tilde{v}$ . These processings have resulted in a better image restoration, where the noise is removed effectively, edges are sharpened reasonably, and most textures and details are preserved in [TeX:] \documentclass[12pt]{minimal}\begin{document}$\tilde{u}+\tilde{v}$\end{document} $\tilde{u}+\tilde{v}$ . As for the AD method, although it can effectively remove the noise, it has smoothed out most of image textures. Without distinguishing image texture from noise, it elminates both noise and textures.

Fig. 2

Denoising the noisy Barbara image (from top-left to bottom-right): Original u, v + 100 by the method 1, result by the AD method, f, [TeX:] \documentclass[12pt]{minimal}\begin{document}$\tilde{u}$\end{document} $\tilde{u}$ by the CBD processing, [TeX:] \documentclass[12pt]{minimal}\begin{document}$\tilde{v}+100$\end{document} $\tilde{v}+100$ by the NL-means processing, result by the AM-ID method, respectively.

In Fig. 3, we also test related methods on a noisy Lena (256 × 256 pixels) image. Once more, a better restoration of image textures and details is obtained by the proposed method. For example, see the feathers on the hat and Lena's eyes.

Fig. 3

Denoising the noisy Lena image (from left to right): original image, its noisy version, results by the AD and the AM-ID methods, respectively.

Finally, we report the peak signal to noise ratio (dB) results and the computational time (seconds) in the parentheses, respectively: the noisy Barbara image (19.01), the AD method (20.42, 0.60), the AM-ID method (22.08, 6.56); the noisy Lena image (21.09), the AD method (22.59, 0.45), and the AM-ID method (23.18, 6.64). All methods are implemented using the MATLAB program on a notebook computer with 1.86 GHz CPU and 3.00 GB Memory. Because of the complexity of the proposed method, a relatively longer computational time is needed.