Open Access Paper
17 October 2022 A visible edge aware directional total variation model for limited-angle reconstruction
Author Affiliations +
Proceedings Volume 12304, 7th International Conference on Image Formation in X-Ray Computed Tomography; 123042N (2022) https://doi.org/10.1117/12.2647520
Event: Seventh International Conference on Image Formation in X-Ray Computed Tomography (ICIFXCT 2022), 2022, Baltimore, United States
Abstract
The directional total variation algorithm (DTV) reported in the literature achieves promising results for limited angle reconstructions, especially when the scanning angular range is very small. However, the visible edge prior for limited-angle CT is not explicitly considered by DTV. In this paper, a variant of the DTV model is proposed which explicitly builds into the visible edge prior developed by Quinto et al. Numerical experiments show that the proposed model and algorithm produce very competitive results compared to DTV.

1.

INTRODUCTION

In certain computed tomography (CT) applications, due to the restrictions on the scanning condition or the geometrical shapes of scanning objects, the projection data could be only acquired in a limited angular range which leads to the challenging limited-angle reconstruction problem. This happens in both medical diagnosis like breast imaging1 and industrial inspection like the C-arm neuro imaging.2

Conventional reconstruction methods like filtered back-projection (FBP) and (simultaneous) algebraic reconstruction technique ((S)ART) perform poorly with limited-angle data, introducing heavy image blurring along the directions perpendicular to the missing projection rays. The limited-angle reconstruction problem has been extensively studied for decades, including theoretical characterization and practical reconstruction algorithms.

An early method views it as a projection domain inpainting problem3 and incorporate the smoothness prior of projection data into the reconstruction process. However, since a local extrapolation error in the projection domain may cause global artifacts in the image domain, this kind of methods suffers from severe stability issue. Another method is based on optimization models encoded with various hand-crafted priors. In certain applications, CT images can be approximated well by piecewise constant functions which should possess the gradient sparsity property. This property can be encoded by the total variation (TV) regularizer, extensively used in image processing. The first method adopting TV regularization is introduced in4 for divergent CT reconstruction. Since then, various modifications and improvements have been proposed, including the adaptive steepest descent-projection onto a convex set method,5 prior image constrained compressed sensing method,6 adaptive-weighted TV model,7 TV-l0 gradient minimization,? etc. These methods could effectively improve the reconstruction quality and achieve promising results.

For limited-angle reconstruction, there is a vital prior described by the theory of visible and invisible boundaries8 developed by Quinto et al. This prior is first considered by the anisotropic total variation (ATV) method.9 Later on, the reweighted ATV10 method takes projection directions as prior information and combines them into the TV formulation. Especially, the alternating edge-reserving diffusion and smoothing (AEDS) algorithm11 takes the visible edges prior to its full advantage. By designing separated x- and y-direction regularizers, the AEDS model encodes explicitly the visible edges prior, and by adopting the alternating minimization technique, the AEDS algorithm decouples the x-direction regularization from the y-direction regularization such that the visible edges are protected and utilized to their full advantages.

A very recent algorithm named DTV (directional total variation) is proposed in,12 which shows very promising reconstructions, especially for very small scanning angular ranges. The energy functional associated with DTV can be seen as a reformulation or constrained version of the AEDS model when the regularizers are specified by x- direction TV (TVx) and y-direction TV (TVy). The workhorse of DTV is the primal-dual based Chambolle-Pock (CP) algorithm.

Motivated by the success of the DTV algorithm, we propose to reformulate the DTV model such that the new model treats the visible edges prior (corresponding to TVx) differently from TVy. This is achieved by exchanging the roles of TVx and the data fidelity terms. Since the TVx term goes into the energy functional while the TVy term is specified as a constraint, the new model shall treat them differently. In this way, we think that the visible edges prior could be better utilized.

The remainder of this paper is organized as follows. We present our approach to the limited-angle CT reconstruction problem in Section 2. In Section 3, experiments are carried out to validate the proposed method. Finally, we conclude the paper in Section 4.

2.

METHOD

2.1

The limited-angle CT reconstruction problem

Assume that the size of reconstruction image u is M×N. The vector 00096_PSISDG12304_123042N_page_2_3.jpg is a concatenate form along the columns of u, and ui describes the ith entry of 00096_PSISDG12304_123042N_page_2_4.jpg, i = 1, 2,…, J. The CT reconstruction problem could be formulated as solving a linear system

00096_PSISDG12304_123042N_page_2_5.jpg

where AI×J is the system matrix and 00096_PSISDG12304_123042N_page_2_6.jpg is a vector of length I = V×D which represents the acquired projection data. V and D denote the number of projection views and the number of detector cells, respectively 00096_PSISDG12304_123042N_page_2_7.jpg accounts for any measurement bias and additive noise.

For limited-angle data, the linear system (1) with IJ is severely ill-posed, therefore, images reconstructed by conventional reconstruction algorithms will introduce streak and blurring artifacts. This is demonstrated in Fig.(1). Without loss of generality, here, we consider the fan-beam scanning with limited-angle range 00096_PSISDG12304_123042N_page_2_8.jpg The rectangle phantom and the scanning configuration are shown in Fig.(1a) and Fig.(1b), respectively. Under this scanning configuration, according to the theory of visible and invisible boundaries, the edges close to vertical are visible and can be easily reconstructed, while for the edges close to be horizontal will be invisible and cannot be recovered well by conventional reconstruction algorithms like FBP or SART, as shown in Fig.(1c).

Figure 1:

Illustration of the theory of visible and invisible boundaries. (a) The rectangle phantom; (b) the scanning configuration; (c) the limited-angle reconstruction for the scanning angular range 00096_PSISDG12304_123042N_page_2_1.jpg.

00096_PSISDG12304_123042N_page_2_2.jpg

2.2

The DTV model

The DTV algorithm12 is to solve the following minimization problem

00096_PSISDG12304_123042N_page_2_9.jpg

where ∇x and ∇y represent matrices size of J × J, corresponding to the discrete x-direction and y-direction gradient operators, respectively, and tx and ty are two scalars, specifying the allowed total variations along the x-direction and y-direction, respectively. Since the model (2) is convex, the CP algorithm could be employed to compute a global minimizer. It should be noted that for limited-angle problems, the matrix A has a very large kernel space, so that the model (2) could possess multiple global minimizers. In this case, different parameterizations or different initializations could lead to different solutions.

2.3

The visible edge aware DTV model (VEA-DTV)

As mentioned earlier, to better utilize the visible edges prior, we reformulate the DTV model (2) as the following one

00096_PSISDG12304_123042N_page_3_1.jpg

The parameter ϵ controls the noise-level of reconstructed image, which has a clear physical meaning.13 It’s easy to check that

00096_PSISDG12304_123042N_page_3_2.jpg

so the proposed VEA-DTV model (3) is theoretically equivalent to the DTV model (2). However, since the two formulations are not the same, when applying the CP algorithm, the resulting solving algorithms would be different. As mentioned earlier, for limited-angle problems, the models (3) and (2) are not strictly convex and since the system matrix A has a large kernel space, each of the two models admits multiple solutions, in which case different algorithms might reach different global minimizers. So, starting from the formulation (3), the CP algorithm might compute a solution different from that of the DTV algorithm. This is also the case when comparing AEDS and DTV. The model AEDS(l1, l1) coincides exactly with that of DTV, since condition (4) is met. However, since AEDS and DTV employ different minimization algorithms, their performance could be different. In fact, the alternating minimization algorithm adopted by AEDS takes constant step-sizes, according to the framework of incremental methods,14 it only converges to a neighbourhood of the optimum. On the other hand, the CP algorithm can be proved to converges to a saddle point corresponding to a optimum.

2.4

Numerical algorithm

The CP algorithm is adapted to develop an iterative algorithm for solving (3) by

00096_PSISDG12304_123042N_page_3_3.jpg

where indicator functions 00096_PSISDG12304_123042N_page_3_4.jpgare defined as:

00096_PSISDG12304_123042N_page_3_5.jpg

Then, the min-max formulation of (5) is given by

00096_PSISDG12304_123042N_page_3_6.jpg

Where

00096_PSISDG12304_123042N_page_3_7.jpg

Applying the proximal point algorithm to solve (6) and taking an additional extrapolation step, we thus obtain the VEA-DTV algorithm described in Algorithm 1, where ||·||2 is computed by the power method suggested in,131J ϵ ℝ J denotes the constant vector with all elements set to 1, operator sgn(·) returns the sign of a real number, and l1Balla(·) projects a vector onto the l1ball with radius of a. The symbol neg(·) represents the negative thresholding function, i.e. projects any positive elements of its argument to zero.

00096_PSISDG12304_123042N_page_4_1.jpg

3.

EXPERIMENTS

Numerical experiments with simulated data against SART and the DTV algorithm are carried out to validate the effectiveness of the proposed reconstruction algorithm VEA-DTV. The simulated analytic projection data are acquired by the open source software CTSim (http://www.ctsim.org), while the astra toolbox (https://www.astra-toolbox.com/) is utilized to perform the forward and backward projections when they are required.

In terms of parameter selections, since the general CP framwork is adopted, there are totally three parameters subject to tuning, i.e. a,ty and ϵ for applying VEA-DTV. Correspondingly, there are parameters: a,tx,ty, are involved in the DTV algorithm. Ideally,tx,ty should be computed in terms of the ideal image. In our experiments, we apply the SART method with 10 iterations on the full-angular data to provide an approximation which then acts like the ideal image. The parameter ϵ relies on noise estimation of the projection data, which might be not easy to acquire. In this work, we tune the parameters to arrive at best performance in terms of artifacts removal and structure-preserving by sampling the parameter space.

3.1

Inverse crime test

The inverse crime occurs when employing the same forward reconstruction model to generate, as well as to invert, synthetic data. To avoid the inverse crime, analytic projection data are acquired in CTSim. Both noise-free and noisy projection data are tested. The scanning angular range is set to 00096_PSISDG12304_123042N_page_5_2.jpg. Poisson noise with incidence intensity I0 = 1.5 ×105 is added to the analytic projection data.

The results are shown in Fig.2. From left to right, the columns 1 and 2 show the SART (10 iterations) reconstructions, with full data and limited data, respectively, and the columns 3 and 4 show the reconstructions of DTV and VEA-DTV, respectively. As Fig.1 has demonstrated, in the limited-angle reconstructions, the invisible edges are too blurred to be recognized. The first row and second row show the noise-free and noisy reconstructions, respectively. We can easily observe that for the noise-free case, DTV and VEA-DTV achieves similar high quality reconstructions, while for the noisy case, VEA-DTV demonstrates superior results. Distortions and blurring could be easily recognized in the DTV reconstructions, especially at the right bottom part. For the proposed VEA-DTV, blurring has been completely removed, and just small local distortions could be identified along the diagonal of the big parallel gram. Same conclusion could be drawn from the quantitative measures listed in Table 1.

Figure 2:

The analytic rectangle phantom. From left to right, the images are reconstructed by full-angle SART, SART, DTV, VEA-DTV, respectively. The first row shows the reconstructions without noise, while the second row shows the results with added Poisson noise, with incidence intensity I0 = 1.5 ×105 The display window is set to [0, 0.5].

00096_PSISDG12304_123042N_page_5_1.jpg

Table 1:

PSNR, SSIM and NRMSE for the analytic rectangle phantom.

 IndexSARTDTVVEA-DTV
 PSNR22.965038.748839.0063
noise-freeSSIM0.817610.991750.99195
 NRMSE0.127260.003360.00317
 PSNR21.888031.815534.2304
noisySSIM0.583960.933940.99195
 NRMSE0.163080.028990.00951

3.2

Invisible edges recovery capability test

One rhombus phantom with tilt angle of 5 degrees is constructed in CTSim. Its projection data without noise are also acquired in CTSim. Both of them are analytic, which are used to test VEA-DTV’s capacity to recover invisible edges. Since the boundary between the two triangles are completely invisible and not distributed along the axes, it is quite challenging to recover it.

The results are shown in Fig.3. From top to bottom, the images are reconstructed with angular ranges 130, 120 and 110 degrees, respectively. From left to right, the columns 2, 3, and 4 show the reconstructions by SART, DTV and VEA-DTV, respectively. As shown in the second column, the SART method fails to recover the invisible edge. For both DTV and VEA-DTV, the quality of the reconstructions decreases with reducing angular ranges, as demonstrated in the last two columns of Fig.3. When the scanning angular range is 130 degrees, both DTV and VEA-DTV recover the invisible edge nearly perfectly. However, when reducing the angular ranges, the performance of DTV deteriorates quickly, while the proposed VEA-DTV could demonstrate certain resistances to such changes. Same conclusion could be drawn from the quantitative measures listed in Table 2.

Figure 3:

The rhombus phantom. From left to right, the images are reconstruction results from full-angle SART, SART, DTV, STV, respectively. From up to bottom, each row shows the reconstructions with different angular ranges. The display window is set to [0, 0.18].

00096_PSISDG12304_123042N_page_6_1.jpg

Table 2:

PSNR, SSIM and NRMSE for the rhombus phantom.

Angular rangeIndexSARTDTVVEA-DTV
PSNR24.266333.889035.3223
SSIM0.533650.994490.99557
NRMSE0.551990.010480.00754
PSNR21.897931.815533.7639
SSIM0.891560.991770.99376
NRMSE0.167420.016900.01079
PSNR19.7866329.950830.5150
SSIM0.858520.987340.98829
NRMSE0.272220.025970.02279

4.

CONCLUSION

We have proposed a visible edge aware convex model for limited-angle reconstruction which is derived by reformulating a DTV model. By treating the visible edges and the invisible ones differently, the proposed algorithm could make better use of the visible edges prior and achieve better reconstructions. Numerical experiments suggest that, compared to DTV, the proposed VEA-DTV demonstrates improved stability against noise and angular range reducing.

ACKNOWLEDGMENTS

Thanks for the support of the National Natural Science Foundation of China (NSFC) (61971292, 61827809 and 61871275).

REFERENCES

[1] 

Niklason, L., Christian, B., Niklason, L., Kopans, D., Castleberry, D., Opsahl-Ong, B., Landberg, C., Slanetz, P., Giardino, A., Moore, R., Albagli, D., DeJule, M., Fitzgerald, P., Fobare, D., Giambattista, B., Kwasnick, R., Liu, J., Lubowski, S., Possin, G., and Wirth, R., “Digital tomosynthesis in breast imaging,” Radiology, 205 (2), 399 –406 (1997). https://doi.org/10.1148/radiology.205.2.9356620 Google Scholar

[2] 

Fahrig, R., Dixon, R., Payne, T., Morin, R. L., Ganguly, A., and Strobel, N., “Dose and image quality for a cone-beam C-arm CT system,” Medical Physics, 33 (12), 4541 –4550 (2006). https://doi.org/10.1118/1.2370508 Google Scholar

[3] 

Kudo, H. and Saito, T., “Sinogram recovery with the method of convex projections for limited-data reconstruction in computed tomography,” J. Opt. Soc. Am., A 8 1148 –1160 (1991). https://doi.org/10.1364/JOSAA.8.001148 Google Scholar

[4] 

Sidky, E. Y., Kao, C.-M., and Pan, X., “Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT,” Journal of X-ray Science and Technology, 14 (2), 119 –139 (2006). Google Scholar

[5] 

Sidky, E. Y. and Pan, X., “Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization,” Physics in Medicine & Biology, 53 (17), 4777 (2008). https://doi.org/10.1088/0031-9155/53/17/021 Google Scholar

[6] 

Chen, G.-H., Tang, J., and Leng, S., “Prior image constrained compressed sensing (PICCS): a method to accurately reconstruct dynamic CT images from highly undersampled projection data sets,” Medical Physics, 35 (2), 660 –663 (2008). https://doi.org/10.1118/1.2836423 Google Scholar

[7] 

Liu, Y., Ma, J., Fan, Y., and Liang, Z., “Adaptive-weighted total variation minimization for sparse data toward low-dose x-ray computed tomography image reconstruction,” Physics in Medicine & Biology, 57 (23), 7923 (2012). https://doi.org/10.1088/0031-9155/57/23/7923 Google Scholar

[8] 

Quinto, E. T., “Artifacts and visible singularities in limited data X-ray tomography,” Sensing and Imaging, 18 (1), 9 (2017). https://doi.org/10.1007/s11220-017-0158-7 Google Scholar

[9] 

Chen, Z., Jin, X., Li, L., and Wang, G., “A limited-angle CT reconstruction method based on anisotropic TV minimization,” Physics in Medicine & Biology, 58 (7), 2119 (2013). https://doi.org/10.1088/0031-9155/58/7/2119 Google Scholar

[10] 

Wang, T., Nakamoto, K., Zhang, H., and Liu, H., “Reweighted anisotropic total variation minimization for limited-angle CT reconstruction,” IEEE Transactions on Nuclear Science, 64 (10), 2742 –2760 (2017). https://doi.org/10.1109/TNS.2017.2750199 Google Scholar

[11] 

Xu, J., Zhao, Y., Li, H., and Zhang, P., “An image reconstruction model regularized by edge-preserving diffusion and smoothing for limited-angle computed tomography,” Inverse Problems, 35 (8), (2019). https://doi.org/10.1088/1361-6420/ab08f9 Google Scholar

[12] 

Zhang, Z., Chen, B., Xia, D., Sidky, E. Y., and Pan, X., “Directional-tv algorithm for image reconstruction from limited-angular-range data,” Medical Image Analysis, 70 (2021). https://doi.org/10.1016/j.media.2021.102030 Google Scholar

[13] 

Sidky, E. Y., Jørgensen, J. H., and Pan, X., “Convex optimization problem prototyping for image reconstruction in computed tomography with the chambolle–pock algorithm,” Physics in Medicine and Biology, 57 3065 –3091 (2012). https://doi.org/10.1088/0031-9155/57/10/3065 Google Scholar

[14] 

Bertsekas, D. P. et al., “Incremental gradient, subgradient, and proximal methods for convex optimization: A survey,” Optimization for Machine Learning2010(1-38), 3 (2011). Google Scholar
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yinghui Zhang, Ke Chen, Xing Zhao, and Hongwei Li "A visible edge aware directional total variation model for limited-angle reconstruction", Proc. SPIE 12304, 7th International Conference on Image Formation in X-Ray Computed Tomography, 123042N (17 October 2022); https://doi.org/10.1117/12.2647520
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Reconstruction algorithms

Data acquisition

Algorithm development

CT reconstruction

Lithium

Computed tomography

Data modeling

Back to Top