|
1.IntroductionPhotoacoustic imaging (PAI) is a promising medical imaging modality that uses a short electromagnetic pulse to generate ultrasound (US) waves based on the thermoelastic effect.1 Having the merits of the US imaging spatial resolution and the optical imaging contrast in one imaging modality is the main motivation of using PAI.2 Unlike the x-ray that uses an ionizing radiation, PAI uses nonionizing waves, i.e., short laser or radio frequency pulses. In comparison with other imaging modalities, PAI has multiple advantages leading to many investigations.3,4 PAI is a multiscale imaging modality that has been used in different cases of study such as tumor detection,5,6 cancer detection and staging,7 ocular imaging,8 monitoring oxygenation in blood vessels,9 and functional imaging.10,11 There are two techniques of PAI: photoacoustic tomography (PAT) and photoacoustic microscopy.12,13 In 2002, for the first time, PAT was successfully used as in vivo functional and structural brain imaging modality in small animals.14 In PAT, an array of elements may be formed in linear, arc, or circular shape, and mathematical reconstruction algorithms are used to obtain the optical absorption distribution map of a tissue.15–17 Most of the reconstruction algorithms are defined under an ideal imaging condition and full-view array of elements. Also, the noise of the measurement system is not considered as a parameter in the reconstruction procedure. Thus, photoacoustic (PA) reconstructed images contain inherent artifacts caused by imperfect reconstruction algorithms. Reducing these artifacts has become a crucial challenge in PA image reconstruction for different number of transducers and different properties of imaging media.18,19 Since there is a high similarity between US and PA detected signals, many of beamforming algorithms used in US imaging can be used in PAI. Moreover, integrating these two imaging modalities has been a challenge.20,21 Common US beamforming algorithms such as delay-and-sum (DAS) and minimum variance (MV) can be used in PA beamforming with modifications.22 These modifications in algorithms have led to use different hardware to implement an integrated US-PA imaging device. There are many studies focused on developing one beamforming technique for US and PA image formation in order to reduce the cost of imaging system.23,24 Although DAS is the most common beamforming method in linear-array imaging, it is a blind beamformer. Consequently, DAS causes a wide mainlobe and high level of sidelobes.25 Adaptive beamformers are commonly employed in radar and have the ability of weighting the aperture based on the characteristics of detected signals. Apart from that, these beamformers form a high quality image with a wide range of off-axis signals rejection. MV can be considered as one of the commonly used adaptive methods in medical imaging.26–28 Over time, a vast variety of modifications have been investigated on MV such as complexity reduction,29,30 shadowing suppression,31 using of the eigenstructure,32,33 and combination of MV and multiline transmission technique.34 Matrone et al. proposed, in Ref. 35, a new beamforming algorithm namely delay-multiply-and-sum (DMAS) as a beamforming technique, used in medical US imaging. This algorithm, introduced by Lim et al., was initially used in confocal microwave imaging for breast cancer detection.36 In addition, DMAS was used in synthetic aperture imaging.37 Double stage DMAS (DS-DMAS), in which two stages of DMAS is used in order to achieve a higher contrast and resolution compared to DMAS, was proposed for linear-array US and PAI.38–40 In addition, a modified version of coherence factor and a high-resolution CF were used to provide a higher contrast and resolution in linear-array PAI, respectively, compared to conventional CF.41,42 In this paper, a beamforming algorithm, namely minimum variance-based DMAS (MVB-DMAS), is introduced. The expansion of the DMAS algorithm is used, and it is shown that in each term of the expansion, there is a DAS algebra. Since the DAS algorithm is a nonadaptive beamformer and leads to low-resolution images, we proposed to use MV instead of the existing DAS in DMAS algebra expansion. It is shown that using MVB-DMAS results in resolution improvement and sidelobe levels reduction at the expense of higher computational burden. A preliminary version of this work and its eigenspace version have been reported before.43–45 However, in this paper, we are going to present a highly more complete description of this approach and evaluate, numerically and experimentally, its performance and the effects of its parameters. The rest of the paper is organized as follows. In Sec. 2, the DMAS and MV beamforming algorithms are presented. In Sec. 3, the proposed method and the necessary modifications are explained. The numerical and experimental results are presented in Secs. 4 and 5, respectively. The advantages and disadvantages of proposed method are discussed in Sec. 6, and the conclusion is presented in Sec. 7. 2.Background2.1.BeamformingWhen PA signals are detected by a linear array of US transducer, beamforming algorithms such as DAS can be used to reconstruct the image using the where is the output of the beamformer, is the time index, is the number of elements of array, and and are detected signals and corresponding time delay for detector , respectively. DAS is a simple algorithm and can be used for real-time PA and US imaging. However, in the linear-array transducer only a few numbers of detection angles are available. In other words, a low-quality image is formed due to the limited available angles in linear-array transducers. DMAS was introduced in Ref. 35 to improve the image quality. DMAS calculates corresponding sample for each element of the array, the same as DAS, but before summation, samples are combinatorially coupled and multiplied. The DMAS formula is given as To overcome the dimensionally squared problem of Eq. (2), following equations are suggested:35 A product in time domain is equivalent to the convolution of the spectra of the signals in the frequency domain. Consequently, new components centered at the zero frequency and the harmonic frequency appear in the spectrum due to the similar ranges of frequency for and . A band-pass filter is applied on the beamformed output signal to only pass the necessary frequency components, generated after these nonlinear operations while keeping the one centered on almost unaltered. Finally, the filtered-DMAS (F-DMAS) is obtained, extensively explained in Ref. 35. The procedure of DMAS algorithm can be considered as a correlation process, which uses the autocorrelation of aperture. In other words, the output of this beamformer is based on the spatial coherence of PA signals, and it is a nonlinear beamforming algorithm.2.2.Minimum VarianceThe output of MV adaptive beamformer is given as where is time-delayed array detected signals , is the beamformer weights, and and represent the transpose and conjugate transpose, respectively. The detected array signals can be written as where , , and are the desired signal, interference, and noise components received by the array transducer, respectively. Parameters and are the signal waveform and the related steering vector, respectively. MV beamformer can be used to adaptively weight the calculated samples, and the goal of MV beamformer is to achieve optimal weights in order to estimate the desired signal as accurately as possible. The superiority of the MV algorithm has been evaluated in comparison with static windows, such as Hamming window.28 To acquire the optimal weights, signal-to-interference-plus-noise ratio (SINR) needs to be maximized46 where is the interference-plus-noise covariance matrix, and is the signal power. The maximization of SINR can be gained by minimizing the output interference-plus-noise power while maintaining a distortionless response to the desired signal using The solution of Eq. (8) is given as47In practical application, the interference-plus-noise covariance matrix is unavailable. Consequently, the sample covariance matrix is used instead of unavailable covariance matrix using recently received samples and is given as Using MV in medical US imaging encounters some problems that are addressed in Ref. 27, and we briefly review it here. It should be noticed that by applying delays on each element of the array, the steering vector for each signal waveform becomes a vector of ones.26–28 The subarray-averaging or spatial-smoothing method can be used to achieve a good estimation of covariance matrix using decorrelation of the coherent signals received by array elements. The covariance matrix estimation using spatial-smoothing can be written as where is the subarray length and is the delayed input signal for the ’th subarray. Due to limited statistical information, only a few temporal samples are used to estimate covariance matrix. Therefore, to obtain a stable covariance matrix, the diagonal loading (DL) technique is used. This method leads to replacing by loaded sample covariance matrix, , where is the loading factor given as where is a constant related to subarray length. Also, temporal averaging method can be applied along with spatial averaging to gain the resolution enhancement while the contrast is retained. The estimation of covariance matrix using both temporal averaging and spatial smoothing in given as where temporal averaging is used over samples. After estimation of covariance matrix, optimal weights are calculated by Eqs. (9) and (13) and finally the output of MV beamformer is given as where .3.Proposed MethodIn this paper, it is proposed to use the MV adaptive beamformer instead of the existing DAS algebra inside DMAS mathematical expansion. To illustrate this, consider the expansion of the DMAS algorithm, which can be written as where and are the delayed detected signals for element and , respectively, and we hold this notation all over this section. As can be seen, there is a DAS in every term of the expansion, and it can be used to modify the DMAS beamformer. To illustrate this, In Eq. (16), in every terms, there exists a summation procedure, which is a type of DAS algorithm. It is proposed to use MV adaptive beamformer for each term instead of DAS. In other words, since DAS is a nonadaptive beamformer and considers all calculated samples for each element of the array the same as each other, consequently, the acquired image by each term is a low quality image with high levels of sidelobes and broad mainlobe. In order to use MV instead of every DAS in the expansion, we need to carry out some modifications and prepare the expansion in Eq. (16) for the proposed method. The following section contains the essential modifications.3.1.Modified DMASIt should be noticed that the quality of covariance matrix estimation in MV highly depends on the selected length of subarray. The upper boundary is limited to and the lower boundary to 1. Choosing leads to resolution enhancement at the cost of robustness, and leads to resolution reduction and robustness increment. In Eq. (16), each term can be considered as a DAS algorithm with different number of elements of array. In other words, the number of samples of elements contributing in the existing DAS is different in each term, which results from the nature of the DMAS algorithm. To illustrate this, consider the length of array and . There will be terms in DMAS expansion, while first term contains entries, second term contains entries, and finally the last term contains only one entry. Limited number of entries in each term causes problem for MV algorithm due to the limited length of the subarray. This problem can be addressed by adding the unavailable elements in each term in order to acquire large enough number of available elements and consequently high quality covariance matrix estimation. The extra terms, needed to address the problem, are given as where Equation (17) is used to make the terms in Eq. (16) ready to adopt an MV algorithm. Finally, by adding Eqs. (16) and (17), a modified version of the DMAS algorithm namely modified DMAS (MDMAS) is obtained and can be written as The introduced algorithm in Eq. (19) has been evaluated by simulations, and it is proved that this formula can be a modification of DMAS algebra with the same results. To put it more simply, Eq. (19) is the multiplication of DMAS output by 2, and since all the cross-products are considered twice, simulations give the same results. Now, the combination of MDMAS algorithm and MV beamformer is mathematically satisfying and instead of every term in Eq. (19), MV can be implemented using all entities in each term. The expansion of MDMAS combined with MV beamformer can be written as follows: where and are almost the same as and used in Eq. (5), respectively, but the ’th element of the array is ignored in calculation and as a result, the length of these vectors becomes instead of . Considering Eq. (20), the expansion can be written based on a summation, which is considered as a DAS algebra. To illustrate this, consider It is proved that DAS leads to low-quality images and high levels of sidelobe; obviously in Eq. (21), expansion leads to a summation, and this summation can be considered as a DAS. As a final step of MVB-DMAS development, it is proposed to use another MV instead of DAS in order to reduce the contribution of off-axis signals and noise of imaging system. To put it more simply, considering Eq. (21), each term is contributed in a summation process, which is regarded as a DAS, represented in Eq. (1). Since Eq. (5) leads to image enhancement compared to Eq. (1), it is expected to improve the image quality in terms of resolution and levels of a sidelobe having MV instead of outer summation in Eq. (21). MVB-DMAS formula can be written as follows: where is the calculated weight for each term in Eq. (22) using Eq. (9) while the steering vector is a vector of ones. It should be noticed that when there is a multiplication, resulting in squared dimension, the method mentioned in Eq. (4) is used to prevent the squared dimension. Moreover, there are two MV algorithms inside the proposed method, one on the delayed signals and one on the ’th term obtained with Eq. (21). Since we face with the correlation procedure of DMAS, including product function in time domain, in the proposed method, necessary band-pass filter is applied in Eq. (21) for each term, before outer summation. In other words, each term in the proposed method in Eq. (22) is filtered to only pass the necessary components, generated after the nonlinear operations, and then all of them are contributed in the second MV algorithm. In Sec. 4, it is shown that MVB-DMAS beamformer results in resolution improvement and sidelobes level reduction.4.Numerical Results and Performance AssessmentIn this section, numerical results are presented to illustrate the performance of the proposed algorithm in comparison with DAS, DMAS, and MV. 4.1.Simulated Point Target4.1.1.Simulation setupThe -wave MATLAB® toolbox was used to simulate the numerical study.48 Eleven 0.1-mm radius spherical absorbers as initial pressure were positioned along the vertical axis every 5 mm beginning 25 mm from the transducer surface. The imaging region was 20 mm in lateral axis and 80 mm in vertical axis. A linear-array having elements operating at 5 MHz central frequency and 77% fractional bandwidth was used to detect the PA signals generated from the defined initial pressures. The speed of sound was assumed to be during simulations. The sampling frequency was 50 MHz, subarray length , , and for all the simulations. Also, a band-pass filter was applied by a Tukey window () to the beamformed signal spectra, covering 6 to 16 MHz, to pass the necessary information. 4.1.2.Qualitative evaluationFigures 1(a)–1(d) show the output of DAS, MV, DMAS, and MVB-DMAS beamformers, respectively. It is clear that DAS and DMAS result in low-resolution images, and at the high depths of imaging, both algorithms lead to a wide mainlobe. However, DMAS leads to lower level of sidelobes and a higher resolution. In Fig. 1(b), it can be seen that MV results in high resolution, but the high level of sidelobes affect the reconstructed image. Formed image using MVB-DMAS is shown in Fig. 1(d) where the resolution of MV beamformer is maintained and the level of a sidelobe is highly degraded compared to MV. To assess the different beamforming algorithms in detail, lateral variations of the formed images are shown in Fig. 2. Lateral variations at the depth of 50 mm are shown in Fig. 2(c) where DAS, MV, DMAS, and MVB-DMAS result in about , , , and sidelobes, respectively. On the other hand, the width of a mainlobe can be regarded as a parameter, indicating the resolution metric. It can be seen that MV and MVB-DMAS result in significant higher resolution in comparison with DAS and DMAS. 4.1.3.Quantitative evaluationTo quantitatively compare the performance of the beamformers, the full-width-half-maximum (FWHM) in and signal-to-noise ratio (SNR) are calculated in all imaging depths using point targets in the reconstructed images. The results for FWHM and SNR are shown in Tables 1 and 2, respectively. As can be seen in Table 1, MVB-DMAS results in the narrowest width of a mainlobe in all imaging depths compared to other beamformers. In particular, consider depth of 50 mm where FWHM for DAS, DMAS, MV, and MVB-DMAS is about 3565, 2355, 172, and , respectively. More importantly, the FWHM differentiation of the first and last imaging depth indicates that MVB-DMAS and MV techniques variate 158 and , respectively, while DAS and DMAS variate 5425 and , respectively. As a result, FWHM is more stabilized using MVB-DMAS and MV in comparison with DAS and DMAS. The represented SNRs in Table 2 are calculated using where and are difference of maximum and minimum intensity of a rectangular region including a point target [white dashed rectangle in Fig. 1(d)] and standard deviation of the noisy part of the region [red rectangle in Fig. 1(d)], respectively.39 As can be seen in Table 2, MVB-DMAS outperforms other beamformers in SNR. Consider, in particular, the depth of 50 mm where SNR for DAS, DMAS, MV, and MVB-DMAS is 21.7, 32.0, 33.2 and 45.0 dB, respectively.Table 1FWHM (μm) values (in −6 dB) at the different depths.
Table 2SNR (dB) values at the different depths.
4.2.Sensitivity to Sound Velocity InhomogeneitiesIn this section, the proposed method is evaluated in the term of robustness against the sound velocity errors resulting from medium inhomogeneities, which are inevitable in practical imaging. The simulation design for Fig. 1 is used in order to investigate the robustness, except that the sound velocity is overestimated by 5%, which covers and may be more than the typical estimation error.26,27 It should be noticed that in the simulation, we have intentionally overestimated the sound velocity by 5% to evaluate the proposed method. This is important since we usually face this phenomenon in the practical situations where the medium is inhomogeneous, but the images are reconstructed assuming a sound velocity of . As can be seen in Fig. 3(b), MV leads to higher resolution compared to DAS, but the high levels of sidelobe and negative effects of overestimated sound velocity still affect the reconstructed image. It should be noticed that the appeared noise and artifacts in Fig. 3(b) are due to the overestimated sound velocity and the temporal averaging with . DMAS, in Fig. 3(c), reduces these negative effects, but the resolution is not well enough. As can be seen in Fig. 3(d), MVB-DMAS results in the high negative effects reduction of DMAS and the high resolution of MV. However, the reconstructed image using MVB-DMAS contains more artifacts compared to DMAS, which is mainly as a result of the lower SNR of MVB-DMAS compared to DMAS. Figure 4 shows the lateral variation of the reconstructed images in Fig. 3. As can be seen, MVB-DMAS detects the peak amplitude of point target as well as DAS. The resolution of the formed image using MVB-DMAS is improved in comparison with DAS and DMAS. Moreover, the levels of sidelobe using MVB-DMAS is reduced in comparison with other mentioned beamformers. 4.3.Effects of Varying LTo evaluate the effects of varying , the proposed method has been implemented using , , , and . The lateral variations of the formed images at the depth of 45 mm are presented in Fig. 5. Clearly, increasing results in a higher resolution and lower level of sidelobes. Moreover, the SNR, in two imaging depths, is presented in Table 3. It is shown that SNR does not significantly vary for different . However, results in higher SNR. In addition, Table 4 shows the calculated FWHM for different amounts of , and it proves that FWHM is reduced with higher . Table 3SNR (dB) values of MVB-DMAS for the different amounts of L.
Table 4FWHM (μm) values of MVB-DMAS (in −6 dB) for the different amounts of L.
4.4.Effects of Coherence WeightingThe proposed algorithm is also evaluated when it has been combined with CF. To have a fair comparison, all the beamformers are combined with CF weighting. The reconstructed images along with the corresponding lateral variations are shown in Figs. 6 and 7, respectively. As can be seen in Fig. 6, MVB-DMAS + CF results in higher resolution and lower sidelobes compared to other beamformers. The higher resolution of MVB-DMAS + CF is visible compared to DMAS + CF, especially at high depths of imaging. In addition, it is clear that MVB-DMAS + CF reduces the sidelobes compared to MV + CF and improves the target detectability. To have a better comparison, consider Fig. 7 where MVB-DMAS + CF outperforms other beamformers in the terms of the width of a mainlobe in and sidelobes. It is shown that sidelobes for DAS, DMAS, MV, and MVB-DMAS, when all of them are combined with CF, are about , , , and , respectively, showing the superiority of MVB-DMAS+CF. 5.Experimental ResultsTo evaluate the MVB-DMAS algorithm, in this section results of designed experiments are presented. 5.1.Experimental SetupA linear-array of PAI system was used to detect the PA waves and the major components of system include an US data acquisition system, Vantage 128 Verasonics (Verasonics, Inc., Redmond, Washington), a Q-switched Nd:YAG laser (EverGreen Laser, double-pulse Nd: YAG system) with a pulse repetition rate of 25 Hz, wavelength 532 nm, and a pulse width of 10 ns. A transducer array (L7-4, Philips Healthcare) with 128 elements and 5.2 MHz central frequency was used as a receiver. A function generator is used to synchronize all operations (i.e., laser firings and PA signal recording). The data sampling rate was 20.8320 MHz. The schematic of the designed system is presented in Fig. 8, and a gelatin-based phantom used as imaging target is shown in Fig. 9, including two blood inclusions to provide optoacoustic properties. The experimental setup for PA linear-array imaging is shown in Fig. 10 where two parallels wire are used as phantom for another experiment. It should be noticed that in all the experiments, surface of the transducer is perpendicular to the imaging targets. Thus, it is expected to see a cross section of the targets. A band-pass filter was applied by a Tukey window () to the beamformed signal spectra, covering 6 to 13 MHz, to pass the necessary information. 5.2.Qualitative EvaluationThe reconstructed images using the phantom shown in Fig. 9 are presented in Fig. 11. Clearly, there are three structures seen in the reconstructed images, Fig. 11, which two of them are blood inclusions, and the first one is because of the small fracture on the upper part of the phantom shown in Fig. 9. As is demonstrated, DAS leads to a low-resolution image having a high level of sidelobe, especially the target at the depth of 35 mm. MV leads to a higher resolution in comparison with DAS, but negative effects of the high level of sidelobes are obvious Fig. 11(b), and the background of the reconstructed image are affected by noise. DMAS enhances the image in the terms of sidelobes and artifacts but still provides a low-resolution image. MVB-DMAS leads to a higher resolution image having lower sidelobes compared to DAS, DMAS, and MV. It is clear that MVB-DMAS provides the high resolution of MV and low sidelobes of DMAS. The line above the targets is due to the PA signal generation at the surface of the phantom (due to the top illumination) and is supposed to look like what is seen in Fig. 11(d), considering the area of illumination, its location, and laser beam profile. The phantom we used was a bit old, and its surface was slightly dried. Hence, when we added the US gel on the top of the sample, there was a rather large impedance mismatch created at the interface between the surface of the sample and the US gel. In our other similar tests (Fig. 12), we observed the similar artifact but much weaker. In Figs. 11(a) and 11(c), the extended version of the line is seen, which is considered as an artifact. DAS and DMAS stretch imaging targets [see the two imaging targets in Figs. 11(a) and 11(c)]. On the other hand, the stretch in MVB-DMAS is much less due to the correlation process and two stages of MV. The reconstructed images for the designed experiment shown in Fig. 10 are shown in Fig. 12. Since the surface of the transducer is perpendicular to the wires, it is expected to see the targets such as points. As is demonstrated in Fig. 12(a), DAS results in low-resolution points, along with high levels of artifacts, especially at the depth of about 30 mm. In Fig. 12(b), MV leads to resolution improvement while the image is still suffers from high level of sidelobes. The reconstructed image using DMAS, shown in Fig. 12(c), contains low level of sidelobes, but the resolution is low. Finally, MVB-DMAS provides an image with characteristics of DMAS and MV, which are reduced sidelobes and high resolution, respectively. Figure 13 demonstrates the lateral variations of the beamformers at the depth of 33 mm of Fig. 12. As shown in the green circle, MVB-DMAS results in a narrower width of a mainlobe and lower sidelobes (see the arrows). 5.3.Quantitative EvaluationTo compare the experimental results quantitatively, SNR and contrast ratio (CR) metrics are used. Tables 5 and 6 show the calculated SNR and CR for the two targets in the Fig. 11. CR formula is explained in Ref. 35. As can be seen, the calculated metrics show that MVB-DMAS outperforms other beamformers. In other words, it leads to higher SNR and CR. Table 5SNR (dB) values at the different depths using the targets in Fig. 11.
Table 6CR (dB) values at the different depths using the targets in Fig. 11.
5.4.In Vivo ImagingWe imaged median antebrachial vein of a 30-year-old Middle Eastern male in vivo (see Fig. 14). The illumination was done from side using a single large diameter poly(methyl methacrylate) (PMMA) fiber (10 mm). transducer was used to collect the PA signals while it was positioned perpendicular to the vein. The institutional review board at Wayne State University (Independent Investigational Review Board, Detroit, Michigan) approved the study protocol, and informed consent was obtained from the individual before enrolment in the study. In the reconstructed images, as shown in Fig. 15, the top and bottom of the antebrachial vein showed up. It can be seen that the reconstructed image using MVB-DMAS has lower sidelobes, noise, and artifacts compared to other methods, and the cross sections (top and bottom) of the vein are more detectable. 6.DiscussionThe main improvement gained by the introduced method is that the high resolution of the MV beamforming algorithm is retained while the level of sidelobes is reduced. PA images reconstructed by DAS beamformer have a low quality, along with high effects of off-axis signals and high sidelobes. This is mainly due to the blindness of DAS. In fact, the DAS algorithm is a procedure in which all contributing samples are treated identically. On the other hand, DMAS beamformer is a nonlinear algorithm and leads to a high level of off-axis signals rejection due to its correlation process. In DMAS beamformer, all the calculated samples are weighted using a linear combination of the received signals. This procedure makes DMAS a nonblind beamforming algorithm, which results in lower effects of off-axis signals and higher contrast reconstructed images compared to DAS. However, the resolution improvement by DMAS is not good enough in comparison with the MV algorithm. In MV beamformer, samples are weighted adaptively resulting significant resolution improvement. However, it leads to a high level of sidelobes. Therefore, we face two types of beamformers, in which one of them (DMAS) results in sidelobes improvement, and the other one (MV) leads to significant resolution enhancement. The expansion of DMAS algebra shows there are multiple terms and each of them can be interpreted as a DAS with different lengths of array. This could be the source of the low resolution of the DMAS algorithm, and using MV instead of these terms can be an appropriate choice to improve the resolution. However, as shown in Eq. (16), the number of contributing samples in each term of the expansion is different. The length of the subarray in the spatial smoothing highly affects the performance of MV algorithm, and in Eq. (16) there are some terms representing a low length of array and subarray. To address this problem, necessary terms are added to each term, and then MV algorithm is applied on it. The superiority of MV has been proved compared to DAS, and it is expected to have resolution improvement using MV instead of the existing DAS inside the expansion. This method has been used in the introduced algorithm twice to suppress the artifacts and sidelobes of MV. In other words, there are two MV algorithms inside the proposed method, one on the delayed signals and one on the ’th term of Eq. (21). The MV implemented on the delayed signals improves the resolution, but since there is another summation procedure interpreting as DAS, shown in Eq. (16), the level of sidelobes and artifacts reduces the image quality. Second, MV is implemented on the ’th term of Eq. (21) to use the properties of MV algorithm in order to improve the image quality. It should be noticed that since the expansion of DMAS is used to integrate the MV algorithm for resolution improvement, there are multiplication operations in the introduced algorithm. The same as DMAS, a band-pass filter is needed to only pass the necessary information.35 The proposed algorithm adaptively calculates the weights for each samples, which improves the resolution. Since the correlation procedure of DMAS contributes in the proposed method, the sidelobe level of MV is reduced while the resolution is retained due to the existence of MV in the proposed method. MVB-DMAS has been evaluated numerically and experimentally. It should be noticed that the processing time of the proposed method is higher than other mentioned beamformers. Table 7 shows the order of beamformers computations and corresponding processing time. The correlation process of DMAS needs more time compared to DAS, and MV needs time to adaptive calculation of the weights. MVB-DMAS uses two stages of MV algorithm and a correlation procedure, so it is expected to result in higher processing time compared to MV and DMAS. The computational complexity for calculating the weighting coefficients in MVB-DMAS is in the order of . Considering the fact that supposed to be a fraction of , the computational complexity is a function of . Given the weighting coefficient, the computational complexity of the reconstruction procedure is a function of , so the bottle neck of the computational burden is , which is the same as a regular MV algorithm. Note that, the complexity of DMAS and DAS are and , respectively. Since the MV algorithm is used in the proposed method, twice, the effects of length of have been investigated, and the results showed that it affects MVB-DMAS the same as it affects MV. The proposed algorithm significantly outperforms DMAS and MV in the terms of resolution and level of sidelobes, respectively, mainly due to having the specifications of DMAS and MV at the same time. In fact, MVB-DMAS uses the correlation process of DMAS to suppress the artifacts and noise, and adaptive weighting of MV to improve the resolution. Table 7Computational operation and processing time (s).
7.ConclusionIn PAI, DAS beamformer is a common beamforming algorithm, capable of real-time imaging due to its simple implementation. However, it suffers from poor resolution and high level of sidelobes. To overcome these limitations, a DMAS algorithm was used. Expanding DMAS formula leads to multiple terms of DAS. In this paper, we introduced a beamforming algorithm based on the combination of MV and DMAS algorithms, called MVB-DMAS. This algorithm was established based on the existing DAS in the expansion of DMAS algebra, and it was proposed to use MV beamforming instead of the existing DAS. Introduced algorithm was evaluated numerically and experimentally. It was shown that MVB-DMAS beamformer reduces the level of sidelobes and improves the resolution in comparison with DAS, DMAS, and MV, at the expense of higher computational burden. Qualitative results showed that MVB-DMAS has the capabilities of DMAS and MV concurrently. Quantitative comparisons of the experimental results demonstrated that the MVB-DMAS algorithm improves CR about 20%, 9%, and 33%, and enhances SNR 89%, 15%, and 35%, with respect to DAS, DMAS, and MV. DisclosuresThis research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. The authors have no potential conflicts of interest to disclose. ReferencesM. Jeon and C. Kim,
“Multimodal photoacoustic tomography,”
IEEE Trans. Multimedia, 15
(5), 975
–982
(2013). http://dx.doi.org/10.1109/TMM.2013.2244203 Google Scholar
J. Xia and L. V. Wang,
“Small-animal whole-body photoacoustic tomography: a review,”
IEEE Trans. Biomed. Eng., 61
(5), 1380
–1389
(2014). http://dx.doi.org/10.1109/TBME.2013.2283507 IEBEAX 0018-9294 Google Scholar
J. Yao and L. V. Wang,
“Breakthroughs in photonics 2013: photoacoustic tomography in biomedicine,”
IEEE Photonics J., 6
(2), 1
–6
(2014). http://dx.doi.org/10.1109/JPHOT.2014.2310197 Google Scholar
P. Beard,
“Biomedical photoacoustic imaging,”
Interface Focus, 1
(4), 602
–631
(2011). http://dx.doi.org/10.1098/rsfs.2011.0028 Google Scholar
B. Guo et al.,
“Multifrequency microwave-induced thermal acoustic imaging for breast cancer detection,”
IEEE Trans. Biomed. Eng., 54
(11), 2000
–2010
(2007). http://dx.doi.org/10.1109/TBME.2007.895108 IEBEAX 0018-9294 Google Scholar
M. Heijblom, W. Steenbergen and S. Manohar,
“Clinical photoacoustic breast imaging: the Twente experience,”
IEEE Pulse, 6
(3), 42
–46
(2015). http://dx.doi.org/10.1109/MPUL.2015.2409102 Google Scholar
M. Mehrmohammadi et al.,
“Photoacoustic imaging for cancer detection and staging,”
Curr. Mol. Imaging, 2
(1), 89
–105
(2013). http://dx.doi.org/10.2174/2211555211302010010 Google Scholar
A. de La Zerda et al.,
“Photoacoustic ocular imaging,”
Opt. Lett., 35
(3), 270
–272
(2010). http://dx.doi.org/10.1364/OL.35.000270 OPLEDP 0146-9592 Google Scholar
R. O. Esenaliev et al.,
“Optoacoustic technique for noninvasive monitoring of blood oxygenation: a feasibility study,”
Appl. Opt., 41
(22), 4722
–4731
(2002). http://dx.doi.org/10.1364/AO.41.004722 APOPAI 0003-6935 Google Scholar
J. Yao et al.,
“Noninvasive photoacoustic computed tomography of mouse brain metabolism in vivo,”
NeuroImage, 64 257
–266
(2013). http://dx.doi.org/10.1016/j.neuroimage.2012.08.054 NEIMEF 1053-8119 Google Scholar
M. Nasiriavanaki et al.,
“High-resolution photoacoustic tomography of resting-state functional connectivity in the mouse brain,”
Proc. Natl. Acad. Sci. U. S. A., 111
(1), 21
–26
(2014). http://dx.doi.org/10.1073/pnas.1311868111 Google Scholar
Y. Zhou, J. Yao and L. V. Wang,
“Tutorial on photoacoustic tomography,”
J. Biomed. Opt., 21
(6), 061007
(2016). http://dx.doi.org/10.1117/1.JBO.21.6.061007 JBOPFO 1083-3668 Google Scholar
J. Yao and L. V. Wang,
“Photoacoustic microscopy,”
Laser Photonics Rev., 7
(5), 758
–778
(2013). http://dx.doi.org/10.1002/lpor.2013.7.issue-5 LPRAB8 1863-8880 Google Scholar
X. Wang et al.,
“Noninvasive laser-induced photoacoustic tomography for structural and functional in vivo imaging of the brain,”
Nat. Biotechnol., 21
(7), 803
–806
(2003). http://dx.doi.org/10.1038/nbt839 NABIF9 1087-0156 Google Scholar
M. Xu and L. V. Wang,
“Time-domain reconstruction for thermoacoustic tomography in a spherical geometry,”
IEEE Trans. Med. Imaging, 21
(7), 814
–822
(2002). http://dx.doi.org/10.1109/TMI.2002.801176 ITMID4 0278-0062 Google Scholar
Y. Xu, D. Feng and L. V. Wang,
“Exact frequency-domain reconstruction for thermoacoustic tomography. I. Planar geometry,”
IEEE Trans. Med. Imaging, 21
(7), 823
–828
(2002). http://dx.doi.org/10.1109/TMI.2002.801172 ITMID4 0278-0062 Google Scholar
Y. Xu, M. Xu and L. V. Wang,
“Exact frequency-domain reconstruction for thermoacoustic tomography. II. Cylindrical geometry,”
IEEE Trans. Med. Imaging, 21
(7), 829
–833
(2002). http://dx.doi.org/10.1109/TMI.2002.801171 ITMID4 0278-0062 Google Scholar
Q. Sheng et al.,
“A constrained variable projection reconstruction method for photoacoustic computed tomography without accurate knowledge of transducer responses,”
IEEE Trans. Med. Imaging, 34
(12), 2443
–2458
(2015). http://dx.doi.org/10.1109/TMI.2015.2437356 ITMID4 0278-0062 Google Scholar
C. Zhang, Y. Wang and J. Wang,
“Efficient block-sparse model-based algorithm for photoacoustic image reconstruction,”
Biomed. Signal Process. Control, 26 11
–22
(2016). http://dx.doi.org/10.1016/j.bspc.2015.12.003 Google Scholar
M. Abran et al.,
“Development of a photoacoustic, ultrasound and fluorescence imaging catheter for the study of atherosclerotic plaque,”
IEEE Trans. Biomed. Circuits Syst., 8
(5), 696
–703
(2014). http://dx.doi.org/10.1109/TBCAS.2014.2360560 Google Scholar
C.-W. Wei et al.,
“Real-time integrated photoacoustic and ultrasound (PAUS) imaging system to guide interventional procedures: ex vivo study,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 62
(2), 319
–328
(2015). http://dx.doi.org/10.1109/TUFFC.2014.006728 Google Scholar
C. Yoon et al.,
“Pixel based focusing for photoacoustic and ultrasound dual-modality imaging,”
Ultrasonics, 54
(8), 2126
–2133
(2014). http://dx.doi.org/10.1016/j.ultras.2014.06.014 ULTRA3 0041-624X Google Scholar
E. Mercep et al.,
“Hybrid optoacoustic tomography and pulse-echo ultrasonography using concave arrays,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 62
(9), 1651
–1661
(2015). http://dx.doi.org/10.1109/TUFFC.2015.007058 Google Scholar
T. Harrison and R. J. Zemp,
“The applicability of ultrasound dynamic receive beamformers to photoacoustic imaging,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 58
(10), 2259
–2263
(2011). http://dx.doi.org/10.1109/TUFFC.2011.2076 Google Scholar
M. Karaman, P.-C. Li and M. O’Donnell,
“Synthetic aperture imaging for small scale systems,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 42
(3), 429
–442
(1995). http://dx.doi.org/10.1109/58.384453 Google Scholar
J. Synnevag, A. Austeng and S. Holm,
“Adaptive beamforming applied to medical ultrasound imaging,”
IEEE Trans. Ultrason., Ferroelect., Freq. Contr., 54
(8), 1606
–1613
(2007). http://dx.doi.org/10.1109/TUFFC.2007.431 Google Scholar
B. M. Asl and A. Mahloojifar,
“Minimum variance beamforming combined with adaptive coherence weighting applied to medical ultrasound imaging,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 56
(9), 1923
–1931
(2009). http://dx.doi.org/10.1109/TUFFC.2009.1268 Google Scholar
J.-F. Synnevag, A. Austeng and S. Holm,
“Benefits of minimum-variance beamforming in medical ultrasound imaging,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 56
(9), 1868
–1879
(2009). http://dx.doi.org/10.1109/TUFFC.2009.1263 Google Scholar
B. M. Asl and A. Mahloojifar,
“A low-complexity adaptive beamformer for ultrasound imaging using structured covariance matrix,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 59
(4), 660
–667
(2012). http://dx.doi.org/10.1109/TUFFC.2012.2244 Google Scholar
A. M. Deylami and B. M. Asl,
“Low complex subspace minimum variance beamformer for medical ultrasound imaging,”
Ultrasonics, 66 43
–53
(2016). http://dx.doi.org/10.1016/j.ultras.2015.11.012 ULTRA3 0041-624X Google Scholar
S. Mehdizadeh et al.,
“Minimum variance beamforming applied to ultrasound imaging with a partially shaded aperture,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 59
(4), 683
–693
(2012). http://dx.doi.org/10.1109/TUFFC.2012.2246 Google Scholar
B. M. Asl and A. Mahloojifar,
“Eigenspace-based minimum variance beamforming applied to medical ultrasound imaging,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 57
(11), 2381
–2390
(2010). http://dx.doi.org/10.1109/TUFFC.2010.1706 Google Scholar
S. Mehdizadeh et al.,
“Eigenspace based minimum variance beamforming applied to ultrasound imaging of acoustically hard tissues,”
IEEE Trans. Med. Imaging, 31
(10), 1912
–1921
(2012). http://dx.doi.org/10.1109/TMI.2012.2208469 ITMID4 0278-0062 Google Scholar
A. Rabinovich, A. Feuer and Z. Friedman,
“Multi-line transmission combined with minimum variance beamforming in medical ultrasound imaging,”
IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 62
(5), 814
–827
(2015). http://dx.doi.org/10.1109/TUFFC.2014.006754 Google Scholar
G. Matrone et al.,
“The delay multiply and sum beamforming algorithm in ultrasound b-mode medical imaging,”
IEEE Trans. Med. Imaging, 34
(4), 940
–949
(2015). http://dx.doi.org/10.1109/TMI.2014.2371235 ITMID4 0278-0062 Google Scholar
H. B. Lim et al.,
“Confocal microwave imaging for breast cancer detection: delay-multiply-and-sum image reconstruction algorithm,”
IEEE Trans. Biomed. Eng., 55
(6), 1697
–1704
(2008). http://dx.doi.org/10.1109/TBME.2008.919716 IEBEAX 0018-9294 Google Scholar
G. Matrone et al.,
“Depth-of-field enhancement in filtered-delay multiply and sum beamformed images using synthetic aperture focusing,”
Ultrasonics, 75 216
–225
(2017). http://dx.doi.org/10.1016/j.ultras.2016.11.022 ULTRA3 0041-624X Google Scholar
M. Mozaffarzadeh et al.,
“Double stage delay multiply and sum beamforming algorithm applied to ultrasound medical imaging,”
Ultrasound Med. Biol., 44
(3), 677
–686
(2017). http://dx.doi.org/10.1016/j.ultrasmedbio.2017.10.020 USMBA3 0301-5629 Google Scholar
M. Mozaffarzadeh et al.,
“Double stage delay multiply and sum beamforming algorithm: application to linear-array photoacoustic imaging,”
IEEE Trans. Biomed. Eng., 65
(1), 31
–42
(2018). http://dx.doi.org/10.1109/TBME.2017.2690959 IEBEAX 0018-9294 Google Scholar
M. Mozaffarzadeh, A. Mahloojifar and M. Orooji,
“Image enhancement and noise reduction using modified delay-multiply-and-sum beamformer: application to medical photoacoustic imaging,”
in Iranian Conf. on Electrical Engineering (ICEE ’17),
65
–69
(2017). http://dx.doi.org/10.1109/IranianCEE.2017.7985131 Google Scholar
M. Mozaffarzadeh, M. Mehrmohammadi and B. Makkiabadi,
“Enhanced linear-array photoacoustic beamforming using modified coherence factor,”
(2017). Google Scholar
M. Mozaffarzadeh, M. Mehrmohammadi and B. Makkiabadi,
“Image improvement in linear-array photoacoustic imaging using high resolution coherence factor weighting technique,”
(2017). Google Scholar
M. Mozaffarzadeh, A. Mahloojifar and M. Orooji,
“Medical photoacoustic beamforming using minimum variance-based delay multiply and sum,”
Proc. SPIE, 10335 1033522
(2017). http://dx.doi.org/10.1117/12.2269608 PSISDG 0277-786X Google Scholar
M. Mozaffarzadeh et al.,
“Photoacoustic imaging using combination of eigenspace-based minimum variance and delay-multiply-and-sum beamformers: simulation study,”
(2017). Google Scholar
M. Mozaffarzadeh et al.,
“Eigenspace-based minimum variance adaptive beamformer combined with delay multiply and sum: experimental study,”
(2017). Google Scholar
R. A. Monzingo and T. W. Miller, Introduction to Adaptive Arrays, Scitech Publishing, Raleigh
(1980). Google Scholar
J. Capon,
“High-resolution frequency-wavenumber spectrum analysis,”
Proc. IEEE, 57
(8), 1408
–1418
(1969). http://dx.doi.org/10.1109/PROC.1969.7278 IEEPAD 0018-9219 Google Scholar
B. E. Treeby and B. T. Cox,
“k-wave: Matlab toolbox for the simulation and reconstruction of photoacoustic wave fields,”
J. Biomed. Opt., 15
(2), 021314
(2010). http://dx.doi.org/10.1117/1.3360308 JBOPFO 1083-3668 Google Scholar
BiographyMoein Mozaffarzadeh received his BSc degree in electronics engineering from Babol Noshirvani University of Technology, Mazandaran, Iran, in 2015, and his MSc degree in biomedical engineering from Tarbiat Modares University, Tehran, Iran, in 2017. He is currently a research assistant at the Research Center for Biomedical Technologies and Robotics, Institute for Advanced Medical Technologies, Tehran, Iran. His current research interests include photoacoustic image reconstruction, ultrasound beamforming, and biomedical imaging. Ali Mahloojifar received his BSc degree in electronic engineering from Tehran University, Tehran, Iran, in 1988, and he received his MSc degree in digital electronics from Sharif University of Technology, Tehran, Iran, in 1991. He obtained his PhD in biomedical instrumentation from the University of Manchester, Manchester, United Kingdom, in 1995. He joined the Biomedical Engineering Group at Tarbiat Modares University, Tehran, Iran, in 1996. His research interests include biomedical imaging and instrumentation. Mahdi Orooji received his BSc degree in electrical engineering from the University of Tehran, Iran, and his MSc and PhD degrees in communication systems from the Louisiana State University, Louisiana, USA. He was a postdoctoral fellow in the Case Western Reserve University, Cleveland, Ohio, USA. Currently, he is an assistant professor of bioelectrical engineering at the Tarbiat Modares University, Tehran, Iran. His research interests include the computer aided diagnostics System and machine vision in medical images. Karl Kratkiewicz graduated summa cum laude with his BS degree in biomedical physics from Wayne State University’s Honors College, Detroit, Michigan, USA, in 2017. He is now a biomedical engineering PhD student at Wayne State University. His area of research includes multimodal (ultrasound/photoacoustic/elastography) imaging and photoacoustic neonatal brain imaging. Saba Adabi currently is a research fellow in medical imaging in Mayo Clinic. She received her PhD in Applied Electronics Department in biomedical engineering from Roma Tre University in Rome, Italy, in 2017. She joined Wayne State University as a scholar researcher in 2016 to 2017. Her main research interests include optical coherence tomography, photoacoustic/ultrasound imaging. She is a member of OSA and SPIE. Mohammadreza Nasiriavanaki received his PhD with outstanding achievement in medical optical imaging and computing from the University of Kent in the United Kingdom. His bachelor's and master's degrees with honors are in electronics engineering. He is currently an assistant professor in the Biomedical Engineering, Dermatology and Neurology Departments of Wayne State University and scientific member of Karmanos Cancer Institute. His area of expertise is designing medical devices for skin and brain diseases diagnosis using photoacoustic imaging and optical coherence tomography technologies. |