Translator Disclaimer
23 October 2020 Measuring hemoglobin spectra: searching for carbamino-hemoglobin
Author Affiliations +
Abstract

Significance: The arterial carbon dioxide (CO2) partial pressure PaCO2 is a clinically relevant variable. However, its measurement requires arterial blood sampling or bulky and expensive transcutaneous PtcCO2 meters. While the spectrophotometric determination of hemoglobin species—such as oxy-hemoglobin (O2Hb) and deoxy-hemoglobin (HHb)—allowed for the development of pulse oximetry, the measurement of CO2 blood content with minimal discomfort has not been addressed yet.

Aim: Characterizing human carbamino-hemoglobin (CO2Hb) absorption spectrum, which is missing from the literature. Providing the theoretical background that will allow for transcutaneous, noninvasive PaCO2 measurements.

Approach: A tonometry-based approach was used to obtain gas-equilibrated, lysed, diluted human blood. Equilibration was performed with both CO2, dinitrogen (N2), and ambient air. Spectrophotometric measurements were carried out on the 235- to 1000-nm range. A theoretical background was also derived from that of pulse oximetry.

Results: The absorption spectra of both CO2Hb and HHb were extremely close and comparable with that of state-of-the-art HHb. The above-mentioned theoretical background led to an estimated relative error above 30% on the measured amount of CO2Hb in a subject’s blood. Auxiliary measurements revealed that the use of ethylene diamine tetraacetic acid did not interfere with spectrophotometric measurements, whereas sodium metabisulfite did.

Conclusions: CO2Hb absorption spectrum was measured for the first time. Such spectrum being close to that of HHb, the use of a theoretical background based on pulse oximetry theory for noninvasive PaCO2 measurement seems extremely challenging.

1.

Introduction

The accurate determination of blood gases—namely dioxygen (O2) and carbon dioxide (CO2)—is of crucial importance in medical care since it gives circulatory as well as ventilatory clues on the state of a patient.1 In particular, in case of acute respiratory failure, chronic obstructive pulmonary disease or cystic fibrosis, the monitoring of parameters such as the arterial blood dioxygen saturation (SatO2) and CO2 arterial pressure (PaCO2) can strongly affect patient handling and outcome.24

Pulse oximetry makes it possible to determine SatO2. It is cheap, noninvasive, accurate, and as such, is widely used in clinical context.5,6 At the opposite, PaCO2 measurements methods are far less satisfactory. In a nutshell, they consist of arterial blood sampling, airway capnometry, and transcutaneous capnometry.

Arterial blood sampling is the gold standard for PaCO2 measurement.7 However, it is invasive, can be both painful and risky,8 needs expensive blood gas analyzer, and the blood samples must be promptly analyzed upon collection.9 To circumvent these flaws, two capnometry methods were developed. Airway capnometry—also known as capnography—is also invasive since it requires the patient to wear a mask or to undergo endotracheal intubation, and it is not reliable in case of end-tidal partial CO2 pressure (PetCO2)/PaCO2 mismatch caused by an increase in physiologic dead space.10,11 Finally, transcutaneous capnometry is derived from the Stow–Severinghaus electrode12 and has been used for a long time in the clinical practice.13 Its drawbacks are mainly the need to heat the skin of the patient between 37°C and 44°C, the need for frequent recalibrations of the sensor, and the high price of transcutaneous CO2 monitors (15k). Consequently, there is a strong need for an alternative to the existing approaches, so as to provide a cheap, noninvasive, and accurate technique for long-term PaCO2 monitoring.

The determination of SatO2 with pulse oximetry is made possible by the spectral differences existing between oxyhemoglobin (O2Hb) and deoxyhemoglobin (HHb), allowing to quantify their proportion in arterial blood. It would be extremely interesting if a similar technique was available to distinguish between carbamino-hemoglobin (CO2Hb) and HHb based on a difference of absorption between these two compounds. Since an equilibrium exists among blood pH, CO2Hb content, bicarbonate concentration, and PaCO2,14,15 the determination of CO2Hb blood content would be a first step toward PaCO2 determination.

Under such perspective, the starting point is to analyze the CO2Hb absorption spectrum. However—at least to the best of our knowledge—its measurement has never been reported in the literature. Consequently, the present article exposes the measurement and analysis of the CO2Hb absorption spectrum. The feasibility of pulse carbametry, the equivalent of pulse oximetry, substituting CO2Hb to O2Hb are also assessed.

2.

Materials and Methods

2.1.

Hemoglobin Preparation and Measurement

Although CO2Hb absorption spectrum has yet to be measured, a number of authors were interested in measuring the spectra of other hemoglobin species in the past decades. The most complete work on the topic is undoubtedly that of Zijlstra et al.,16 which summarized almost a century of research aiming at measuring mainly O2Hb, HHb, met-hemoglobin (MetHb), and carboxy-hemoglobin (COHb) spectra. Inspired by their work, the following experimental protocol was elaborated:

  • Human blood was diluted at 1:10 or 1:1000 [HEPES 20 mM, KCL 150 mM, pH 7.20, ethylene diamine tetraacetic acid (EDTA) 0.61 mM for the 1:10 dilution only, to prevent coagulation].

  • Blood cells were lysed with ultrasound (Sonicator W-10, Heat Systems Ultrasonics).

  • The obtained haemolysates were equilibrated using Eschweiler spherical glass tonometers during at least 30 min with either pure dinitrogen (N2)—to obtain HHb—or pure CO2—to obtain CO2Hb. Alternatively, they were let in ambient air so as to obtain O2Hb.

  • The equilibrated hemolysates were carefully handled so as not to spoil them with ambient air. Syringes and cuvettes were rinsed three times with the tonometry gas, and the solutions were collected from the tonometers through a septum.

  • Equilibrated solutions were poured in airtight quartz cuvettes (CV10Q1400FS, Thorlabs, 10 mm transmitted path length) placed inside the spectrophotometer (Carry 5000, Agilent Technologies).

  • Measurements were performed on the 235- to 600-nm range [hereafter referred to as the ultraviolet/visible (UV–Vis) range] for the 1:1000 dilution and on the 600- to 1000-nm range [visible/infrared (Vis–IR) range] for the 1:10 dilution for N2- and CO2-equilibrated solutions (235 to 590 nm and 590 to 1000 nm for air-equilibrated solutions).

Figure 1 shows the above-described steps, which led to six different mixtures: diluted lysed blood at 1:10 or 1:1000 ratio, equilibrated with CO2, N2, or ambient air. In addition, the dilution medium was also measured: pure for baseline correction, and with EDTA and sodium metabisulfite separately, to assess the influence of these substances on the hemolysates measurements. Indeed, no information about the absorption spectrum of sodium metabisulfite nor the one of EDTA in solution is to be found in the literature. An analysis of the relative variations of the spectrum of the dilution medium with and without sodium metabisulfite and EDTA was thus performed. Concentrations in the intramedium were 6.1 mM for EDTA and 2.0 mM for sodium metabisulfite.

Fig. 1

Preparation of blood, from the vein to the spectrophotometer. The different steps are (from top left to bottom left): venous sampling, dilution, ultrasound lysis, tonometry with CO2 or N2, careful handling, pouring into airtight glass cuvettes for spectrophotometric measurements.

JBO_25_10_105001_f001.png

In addition, the influence of tonometry duration on the obtained spectra was investigated. Equilibration durations were varied between 30 and 45 min, in 3 min steps, whereas measuring the absorbance at the 759-nm peak of the spectra of CO2Hb and HHb. A Pearson correlation coefficient test was then performed, searching for an influence of the tonometry duration on the measured absorbance values.

2.2.

Assessment of Pulse Carbametry Feasibility

For pulse carbametry to be achievable, one needs that the absorption spectra of CO2Hb and HHb exhibit sufficient differences at accessible wavelengths. Assessing how much is sufficient is a complex task, which can be answered by addressing the following questions in order:

  • 1. Are the measured average spectra computed for HHb and CO2Hb different?

  • 2. If they are, is this difference statistically significant?

  • 3. Does this difference—observed in the laboratory—translate into something actually exploitable in real life setups, where absorption measurements would be affected by:

    • additional absorption caused by tissues surrounding the blood vessels,

    • light reflection and scattering in the said tissues,

    • intersubject variations in physiology,

    • noises related to ambulatory measurement setups (ambient light and motion),

    • the accuracy of embedded sensors, which is bound to be lower than that of laboratory spectrophotometers.

Different methods were developed to answer each of these questions, as detailed below.

2.2.1.

Comparison of average spectra for Hb and CO2Hb

After offset correction and outlier removal, a set of spectra for each hemoglobin species was obtained. Each of these sets was then averaged to obtain the final absorption spectrum of the corresponding hemoglobin species. Resulting average spectra were then plotted for visual comparison (see Fig. 3).

2.2.2.

Statistical significance of the difference between spectra

The problem of assessing whether two absorption spectra are statistically different is extremely complex. Indeed, one has to deal with limitations of two kinds:

  • 1. The estimated absorption spectrum of each species is a vector of dependent random variables A^species(λ) such that   λ, A^species(λ)N[Aspecies(λ),σspecies(λ)2] where σspecies(λ) is the standard variation of the noise on the measurement of the absorption of the species under consideration at wavelength λ. Thus, deciding whether the difference in the measured spectra of HHb and CO2Hb is statistically significant yields a multivariate analysis problem. Solving the latter would need one to perform at least as many measurements as there are points in the measured spectra (i.e., several hundreds).17

  • 2. Variations in the measured spectrum of each species are bound to be induced by the slight differences in the manipulations specific to each species; thus, a statistically significant difference between measured spectra could actually reveal a difference in the protocol and not the spectra themselves.

To address such difficulties, the following analysis was performed on the measured hemoglobin spectra: for each pair of hemoglobin species (HHb, CO2Hb) and (HHb, O2Hb), we computed the average, minimum, and maximum relative difference of their absorption spectra. This difference, computed for each wavelength, allows one to assess whether there is an exploitable discrepancy between the spectra of HHb and CO2Hb in the same order of magnitude as that between HHb and O2Hb.

2.2.3.

Applicability in real life setups

To estimate how much difference should be measurable between the spectra of HHb and CO2Hb for it to be exploitable in a pulse carbametry context, parallels were drawn with pulse oximetry. Specifically, we propose to

  • use the literature available on pulse oximetry to obtain an estimation of the accuracy of photoplethysmographic measurements on human skin,

  • derive a theoretical background for pulse carbametry, and

  • use the aforementioned accuracy in such background along with the results of our measurement, to conclude on the feasibility of pulse carbametry.

Note that we focus, in all our analysis, on a two-wavelength system. Even though we acknowledge that multiwavelength approaches can improve the performance of photoplethysmographic systems, the goal of this paper is to evaluate whether there are couples of wavelengths for which the spectra of HHb and CO2Hb exhibit exploitable difference. The optimization of the exploitation of these pairs of wavelengths, should they exist, is out of the scope of this paper.

Accuracy in pulse oximetry

Our goal here is not to dive deeply into the theoretical foundations of pulse oximetry—as it has been done elsewhere1821—but to estimate the sources of inaccuracy of this technique. In pulse oximetry, SatO2 is derived from the so-called ratio of ratio, R, which in turns utilizes absorbance of light by human tissues at two different wavelengths. R is given as

Eq. (1)

R=EAC(λ1)/EDC(λ1)EAC(λ2)/EDC(λ2)=EO2Hb(λ1)·SatO2+EHHb(λ1)·(1SatO2)EO2Hb(λ2)·SatO2+EHHb(λ2)·(1SatO2),
where λ1 and λ2 are the two measurement wavelengths, often 660 and 940 nm, and E is either the extinction coefficient of the tissues, measured with photoplethysmography (PPG) and decomposed in its alternative (AC) and continuous (DC) parts (left hand side) or the extinction coefficient of hemoglobin species (right-hand side).

The question at stake for our analysis is then: what accuracy on R is achievable in practice by common photoplethysmographic sensors? As can be seen from Eq. (1), such an accuracy on R can be estimated based on the accuracy on SatO2 that is reported in the literature. The latter has been studied in many clinical trials—themselves reviewed5,6—and a mean standard deviation of 2% on the 70%- to 100%-SatO2 range can be considered to be achievable under good measurement conditions—that is, mainly no movement from the subject and a good perfusion index. Figure 2 shows the results obtained when taking such a standard deviation for SatO2 and computing the corresponding R measurement inaccuracies at the wavelengths 660 and 940 nm—the two most-used wavelengths in pulse oximetry—using Zijlstra et al.16 absorption coefficient for O2Hb and HHb.

Fig. 2

(a) An error of 2% on the SatO2 reading at 80% of SatO2 (in blue) is the result of an inaccuracy of 7% on the measurement of R (in red). (b) Conversely, if we impose a 2% error on the SatO2 reading, we can compute the relative variation of R, which generated such error.

JBO_25_10_105001_f002.png

One can see that the lower the oxygen saturation is, the more accurate the measurement of R needs to be to guarantee a given accuracy on SatO2. The minimum measured accuracy on R is of 5.6% at 70% of SatO2. Such calculations were made with the hypothesis that all errors were Gaussians.

Accuracy in pulse carbametry

Such a minimum error in the case of pulse oximetry gives a best-case—hence optimistic—value of the achievable accuracy on R measurement, using transcutaneous ratiometric techniques. When applying a similar method to obtain the concentration in CO2Hb in a pulse carbametry context, one may thus expect—at best—a similar accuracy on R. Such a context will be detailed below.

Let us consider a binary system composed solely of HHb and CO2Hb and define carbon dioxide saturation (SatCO2) as

Eq. (2)

SatCO2=CCO2HbCCO2Hb+CHHb,
where C is the concentration of the different species involved. Using the pulse oximetry theoretical background,5 SatCO2 can be derived from a measured ratio of ratio R as

Eq. (3)

SatCO2(λ1,λ2)=EHHb(λ1)R·EHHb(λ2)EHHb(λ1)ECO2Hb(λ1)R·[EHHb(λ2)ECO2Hb(λ2)].

The feasibility of pulse carbametry will be assessed as follows: considering the extinction coefficients ECO2Hb and EHHb derived from our spectrophotometric measurements, and the aforementioned standard deviation on R, the standard deviation on SatCO2 will be computed for each (λ1, λ2) couple on the 235- to 1000-nm range. Then, finding the minimum value of this deviation with respect to (λ1, λ2) will provide the best achievable accuracy using pulse carbametry. More explicitly, the minimum SatCO2 accuracy reachable with pulse carbametry is given as

Eq. (4)

δSatCO2=min(λ1,λ2)σSatCO2(λ1,λ2),
wherein σSatCO2(λ1,λ2) is the relative standard deviation of SatCO2(λ1,λ2), computed from the R standard deviation in the case of pulse oximetry (5.6%). Judging whether a given minimal accuracy δSatCO2 is small enough is essentially an arbitrary choice. Still, one can rely on the clinically accepted range for PaCO2, which is ±7.5  mmHg (95% limits of agreement, corresponding to ±2 S.D.).22 Such a range translates into a standard deviation of 9% on PaCO2 reading, at a standard PaCO2 level of 40 mmHg. Thus, the decision threshold on δSatCO2 was set to this value as a first approximation, i.e., if δSatCO2 is below 9%, pulse carbametry will be considered feasible.

3.

Results

3.1.

Hemoglobin Spectra

The obtained spectra of diluted lysed blood equilibrated with ambient air, pure N2, and pure CO2 are presented in Fig. 3 after baseline correction and outlier removal. Each spectrum is averaged over (UV–Vis/Vis–IR spectra number): 24/13 (CO2), 10/17 (N2), and 32/38 (air) measurements. The variations in the number of trials are explained by several reasons. At first, there were two different measurement campaigns for the UV–Vis and Vis–IR range, leading to less measurements in the Vis–IR (some fluorescence measurements were performed instead, unpublished). Then, there were twice as much measurements made with O2Hb as with N2 or CO2, only because O2Hb was readily available and measured while waiting for HHb and CO2Hb to be obtained by tonometry. Finally, we used an outlier removal algorithm based on the standard deviation of the measurements, removing measurements diverging more than roughly ±2.5 standard deviation from the mean, using an adaptative threshold and a recursive algorithm inspired by the work of Hadi et al.23. This threshold choice was arbitrary, as is that of outlier detection and removal in the general case.24 Given the important number of wavelengths in each measurement and the limited number of measurements performed, a power calculation was not feasible.

Fig. 3

Measured absorption spectra of diluted lysed blood tonometered with O2, N2, or CO2. The vertical scale is arbitrary, data were scaled for representation and corresponds to two different dilution ratios of 1:1000 for the UV–Vis 235 to 600 nm range (left) and 1:10 for the Vis–IR 600- to 1000-nm range (right) (ranges are 235 to 590 nm and 590 to 1000 nm for air-equilibrated solutions). The black dashed line separates the UV–Vis from the Vis–IR measurements.

JBO_25_10_105001_f003.png

The absorption spectra of HHb and CO2Hb appear to be extremely close, especially compared to O2Hb. The standard deviations in absorption for O2Hb, CO2Hb, and HHb were (mean standard deviation, minimum, and maximum) 1.200.387.55  mAbs, 3.160.5136.34  mAbs, and 2.430.4021.02  mAbs, corresponding to relative variations of 0.530.142.24%, 1.080.055.74%, and 0.810.074.59%, respectively.

Figure 4 gives a more quantitative analysis to the difference among O2Hb, CO2Hb, and HHb spectra. While the relative differences between O2Hb and HHb spectra—clearly visible in Fig. 3—reach several tens of percent, those between CO2Hb and HHb are much more tenuous. The differences between mean O2Hb and HHb spectra on the one hand and CO2Hb and HHb spectra on the other hand were (mean absolute difference and maximum) 0.18(1.99)  Abs and 0.08(0.11)  Abs, corresponding to relative variations of 36(153)% and 2(13)%, respectively.

Fig. 4

Relative differences between HHb and CO2Hb (in blue) and between HHb and O2Hb (in red) absorption spectra. The two thin lines for each comparison represent the maximum and minimum values along all measurements. For instance, for HHb/CO2Hb comparison, at a given wavelength, the higher line represents HHb maximum value minus CO2Hb minimum value, and the lower line represents HHb minimum value minus CO2Hb maximum value.

JBO_25_10_105001_f004.png

3.2.

Intra Medium

Figure 5 shows the spectra of the dilution medium with and without sodium metabisulfite. Results with EDTA are not shown since they were indistinguishable from pure dilution medium on a full scale view. More subtle effects of these substances are shown in Fig. 6, which focuses on the deviation—with respect to pure dilution medium—of the prepared EDTA or sodium metabisulfite solutions. Again, each spectrum is averaged over several measurements. For the UV–Vis/Vis–IR range: 28/34 (pure) and 12/11 (sodium metabisulfite) measurements. For the Vis–IR only range: five (EDTA) measurements.

Fig. 5

Absorption spectra of the dilution medium with and without the addition of sodium metabisulfite (2.0 mM), we can observe a marked absorbing effect of sodium metabisulfite in the ultraviolet, up to almost 500 nm.

JBO_25_10_105001_f005.png

Fig. 6

Relative variations of the dilution medium absorption spectrum upon the addition of EDTA (0.61 mM) or sodium metabisulfite (2.0 mM). The left side is multiplied by 0.1 (10% of relative variation for sodium metabisulfite at 500 nm).

JBO_25_10_105001_f006.png

3.3.

Tonometry Duration

The influence of tonometry duration on the measured absorbances was found to be insignificant for durations between 30 and 45 min, with test results being ρ=0.13, p=0.62, on 17 samples for N2 tonometry and ρ=0.04, p=0.91, on 13 samples for CO2 tonometry (Pearson correlation coefficient). We concluded that 30 min of equilibration time were enough to obtain either CO2Hb or HHb.

3.4.

Pulse Carbametry

The obtained CO2Hb and HHb spectra—CO2 and N2 tonometry, respectively—shown in Fig. 3 were then used to perform the analysis presented in Sec. 2.2.3. The value of σSatCO2 as a function of the two wavelengths (λ1,λ2) is shown in Fig. 7.

Fig. 7

σSatCO2 as a function of (λ1,λ2) on the 235- to 1000-nm range.

JBO_25_10_105001_f007.png

The minimal value taken by σSatCO2 is δSatCO2=34.2% at λ1=508  nm and λ2=600  nm. However, as can be seen from the asymmetry of the spots on the λ1=600  nm or λ2=600  nm lines, these values likely originate from limitation of the measurement system. Indeed, with a 1:1000 dilution, lysed blood absorption was below 1.2 Abs on the full 235- to 600-nm range. At the opposite, the 1:10 dilution topped at 2.8 Abs near 600 nm, which is close to the saturation value of 3.0 Abs of the spectrophotometer that we used. Ideally, to circumvent this flaw of the measurement setup, three dilutions at 1:10, 1:100, and 1:1000 could have been performed on the 235 to 450 nm, 450 to 650 nm, and 650 to 1000 nm ranges, respectively.

Still, even with these flaws, which—in the worst case—could increase the spectral differences between HHb and CO2Hb and thus lower the error on SatCO2 measurements, the reached accuracy is still far above the 9% target established previously. If σSatCO2 values near the 600-nm lines are discarded and focus is made on other spots such as the (λ1=510  nm, λ2=580  nm) area, values above 41% are to be found for δSatCO2.

4.

Discussion

At first, the chosen method for obtaining CO2Hb, HHb, and O2Hb is discussed. Then, the hemoglobin spectra are compared with those available in the literature, the influence of EDTA and sodium metabisulfite are also discussed. Finally, the feasibility of pulse carbametry is assessed.

4.1.

On the Chosen Method

Among the several authors who measured hemoglobin absorption spectra, some used freshly drawn blood16,2533 whereas others preferred lyophilized hemoglobin.3436 Lyophilized blood, despite its convenience, has several drawbacks. First, it is composed merely of MetHb33,37 and thus needs an oxidation procedure to convert it back into O2Hb, a step that involves chemicals that might interfere with the hemoglobin spectrum. Second, a better affinity of hemoglobin has been reported for hemoglobin extracted from freshly drawn blood.25,33 These considerations drove our choice toward fresh blood as a hemoglobin source.

However, fresh blood requires the lysis of erythrocytes and other blood cells to yield a limpid solution. Despite the common use of a surfactant such as Sterox SE27,28,32 or equivalent,25,29,31 we preferred an ultrasound lysis, which adds no foreign chemical in blood for the same effect.30

Fresh blood sampling could also require centrifugation to keep only the erythrocytes and avoid spectral interferences from other blood components, namely leucocytes and lipids. Yet, since hemoglobin is the main absorbing compound in blood, by two up to three orders of magnitude,38 we did not consider the centrifugation step mandatory. Lastly, fresh blood sampling requires the addition of an anticoagulant if it is not largely diluted. Consequently, for the 1:10 dilution ratio—on the 600- to 1000-nm range—we considered the addition of EDTA to the collected blood. Its spectral influence was measured and found to be negligible on the studied range—as shown in Fig. 6—with relative absorption variations in the ±1% range, corresponding to absolute variations in the ±1  mAbs range, well below the measurement standard deviation (1.249.3+14.1  mAbs for the dilution medium itself for instance, similar values were found for dilution medium with EDTA). We concluded that EDTA did not have any influence on the measured spectra, in the quantity used in our experiments.

Concerning hemoglobin measurements in its reduced form, the use of sodium dithionite (Na2S2O4) has been reported, as a mean to quickly obtain HHb.26,27,30,33,36 Alas, it has also been reported to alter its absorption spectrum.16,35,39 We conducted investigations on the possible use of sodium metabisulfite (Na2S2O5), which—like sodium dithionite—yields to the production of aqueous bisulfite anion, the strong reducing agent converting O2Hb into HHb. Our results—see Figs. 5 and 6—confirm earlier observations and extend them with quantitative measurements on the 235- to 1000-nm range. We would not recommend the use of bisulfite anion for its strong absorption, especially in the short wavelengths up to 500 nm.

Consequently, tonometry was chosen to obtain HHb and CO2Hb. Concerning its duration, 30 min was found to be sufficient in Eschweiler spherical glass tonometers filled with 6 mL of diluted lysed blood as demonstrated in Sec. 3.3. However, one should bear in mind that this duration is strongly dependent on several parameters, such as the shape of the tonometer used for equilibration, its filling level, or the gas flow rate for instance.

The dilution medium was chosen to correspond to an intracellular medium (with high K+ concentration). pH was also set to an erythrocyte intracellular value of 7.2 since it has been reported to be that of the inner erythrocytes.40,41 It has also been reported35,42,43 that the pH has an impact—although relatively small—on the measured hemoglobin spectra. Concerning the choice of HEPES as a buffer, a better preservation of the hemoglobin oxygenation function was reported with HEPES over Tris/Bis-Tris.44 Finally, the chosen dilution ratios are justified since hemoglobin has been reported to follow Beer–Lambert law, would it be for extremely diluted or concentrated solutions.34

4.2.

Hemoglobin Spectra

The measured spectra of diluted lysed blood, either equilibrated with N2 or ambient air, are extremely close to that of the literature, as can be seen in Fig. 8. This comforts us in the method that we employed and the above-mentioned choices. The small discrepancies observed between our spectra and that of the literature may be explained by a number of methodological differences. For instance, several authors27,28,32 used a surfactant such as Sterox SE to perform the erythrocyte lysis, whereas we chose to use ultrasound. The surfactant may have a spectral impact, which—to the best of our knowledge—has never been quantified. Other authors, even when choosing tonometry, added some sodium dithionite before measuring.16 Yet, sodium dithionite, such as sodium metabisulfite, is known to have a marked spectral influence.35 Zijlstra et al.16 also mentioned that in case of too long tonometry, supernatant residues sometimes appeared in the diluted blood, the nature of which was not determined. Although we did not observe such behavior, a small turbidity might have been present in their measurements, or ours. Of all the literature spectra shown in Fig. 8, Prahl and Kolyva only offered raw coefficients, whereas Assendelft and Zijlstra detailed their protocol. It is therefore difficult to analyze the potential sources of differences between their spectra or between their spectra and ours.

Fig. 8

Our measurements (plain line) compared to that of Prahl,45 Zijlstra et al.,16 Kolyva et al.,46 and Assendelft.27 Our measurements are consistent with that of the literature for O2Hb (air) and HHb (N2).

JBO_25_10_105001_f008.png

Overall, the repeatability of the measurements was fairly good, with mean standard deviation of 0.53%, 1.08%, and 0.81%, for O2Hb, CO2Hb, and HHb measurements, respectively, which can be compared to values between 0.8% and 2.1% reported by Zijlstra et al.16 The rather high maximum standard deviations reported in Sec. 3.1 (2.24%, 5.74%, and 4.59% for O2Hb, CO2Hb, and HHb, respectively) are mainly due to the measurement limits of the spectrophotometer near 600 nm, corresponding to either too low (0.05  Abs) absorbance below 600 nm or too high (2.5  Abs) absorbance above 600 nm. When computing the mean standard deviation without the 580- to 620-nm range for O2Hb, CO2Hb, and HHb, maximum standard deviations values drop to 7.25, 12.60, and 21.02 mAbs, corresponding to relative variations of 1.31%, 2.78%, and 2.54%, respectively. The mean absorption spectra that we measured for O2Hb, CO2Hb, and HHb are published as Supplementary Material (see also the supplemental “ readme” file explaining the units used).

Fig. 3 also reveals that the spectra of HHb and CO2Hb are extremely close, their differences being more than one order of magnitude below the one between the spectra of O2Hb and HHb, as can be seen in Fig 4. Moreover, the measured HHb and CO2Hb spectra are similar to the HHb spectra already available in the literature, as can be seen in Fig. 8. Such observations tend to make one believe that the formation of carbamined compounds between CO2 and hemoglobin terminal amine groups does not change the hemoglobin molecule conformation significantly, hence bringing no spectral alteration. However, such intuition shall not have the value of evidence, this is why the possible use of slight differences between HHb and CO2Hb will now be discussed.

4.3.

Pulse Carbametry

Given the accuracy threshold that was fixed at 9% for δSatCO2, and the observed value of 34.2%—or even more if the values close to the spectrophotometer saturation limit are discarded—we could readily conclude that pulse carbametry—as it was presented—is not feasible. However, several additional aspects of this technique need to be further discussed.

At first sight, the consideration of a binary system composed solely of HHb and CO2Hb can seem surprising. Indeed, in practice, human arterial blood is composed at least of O2Hb, HHb, and CO2Hb—and even COHb47,48 and MetHb49,50 in small amounts. That being said, it should be clear that the demonstrated inability to distinguish between CO2Hb and HHb, even when they are the only absorbing compounds involved, would be worsened by the addition of any other perturbing absorbing species— e.g., O2Hb. An in-depth analysis of the tertiary system O2Hb–HHb–CO2Hb would have been necessary only if pulse carbametry had been found to be possible in a binary system.

Then, we made the hypothesis that all studied errors were Gaussian. It is most often considered to be the case in the literature,5,6 and we will also stick to this hypothesis in the absence of evidence to the contrary. Thus, the main remaining question is to know whether the mathematical functions giving R=f(SatO2) and SatCO2=g(R) can be reasonably linearly approximated. The latter assumption has to be checked for f at the 660/940  nm couple, and for g on the full 235 to 1000 nm range. The calculation of the derivative of these two functions is straightforward and allows one to conclude that the relative variation of the slope of f stays below 3.8% on the 70- to 100%-SatO2 range at 660/940  nm, whereas the slope of g stays below 2.2% on the 0% to 100%-SatCO2 range at 340/600  nm (maximal value on the 235- to 1000-nm range). We can thus safely conclude that approximating f and g with linear functions is reasonable and that our hypothesis concerning Gaussian errors is justified.

Next, all the calculations leading to Fig. 7 were made considering a monochromatic skin illumination. In a typical pulse carbametry application, the light source is more likely to be a laser, laser diode, or light-emitting diode (LED). In such cases, the effect of a nonmonochromatic light source will be a degradation of δSatCO2 caused by the spectral spread of the source. Such spread will basically smooth HHb and CO2Hb spectra by convolving them with the emission spectrum of the source. Such spectrum can in turn be roughly regarded as a Gaussian window of full-width at half-maximum (FWHM) of a few (laser sources) or a few tenths (LED) of nanometers. For instance, a source with an FWHM of 5 nm leads to a δSatCO2 of 36.8%, with an FWHM of 20 nm this value reaches 42.1%, to be compared with the 34.2% of the aforementioned ideal monochromatic case.

Finally, the last assumption that we made concerns the extrapolation to pulse carbametry of the accuracy on R measurement in the SatO2 case. Such an assumption was made considering that the 660- and 940-nm wavelengths were not chosen randomly but to maximize pulse oximetry sensitivity. In other words, they were chosen such that a small change in SatO2 translates into a huge change in measured light intensity at certain wavelengths,27,51 but also such that they were in the tissues optical window—the 700- to 1000-nm range.5254 Such considerations make the SatO2 660/940  nm situation a best case, and we would expect other wavelengths couples to give equally or worse accurate R measurements. This remains, however, a supposition since—to the best of our knowledge—there appears to be no study on the measurement accuracy on SatO2—and thus R—at wavelengths different from the usual 660/940  nm pair. Still, it is worth noticing that our conclusions would remain unchanged, even if we managed somehow to drastically reduce the measuring accuracy on R—say by a factor two or three, we would still have a δSatCO2 value above 9%.

5.

Conclusion

In this study, CO2Hb absorption spectrum was measured for the first time. O2Hb, HHb, and CO2Hb were obtained from diluted lysed blood equilibrated with ambient air, pure N2, and pure CO2, respectively. Their isolation method was discussed thoroughly, including the possible use of EDTA or sodium metabisulfite.

The absorption spectra of O2Hb and HHb were close to that of literature, whereas the absorption spectrum of CO2Hb was extremely close to that of HHb. No influence of EDTA was found. Sodium metabisulfite, however, strongly absorbs in the ultraviolet and visible range up to 500 nm. As such, it should not be used in this spectral range for hemoglobin reduction.

A theoretical variation of pulse oximetry applied to the determination of CO2Hb fraction was presented, called pulse carbametry. Such theory was applied to the aforementioned measurements to conclude whether the slight variations observed between HHb and CO2Hb absorption spectra could be used in such context. Our observations show that such approach seems extremely challenging since these spectra are almost identical. In particular, on the basis of current knowledge, pulse carbametry may not be used in medical practice.

Yet, this work may benefit from further investigations to consolidate its conclusions. In particular, only two wavelengths were considered for pulse carbametry. It would be interesting to use more sophisticated multiwavelengths approaches since they usually give better results in the case of pulse oximetry,20 although the question of wavelengths selection becomes more complex.55,56

Disclosures

The authors declare that there are no conflicts of interest related to this article.

Acknowledgments

We would like to express our special thanks to Karine Pichavant for her technical and scientific support during the measurements, Céline Théron for her technical help, and Sylvain Gioux for his redacting advices. This work was funded by BiOSENCY and the Université de Bretagne Occidentale. Some of the graphic symbols presented in Fig. 1 were provided by Icon Island, Eucalyp, Teresa Moravcova, Adrien Coquet, Turkubb, and Amrit Mazumder from the Noun Project and are under Creative Comons license (CC BY 3.0).

References

1. 

P. D. Wagner, “The physiological basis of pulmonary gas exchange: implications for clinical interpretation of arterial blood gases,” Eur. Respir. J., 45 (1), 227 –243 (2015). https://doi.org/10.1183/09031936.00039214 Google Scholar

2. 

T. Bradley et al., “Daytime hypercapnia in the development of nocturnal hypoxemia in COPD,” Chest, 97 308 –312 (1990). https://doi.org/10.1378/chest.97.2.308 CHETBF 0012-3692 Google Scholar

3. 

E. Kerem et al., “Prediction of mortality in patients with cystic fibrosis,” New Engl. J. Med., 326 (18), 1187 –1191 (1992). https://doi.org/10.1056/NEJM199204303261804 NEJMBH Google Scholar

4. 

A. M. Al Rajeh and J. R. Hurst, “Monitoring of physiological parameters to predict exacerbations of chronic obstructive pulmonary disease (COPD): a systematic review,” J. Clin. Med., 5 108 (2016). https://doi.org/10.3390/jcm5120108 Google Scholar

5. 

M. Nitzan, A. Romem and R. Koppel, “Pulse oximetry: fundamentals and technology update,” Med. devices: Evidence Res., 7 231 –239 (2014). https://doi.org/10.2147/MDER.S47319 Google Scholar

6. 

A. Jubran, “Pulse oximetry,” Crit. Care, 19 272 (2015). https://doi.org/10.1186/s13054-015-0984-8 Google Scholar

7. 

T. A. Raffin, “Diagnostic decision: indications for arterial blood gas analysis,” Ann. Internal Med., 105 (3), 390 –398 (1986). https://doi.org/10.7326/0003-4819-105-3-390 AIMEAS 0003-4819 Google Scholar

8. 

B. V. Scheer, A. Perel and U. J. Pfeiffer, “Clinical review: complications and risk factors of peripheral arterial catheters used for haemodynamic monitoring in anaesthesia and intensive care medicine,” Crit. Care, 6 199 (2002). https://doi.org/10.1186/cc1489 Google Scholar

9. 

A. A. Nanji and K. J. Whitlow, “Is it necessary to transport arterial blood samples on ice for pH and gas analysis?,” Can. Anaesth. Soc. J., 31 (1984). https://doi.org/10.1007/BF03009545 Google Scholar

10. 

S. D. McSwain et al., “End-tidal and arterial carbon dioxide measurements correlate across all levels of physiologic dead space,” Respir. Care, 55 (3), 288 –293 (2010). Google Scholar

11. 

M. E. Donnellan, “Capnography: gradient PaCo2 and PetCo2,” Appl. Technol. Pulmonary Med., 126 –131 (2011). Google Scholar

12. 

J. W. Severinghaus and P. B. Astrup, “History of blood gas analysis. III. Carbon dioxide tension,” J. Clin. Monitor., 2 60 –73 (1986). https://doi.org/10.1007/BF01619178 JCMOEH 0748-1977 Google Scholar

13. 

A. Conway et al., “Accuracy and precision of transcutaneous carbon dioxide monitoring: a systematic review and meta-analysis,” Thorax, 74 157 –163 (2018). https://doi.org/10.1136/thoraxjnl-2017-211466 THORA7 0040-6376 Google Scholar

14. 

C. Geers and G. Gros, “Carbon dioxide transport and carbonic anhydrase in blood and muscle,” Physiol. Rev., 80 681 –715 (2000). https://doi.org/10.1152/physrev.2000.80.2.681 PHREA7 0031-9333 Google Scholar

15. 

A. Lumb, Nunn’s Applied Respiratory Physiology, 8th ed.Elsevier(2016). Google Scholar

16. 

W. G. Zijlstra, A. Buursma and O. W. van Assendelft, Visible and Near Infrared Absorption Spectra of Human and Animal Hemoglobin: Determination and Application, VSP(2000). Google Scholar

17. 

A. C. Rencher, Methods of Multivariate Analysis, 2nd ed.John Wiley and Sons(2002). Google Scholar

18. 

G. A. Millikan, “The oximeter, an instrument for measuring continuously the oxygen saturation of arterial blood in man,” Rev. Sci. Instrum., 13 (10), 434 –444 (1942). https://doi.org/10.1063/1.1769941 RSINAK 0034-6748 Google Scholar

19. 

A. Zwart et al., “Multicomponent analysis of hemoglobin derivatives with reversed-optics spectrophotometer,” Clin. Chem., 30 (3), 373 –379 (1984). https://doi.org/10.1093/clinchem/30.3.373 Google Scholar

20. 

K. Urpalainen, “Development of a fractional multi-wavelength pulse oximetry algorithm,” Aalto University, (2011). Google Scholar

21. 

T. Tamura et al., “Wearable photoplethysmographic sensors–past and present,” Electronics, 3 (2), 282 –302 (2014). https://doi.org/10.3390/electronics3020282 ELECAD 0013-5070 Google Scholar

22. 

K. Bendjelid et al., “Transcutaneous Pco2 monitoring in critically ill adults: clinical evaluation of a new sensor,” Crit. Care Med., 33 2203 –2206 (2005). https://doi.org/10.1097/01.CCM.0000181734.26070.26 CCMDC7 0090-3493 Google Scholar

23. 

A. Hadi, “Identifying multiple outliers in multivariate data,” J. R. Stat. Soc. Ser. B (Methodol.), 54 (1992). JSTBAJ 0035-9246 Google Scholar

24. 

H. Aguinis, R. K. Gottfredson and H. Joo, “Best-practice recommendations for defining, identifying, and handling outliers,” Organ. Res. Methods, 16 (2), 270 –301 (2013). https://doi.org/10.1177/1094428112470848 1094-4281 Google Scholar

25. 

B. L. Horecker, “The absorption spectra of hemoglobin and its derivatives in the visible and near infra-red regions,” J. Biol. Chem., 148 (1), 173 –183 (1943). JBCHA3 0021-9258 Google Scholar

26. 

R. B. Barlow and M. L. Polanyi, “Absorption measurements for oxygenated and reduced hemoglobin in the range 0.6—1.88 microns,” Clin. Chem., 8 (1), 67 –71 (1962). https://doi.org/10.1093/clinchem/8.1.67 Google Scholar

27. 

O. W. V. Assendelft, Spectrophotometry of Haemoglobin Derivatives, Van Gorcum, Assen (1970). Google Scholar

28. 

G. A. Mook et al., “Spectrophotometric determination of oxygen saturation of blood independent of the presence of indocyanine green,” Cardiovasc. Res., 13 233 –237 (1979). https://doi.org/10.1093/cvr/13.4.233 CVREAU 0008-6363 Google Scholar

29. 

S. Wray et al., “Characterization of the near infrared absorption spectra of cytochrome aa3 and haemoglobin for the non-invasive monitoring of cerebral oxygenation,” Biochim. Biophys. Acta – Bioenergetics, 933 (1), 184 –192 (1988). https://doi.org/10.1016/0005-2728(88)90069-2 Google Scholar

30. 

Y. Mendelson and J. C. Kent, “Variations in optical absorption spectra of adult and fetal haemoglobins and its effect on pulse oximetry,” IEEE Trans. Biomed. Eng., 36 844 –848 (1989). https://doi.org/10.1109/10.30810 IEBEAX 0018-9294 Google Scholar

31. 

M. Cope, “The application of near infrared spectroscopy to non-invasive monitoring of cerebral oxygenation in the newborn infant,” University of London, (1991). Google Scholar

32. 

W. Zijlstra and W. Meeuwsenvanderroest, “Absorption spectra of human, fetal and adult oxyhemoglobin, de-oxyhemoglobin, carboxyhemoglobin, and methemoglobin,” Clin. Chem., 37 1633 –1638 (1991). https://doi.org/10.1093/clinchem/37.9.1633 Google Scholar

33. 

E. Mieczkowska, R. Koncki and L. Tymecki, “Hemoglobin determination with paired emitter detector diode,” Anal. Bioanal. Chem., 399 3293 –3297 (2010). https://doi.org/10.1007/s00216-010-4358-4 ABCNBP 1618-2642 Google Scholar

34. 

D. L. Drabkin and J. H. Austin, “Spectrophotometric studies: V. A technique for the analysis of undiluted blood and concentrated hemoglobin solutions,” J. Biol. Chem., 112 (1), 105 –115 (1935). JBCHA3 0021-9258 Google Scholar

35. 

K. A. Dalziel and J. P. O’brien, “Side reactions in the deoxygenation of dilute oxyhaemoglobin solutions by sodium dithionite,” Biochem. J., 67 (1), 119 –124 (1957). https://doi.org/10.1042/bj0670119 Google Scholar

36. 

F. E. Robles, S. Chowdhury and A. Wax, “Assessing hemoglobin concentration using spectroscopic optical coherence tomography for feasibility of tissue diagnostics,” Biomed. Opt. Express, 1 310 –317 (2010). https://doi.org/10.1364/BOE.1.000310 BOEICL 2156-7085 Google Scholar

37. 

Sigma-Aldrich, “Human haemoglobin lyophilised powder, H7379, product page,” (2020). Google Scholar

38. 

M. C. Meinke et al., “Optical properties of platelets and blood plasma and their influence on the optical behavior of whole blood in the visible to near infrared wavelength range,” J. Biomed. Opt., 12 (1), 014024 (2007). https://doi.org/10.1117/1.2435177 JBOPFO 1083-3668 Google Scholar

39. 

G. Schubart et al., “Spektralphotometrie von hämolysiertem blut im nahen infrarot,” Pflüger’s Archiv für die gesamte Physiologie des Menschen und der Tiere, 265 1 –10 (1957). https://doi.org/10.1007/BF00364516 Google Scholar

40. 

F. B. Jensen, “Red blood cell pH, the Bohr effect, and other oxygenation-linked phenomena in blood O2 and Co2 transport,” Acta Phys. Scand., 182 (3), 215 –227 (2004). https://doi.org/10.1111/j.1365-201X.2004.01361.x Google Scholar

41. 

D. Kummerow et al., “Variations of intracellular pH in human erythrocytes via K+ (Na+)/H+ exchange under low ionic strength conditions,” J. Membr. Biol., 176 207 –216 (2000). https://doi.org/10.1007/s00232001089 JMBBBO 0022-2631 Google Scholar

42. 

P. D. Wimberley et al., “Effect of pH on the absorption spectrum of human oxyhemoglobin: a potential source of error in measuring the oxygen saturation of hemoglobin,” Clin. Chem., 34 (4), 750 –754 (1988). https://doi.org/10.1093/clinchem/34.4.750 Google Scholar

43. 

W. Zijlstra and A. Buursma, “Spectrophotometry of hemoglobin: absorption spectra of bovine oxyhemoglobin, deoxyhemoglobin, carboxyhemoglobin, and methemoglobin,” Comp. Biochem. Physiol. Part B: Biochem. Mol. Biol., 118 (4), 743 –749 (1997). https://doi.org/10.1016/S0305-0491(97)00230-7 CBPBB8 0305-0491 Google Scholar

44. 

R. Weber, “Use of ionic and zwitterionic (Tris/BisTris and HEPES) buffers in studies on hemoglobin function,” J. Appl. Physiol. (Bethesda, Md.: 1985), 72 1611 –1615 (1992). https://doi.org/10.1152/jappl.1992.72.4.1611 Google Scholar

45. 

S. Prahl, “Tabulated molar extinction coefficient for hemoglobin in water,” (1998). Google Scholar

46. 

C. Kolyva et al., “Systematic investigation of changes in oxidized cerebral cytochrome c oxidase concentration during frontal lobe activation in healthy adults,” Biomed. Opt. Express, 3 2550 –2566 (2012). https://doi.org/10.1364/BOE.3.002550 BOEICL 2156-7085 Google Scholar

47. 

P. M. Mcllvaine, W. C. Nelson and D. Bartlet, “Temporal variation of carboxyhemoglobin concentrations,” Arch. Environ. Health: Int. J., 19 (1), 83 –91 (1969). https://doi.org/10.1080/00039896.1969.10666808 Google Scholar

48. 

N. J. Wald et al., “Carbon monoxide in breath in relation to smoking and carboxyhaemoglobin levels,” Thorax, 36 (5), 366 –369 (1981). https://doi.org/10.1136/thx.36.5.366 THORA7 0040-6376 Google Scholar

49. 

H. Kravitz et al., “Methemoglobin values in premature and mature infants and children,” AMA J. Diseases Child., 91 1 –5 (1956). https://doi.org/10.1001/archpedi.1956.02060020003001 Google Scholar

50. 

E. van Kampen, W. Zijlstra, “Determination of hemoglobin and its derivatives,” Advances in Clinical Chemistry, 8 141 –187 Elsevier(1966). Google Scholar

51. 

G. Mook, O. van Assexdelft and W. Zijlstra, “Wavelength dependency of the spectrophotometric determination of blood oxygen saturation,” Clin. Chim. Acta, 26 (1), 170 –173 (1969). https://doi.org/10.1016/0009-8981(69)90304-0 CCATAR 0009-8981 Google Scholar

52. 

B. C. Wilson, W. P. Jeeves and D. M. Lowe, “In vivo and post mortem measurements of the attenuation spectra of light in mammalian tissues,” Photochem. Photobiol., 42 (2), 153 –162 (1985). https://doi.org/10.1111/j.1751-1097.1985.tb01554.x PHCBAP 0031-8655 Google Scholar

53. 

C. Melo et al., “Characterization of light penetration in rat tissues,” J. Clin. Laser Med. Surg., 19 175 –179 (2001). https://doi.org/10.1089/104454701316918925 JCLSEO Google Scholar

54. 

C. Ash et al., “Effect of wavelength and beam width on penetration in light-tissue interaction using computational methods,” Lasers Med. Sci., 32 1909 –1918 (2017). https://doi.org/10.1007/s10103-017-2317-4 Google Scholar

55. 

J. A. Brunelle et al., “Simultaneous measurement of total hemoglobin and its derivatives in blood using co-oximeters: analytical principles; their application in selecting analytical wavelengths and reference methods; a comparison of the results of the choices made,” Scand. J. Clin. Lab. Investig. Suppl., 224 47 –69 (1996). https://doi.org/10.3109/00365519609088624 Google Scholar

56. 

B. J. Brendel and T. Nielsen, “Selection of optimal wavelengths for spectral reconstruction in diffuse optical tomography,” J. Biomed. Opt., 14 (3), 034041 (2009). https://doi.org/10.1117/1.3156823 JBOPFO 1083-3668 Google Scholar

Biography

Emmanuel Dervieux is a PhD student with a background in physics, signal processing, and telecommunications. He reoriented toward applied physiology in his PhD course. His research interest focuses on the chemical and optical properties of human skin and tissues on the one hand, and on transcutaneous sensing techniques on the other hand, aiming at discovering novel, non-invasive schemes for transcutaneous blood gas analysis.

Quentin Bodinier is an engineer from 2014. He received his PhD in digital systems and signal processing in 2017. He applied his expertise in developing 5G wireless communication systems. He now leads the research and development of innovative biophysical sensors at BiOSENCY, a French SME which focuses on facilitating the remote monitoring of patients with chronic respiratory diseases. There, they focus on two main research areas: (1) development of clinical-grade and non-invasive biophysical sensors and (2) preventive clinical data analysis.

Wilfried Uhring received his MSc degree in microelectronic, his master’s degree in engineering physic in 1999, and his PhD in optoelectronics from the University of Strasbourg, France, in 2002. His research activity is about high-speed imaging. He designed several ultrafast optical detection devices, such as streak cameras, gated intensified cameras, and fast image CMOS sensors with sub-nanosecond to picosecond resolution for biomedical imaging. He is the author/coauthor of more than 120 peer-reviewed articles in international journals and conferences.

Michaël Théron is an assistant professor at the University of Brest, France. He is a member of the Laboratory of Physiology ORPHY. His scientific expertise belongs to the fields of animal physiology (mammals and fish), adaptations to physical and chemical constraints, gas transport, bioenergetics, hydrostatic, and gas pressures, with two main research fields: (1) ecotoxicology of fuel oil contamination and assessment of depollution methods and (2) effects of gas and hydrostatic pressures in the context of human diving.

© The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Emmanuel Dervieux, Quentin Bodinier, Wilfried Uhring, and Michaël Théron "Measuring hemoglobin spectra: searching for carbamino-hemoglobin," Journal of Biomedical Optics 25(10), 105001 (23 October 2020). https://doi.org/10.1117/1.JBO.25.10.105001
Received: 8 June 2020; Accepted: 28 September 2020; Published: 23 October 2020
JOURNAL ARTICLE
15 PAGES


SHARE
Advertisement
Advertisement
Back to Top