Photoplethysmography (PPG), as first described in the 1930s,1 is a simple, low-cost, and non-invasive optical technique used to measure the blood volume changes that occur in man and other animals due to the pulsatile nature of the circulatory system.2 Since its development decades ago, its ability to monitor vital physiological parameters in real-time, e.g., heart/respiration rates, blood oxygen saturation, has gained significant attention in the biomedical and clinical community and, in the case of pulse oximetry, made PPG the standard of monitoring blood oxygen saturation. However, the need to apply a PPG sensor directly to the skin constrains its practicability in situations such as the evaluation of skin healing, or when free movement is required. Recent studies have investigated the effect of contact force on the amplitude and timing of the PPG signal using spring-loaded conventional PPG probes3,4 and have shown that this force must be carefully controlled to obtain high-quality clinical data from the signals. One potential way to overcome these problems is to use the recently introduced technique of imaging PPG. This is a noncontact method that can detect the heart-generated pulse wave and can be used, for instance, to assess peripheral blood perfusion.126.96.36.199.10.11.–12 Compared to conventional contact PPG, remote-sensing imaging has the advantage of offering detailed spatial information simultaneously from multiple sites of arbitrary size and location, thus allowing the derivation and mapping of physiological parameters and ultimately facilitating insights that would otherwise be difficult or even impossible to obtain from single point contact measurements. Moreover, as a noncontact technique, imaging PPG avoids the deformation of the arterial wall, typically caused by the compression of the spring-loaded clips in contact PPG finger probes or varying contact force in handheld probes, thereby providing more reliable signals for clinical applications.
With significant achievements and improvements in imaging hardware and software, the past decade has witnessed a rapid growth in the literature pertaining to imaging PPG techniques. The use of an imaging sensor in a PPG system provides additional functionality with respect to a single diffuse sensor, particularly motion compensation and region of interest selection, both of which enable a robust and flexible noncontact PPG system. For instance, Wieringa and colleagues have introduced a complementary metal oxide semiconductor (CMOS) camera-based multiple wavelength imaging PPG device that provides a potential route toward contactless assessment of blood oxygen saturation,8 and Poh et al. have reported a webcam-based technique for remote acquisition of PPG signals that uses ambient light as a source of illumination.6 These examples indicate two research directions within imaging PPG: high-definition camera-based imaging PPG (iPPG) and webcam-based imaging PPG (wPPG). The first of these two examples, which typically comprises a high sample rate and is coupled with a custom light source, has proven to be superior in sensitivity and the ability to assess multiple physiological parameters, while the second, which normally uses ambient light as the illumination source, shows its advantage in terms of simplicity and low cost but lacks the ability to extract several clinically important parameters, including blood oxygen saturation. However successful it has been in acquiring physiological parameters, e.g., heart/respiration rate, a number of key questions still remain for the wPPG technique. Particularly, we have to address the practical issue of how variations in ambient light intensity could influence the performance of the system during physiological assessment. Moreover, compared to the accumulated literature regarding imaging PPG,188.8.131.52.10.11.–12 there are few studies that compare these two techniques and appraise their performance within the same experiment. In our previous work,5,11 a high-resolution CMOS camera-based imaging PPG system has been introduced, and its practicability and reliability in terms of remote assessment of the cardiovascular system has been shown. Therefore, in the present study, the remote imaging PPG systems, including a high-speed CMOS color camera, a webcam, an optical spectrometer, and a contact PPG (cPPG) sensor, have been set up to compare the reliability and sensitivity of ambient light-based imaging PPG measurements in accessing the cardiovascular system. Measurements were taken from subjects undergoing various intensities of exercise in order to make these comparative assessments under different physiological conditions.
Methods and Materials
Ten healthy male subjects recruited from Loughborough University were enrolled in this study, as summarized in Table 1. None of them had any known cardiovascular disease, and none were diabetic. The investigation conformed to the principles outlined in the Declaration of Helsinki (1989) of the World Medical Association and was approved by the local Ethical Committee. The nature of the research was explained to the subjects prior to the recordings, and informed consent was obtained. The subjects were asked to refrain from consuming caffeine or alcohol and not to smoke or undertake strenuous exercise for the two hours leading to the study.
Subject characteristics and weather conditions.
|Sub no.||Gender||Age (years)||Weight (kg)||BMI (kg/m2)||HR (bpm)||SBP (mmHg)||DBP (mmHg)||Cold cover/room temp.a|
Note: BMI indicates body mass index; HR, heart rate; SBP, systolic blood pressure; and DBP, diastolic blood pressure.
The temperature and the weather condition were recorded only during the data capture period.
A schematic diagram of the validation platform is shown in Fig. 1. The subjects and all equipment were positioned in a room with no artificial light present. The high-speed color CMOS camera (Model: MC1311, Mikrotron GmbH, Unterschleissheim, Germany) with maximum resolution of was focused on the face of the participants using a standard C-mount lens (Model: M0814-MP Megapixel Lens 8 mm f1.4, Computar, New York). The distance between the camera and face was approximately 350 mm. A color video was also recorded from the face via a webcam (Model: Webcam Pro 9000, Logitech, Fremont, California) with embedded Carl Zeiss® optics lens. Because of the different camera focal length, the webcam was fixed about 200 mm in front of the face [Fig. 2(a)]. In all experiments, a commercial pulse oximetry contact sensor (Model: P871RA, Viamed, Keighley, United Kingdom) was placed on the index finger of the left hand to measure the participant’s pulse signal as a reference. The analog signals from the contact sensor were digitized using a DISCO4 (Dialog Devices, Loughborough, United Kingdom) data acquisition system incorporating a 12-bit A/D converter running at a sample rate of 128 Hz. To assess the influence of ambient light intensity, an optical spectrometer (Model: USB4000, Ocean Optics, Dunedin, Florida) was used. The recorded wavelength range was between 525 and 750 nm for consideration of the red and green parts of the visible spectrum, as they reportedly contain stronger plethysmographic signals than shorter wavelengths.7 The upper frequency limit was determined by the infrared cutoff filters in the webcam. The images captured from the CMOS camera were synchronized to the signals acquired from the contact sensor, spectrometer, and webcam via an additional signal from the camera. Specifically, when initiating the iPPG capture, a trigger signal was sent to initialize the recording of the spectrometer and cPPG subsystem, and a red light-emitting diode (LED) () placed within the field of view of the webcam was simultaneously turned on for synchronization of the wPPG sub-system [Fig. 2(d)].
A similar experimental protocol has been reported in more detail in our previous studies.5,11 Briefly, before commencing each experiment, the subject’s gender, age, height, weight, and body mass index, as well as the outside cloud cover and room temperature, were noted at the time of measurement. The participants were then required to sit on a stable chair and rest for at least 10 min, at which time blood pressure was measured in the right arm with a digital blood pressure monitor (Model: M6, Omron, Kyoto, Japan). The cPPG signal acquisition and ambient light intensity monitoring were then initialized to wait for the trigger signal from the CMOS camera. This was set to record with an image size of (raw image prior to Bayer filtering) at a frame rate of 50 Hz, for 30 s. On receiving the trigger signal from the CMOS camera, the webcam video, the cPPG signal, and the ambient light intensity spectrometer signal were captured for 180 s. The spectrometer was set at a fixed sample rate of 10 Hz, and video capture from the webcam was configured via custom-written software in MATLAB (MathWorks, Natick, Massachusetts), to give an image size of and a frame rate of 30 Hz. Additional measurements of 180-s duration were taken after two 10-min periods of exercise on a fixed bicycle (Model: XR-580, PowerTrek, United Kingdom), in order to assess the ability of the platform in obtaining the physiological parameters under various conditions, and to investigate the influence of different exercise levels on the cardiovascular system. The first exercise period was performed at a rate of (exercise 1), and the second at (exercise 2). Following the second exercise period, a final 180-s recording was made after an additional 10-min rest period (Fig. 3). Thus four sections of data were recorded from each of the 10 subjects.
In a previous study, we proposed a motion compensation technique for extraction of physiological parameters from measurements taken under conditions of motion due to exercise.5 In the present study, dual-channel images were recorded under postexercise conditions, where a simple yet efficient averaging approach7 was adopted and found adequate to attenuate these relatively small motion artifacts. After a set of recordings was acquired, a Bayer function was applied to extract the three channel images (red, green, and blue, per channel) from the CMOS camera. A manual procedure was then conducted to detect the face within the frames obtained from this camera and the webcam and to localize the measurement region of interest (ROI) [Figs. 2(a) and 2(d)]. This manual ROI determination approach was repeated for all subjects. The raw imaging PPG signals ( and components) were then derived from the average value of the pixels within the ROI. A fifth-order Butterworth bandpass filter with cutoff frequencies set at 0.5 and 4 Hz was employed to accommodate a wide range of heart rate measurements. The three PPG signals, from iPPG (CMOS camera), wPPG (webcam), and cPPG (contact PPG sensor), were then saved for postprocessing.
The Fourier transform (FT) has been widely utilized in conventional PPG signal processing, because of its simplicity and ability to provide fundamental physiological information easily and directly.8,13 However successful, uncritical FT use may lead to ambiguous results, since it assumes that signals are steady-state when, in reality, physiological signals are often transient in nature. Recent imaging PPG studies have increasingly revealed that a combination of both time and frequency domain information can provide more reliable physiological assessments,5,7,9 especially under conditions of exercise or recovery from exercise, when the normal homeostatic control mechanisms are temporarily overridden. Therefore, a joint time-frequency analysis [i.e., time frequency representation (TFR)] has been performed in this study to analyze the time varying aspects of the signal’s frequency components following exercise. Based on our experience of iPPG signal processing,5 a smoothed pseudo-Wigner-Ville distribution (SPWVD) (for a review of this technique, see Refs. 14 and 15) was chosen for estimation of the TFR for the observed PPG signals:
Differences between the heart rate and blood pressure measurements obtained from the digital blood pressure meter under different conditions were assessed with one-way analysis of variance (ANOVA, ) to show the influence of exercise on blood pressure. The group differences were assessed by post hoc analysis using Fisher’s least significant difference (LSD), where the groups represent the stages of recording, i.e., rest, Ex1, Ex2, and recovery. Two-way ANOVA () was performed to assess differences between the two imaging PPG systems and cPPG under the testing conditions. To further test the performance of both imaging PPG systems, Bland-Altman16 and Pearson’s correlation analyses were performed to compare iPPG with cPPG and wPPG with cPPG. In addition, the Pearson’s correlation coefficients and the corresponding -values were calculated to estimate the relationship between the imaging PPG signals (wPPG) and the ambient light intensity for short-term recordings (). All analyses were performed with (Type I error) set at 0.05 using the statistical software program SPSS for Windows, version 17.0 (IBM, Armonk, New York).
In the present study, a total of four sets of measurements were taken from each participant (Fig. 3). Table 2 summarizes the results of the measured variables: heart rate (HR), systolic blood pressure (SBP), and diastolic blood pressure (DBP). To statistically analyze the influence of exercise on the cardiovascular system, separate ANOVAs with post hoc tests were conducted on the obtained variables, as explained in the methods section. Significant effects of exercise were seen on HR and SBP (, ; , ). Additionally, post hoc tests revealed that the HR and SBP after both exercise periods were significantly higher than those during the initial resting condition (ex1 versus rest, , ex2 versus rest, ). A significant difference between exercise levels was also detected in HR and SBP, while all variables returned to resting levels after the final 10-min resting period, i.e., no statistical differences were uncovered between recovery and initial resting conditions. Under all conditions, the DBP did not change significantly.
Effects of exercise on blood pressure and heart rate (values are mean±S.D.).
|Rest||Exercise 1||Exercise 2||Recovery|
Main effect (p<0.001) of exercise has been identified in HR and SBP.
Significant statistical difference by post hoc comparison with rest condition are indicated for p<0.05.
Post hoc test between first and second exercise periods (Ex2 versus Ex1), p<0.05.
Heart Rate Measurement by Imaging PPG
Figure 2 is an example image obtained from Fig. 2(a) CMOS camera and Fig. 2(d) webcam from a single subject (Sub #1, ) under resting condition. Additionally, three images are presented of the red, green, and blue channels for both cameras [Figs. 2(b) and 2(e)]. Separate plethysmographic waveforms obtained from each of these three channels are shown for Fig. 2(c) the CMOS camera and Fig. 2(f) the webcam. Physiological pulsations are more apparent in the green channel from the webcam, while the CMOS camera shows comparable PPG signals for all three channels. It has been reported that the green component of the plethysmographic signal is stronger than that of the red and blue channels.6,7 Therefore, in what follows, only the green channel PPG signals were further processed for HR detection. To further characterize the cardiac pulse, TFR traces (Fig. 4) derived from the plethysmographic waveforms from each type of measurement (Fig. 4) were used to obtain values of and . These values were calculated by averaging the traces for HR from each 30-s period where recordings were taken from both imaging devices simultaneously. The HR values showed close agreement between three measurements and were consistent with the physiological results obtained from the digital blood pressure meter. Two-way ANOVA was then applied to the HR values derived from the TFR in order to compare the performance of these two techniques and the (gold standard) contact measurements. ANOVA performed on the parameter HR shows significant difference for the exercise state factor (, ), while the measurement system and factors had no significant association with HR (, ; , ). Post hoc tests performed on the exercise state reveal a positive trend during increasing exercise and a negative trend toward recovery, as mentioned above in the physiological measurement section (Rest versus Ex1: ; Rest versus Ex2: ; Ex1 versus Ex2: ; and Rest versus Recovery: ), while there were no significant associations of HR with the measurement system factor (i.e., HR values did not depend on which measurement method was used).
To further evaluate the performance of both imaging PPG systems, Bland-Altman analysis was employed to assess the agreement of HR between each imaging method and contact readings. The results are shown in Fig. 5. In no case did the mean difference between the two methods differ significantly from zero. Specifically, the mean bias between cPPG and iPPG was with 95% limits of agreement to in the resting state, while the mean biases for Ex1, Ex2, and recovery states are 0.27, 0.63, and 0.47 bpm, respectively. The corresponding 95% limits of agreement are from to 2.26 bpm, to 3.49 bpm, and to 4.3 bpm. Furthermore, there was a significant correlation of HR obtained from cPPG and iPPG under all resting and exercise conditions (, ) (Plots not shown). The heart rates obtained from the webcam showed a similar pattern. The mean bias between cPPG and wPPG for the four conditions were , , 0.55, and 0.16 bpm with the corresponding 95% confidence intervals: to 4.12, to 1.73, to 3.93, and to 3.73 bpm. Significant correlations between cPPG and wPPG were also found (, for all states).
The Influence of Ambient Light Intensity
Figure 6 shows the overall spectral characteristics of the ambient light encountered for all spectrometer measurements in this study, where six out of the 40 recorded segments of data were discarded due to partial saturation of the spectrometer. The highest intensities were seen in the red part of the spectrum. Figure 7 shows an example of a 120-s recording of the wPPG signal together with the average light intensity for Fig. 7(a) green (525 to 575 nm) and Fig. 7(b) red channels (620 to 750 nm). It can be seen that the ambient light intensity changed markedly even within the recording period. As expected, the mean level of the raw PPG signals from both channels (red and green) varied in concert with the ambient light intensity. Although the light intensity of the red channel was higher than that of the green channel, a more pronounced plethysmographic waveform was seen in the green channel [Fig. 7(a)]. To further analyze the relationship between the wPPG signals and ambient light intensity, the correlation coefficients between the ambient light intensity and the & components of the raw wPPG signals were calculated. Moreover, to eliminate the influence of the exercise dependent amplitude change, the analysis was conducted only under resting conditions. Here, the components of the wPPG signals were accessed via low pass filtering (), while the components were calculated via derivation of peak-to-peak amplitudes from the envelope of the PPG signals based upon the bandpass filter in the range of 0.5 to 4 Hz and normalized with respect to the corresponding components. The correlation analysis reveals different dependence of and components on the ambient light intensity. Specifically, significant positive correlations between the components and ambient light intensity have been identified in all subjects in both the red (, ) and green (, ) channels, whereas these correlations were absent in the normalized components of both channels (red and green).
The relationships between HR and time under resting and exercise conditions are shown in Fig. 8. Following various conditions, the characteristics and trend of the HR are dynamic and consistent with the physiological results obtained from the digital blood pressure meter. Specifically, when compared to the resting condition (), the HR increases in both Ex1 and Ex2 states. The HR peaks at immediately after the Ex1 condition and returns to the resting value within 40 s. The higher-intensity exercise (Ex2) resulted in a higher HR and a pronounced recuperation, e.g., the HR reaches after the subject finished the exercise and decreases markedly to over the subsequent 100 s, after which it is maintained for the remaining 80 s of the monitoring period. Ten minutes after Ex2, the subject appeared to have fully recuperated, as HR had returned to its resting level (not shown). The results of the other subjects followed a similar pattern to those of subject #1, the exemplar.
This study compares the quality of the physiological information that is available from a high-performance CMOS camera and a low-cost webcam using ambient light, where the influence of the ambient light intensity on the obtained plethysmographic signals has also been investigated. The webcam and high-performance camera-derived plethysmographic signals have been evaluated by comparing them to those from a commercial pulse oximeter sensor. The agreement between the results from these three methods (CMOS, webcam, and contact) indicates that both imaging PPG systems can successfully measure important physiological variables, i.e., heart rate. The influence of ambient light intensity on the raw PPG signals has revealed a significant positive correlation between the light intensity and the components obtained from iPPG, while such a correlation is absent for the components. This suggests that, under variable external weather conditions, information contained in the component of the PPG signal, such as heart rate, is not corrupted by changes in ambient light intensity.
Since its conception decades ago, various imaging PPG systems have been proposed and validated for remote physiological assessments. Based upon their imaging devices, these systems can be divided into two categories: high-resolution camera-based or low-cost webcam-based. In the present imaging PPG setup, both systems have been tested and validated for noncontact physiological assessments (e.g., HR) under various exercise conditions in order to evaluate their feasibility and, more importantly, to compare their sensitivity. The PPG signals derived from both cameras have been compared with the recordings of a cPPG sensor. No statistical differences between the different monitoring techniques were found. Bland-Altman analysis showed that the heart rates derived from both imaging systems were comparable to the values obtained with the commercial contact sensor, the maximum HR difference being for both cameras under resting and exercise conditions. All three techniques revealed the expected association between exercise and increased heart rate, which echoes the changes in blood pressure and agrees well with previous studies.5,17,18 Thus in all respects, the results from both cameras were comparable to those of the reference contact probe. From the clinical point of view, the word “comparable” means that measurements by different instruments/techniques should be sufficiently close so as not to change the actions and decisions regarding the patient.10 For instance, in the Emergency Severity Index triage, an adult patient with a heart rate over 100 bpm is considered to be tachycardic.19 In this scenario, a difference of <5 bpm (<5% error) obtained from both imaging PPG systems could be acceptable, especially given that the measurements can be performed remotely using ambient light and without the need for specialized illuminators.
Due to the historical emphasis of PPG on pulse oximetry and the need to sample relatively deep microvascular tissue beds, the pioneering imaging PPG systems were always coupled with dedicated light sources, typically in the red to near-infrared wavelength range.89.–10 Recently, a substantial body of work has accumulated regarding the applicability of ambient light in remote plethysmographic imaging,6,7 and its effectiveness in the context of physiological assessments has been shown. For instance, Verkruysse et al. have demonstrated that heart and respiration rates may be remotely obtained using a simple digital camera and ambient light,7 and Poh et al. have reported a methodology combining of automatic facial recognition and blind source separation for reliable cardiac pulse measurement using a webcam.6 Though these devices have successfully obtained useful physiological information, the relationship between the ambient light intensity and the obtained plethysmographic signals is far from well understood. In the present study, continuous measurements of ambient light intensity have been synchronized with the recorded images, providing essential information for investigating such a relationship.
The spectrometric data presented in Fig. 6 show the overall spectral characteristics of the ambient light encountered in all recording sessions, where a positive skewness and even dispersion are consistent across the captured wavelength range. The skewness reflects an exponential decay of ambient light intensity in the presence of decreased visibility due to clouds. The standard deviations of the intensities are proportional to the mean intensities, exhibiting a positive linear relationship when normalized with respect to these. The latter linear characteristic is most likely to reflect the increase in optical absorption of water with respect to wavelength in the visible range.20 The average intensity of the red (625 to 675 nm) band was found to be around 1.4 times larger than that of the green (525 to 575 nm) band, and the average values of the red band show a 2% variability with respect to wavelength, in contrast to a 13% variability in the green band. The ambient light intensity of both the red and green bands and the obtained components of the corresponding plethysmographic signals can be seen to significantly and positively correlate. However, we observed no correlation between the ambient light intensity and the amplitude of the normalized components, e.g., Fig. 7 illustrates the pronounced and clear signals uncovered in the green channel, while the ambient light intensity is relatively higher in the red channel. The high amplitude of signals in the green channel is expected, as the maximum absorbance of hemoglobin in the visible part of the spectrum is in the range of 510 to 590 nm. This finding also agrees well with previous imaging PPG studies.6,7
The ideal amount of exercise needed to maintain fitness and reduce mortality from cardiovascular disease remains a matter of debate.2184.108.40.206.–26 For example, Lee et al. showed that moderate-intensity exercise training was sufficient to generate substantial benefits,23 and similar results have been reported elsewhere,24,26 while Williams argued that high-intensity training produced proportionally greater effects,22 which agrees well with a 20-year study regarding the reduction of premature mortality by high physical activity.25 Therefore, to help clinicians and researchers to evaluate and optimize the effects of exercise, it is clear that there is a need for a simple remote, reliable, and low-cost technique, ideally one that does not require a dedicated illumination source. To this end, the performance of our webcam-based imaging PPG system has been further validated by assessing its ability to measure heart rate reliably under various conditions. As can be seen in Fig. 8, a clear recuperation can be seen in the signals obtained by the webcam using ambient light, supporting its applicability in sports training and, more generally, in the evaluation of the physiological and pathological response to exercise.
PPG is susceptible to motion-induced signal corruption, making the attenuation of motion artifacts one of the most challenging issues in all PPG signal processing.6 This paper verifies the performance of both imaging PPG systems (CMOS & webcam) for remote physiological assessment and investigates the relationship between the ambient light intensity and the obtained plethysmographic signals. A simple spatial averaging approach was used to attenuate the minor motion artifacts in the present study. Nevertheless, the use of sophisticated and more effective motion artifact compensation methodologies is encouraged, and more generalized imaging registration27,28 and blind source separation5,6 methods should be used in the future. The scope of this study is limited to the effects of exercise on measurements of heart rate. Therefore, consideration of respiration rate and blood oxygen saturation is the subject of a future study. Another improvement is to investigate the correlation between the plethysmographic signals derived from a CMOS camera and the ambient light intensity. In this study, the impact of the ambient light intensity on the iPPG signals was not addressed due to the short duration of the measurement period. A further study with an extended monitoring duration and a wider wavelength range (450 to 1000 nm) will be considered to further describe and understand the performance of CMOS camera-based imaging PPG system under different ambient light conditions.
The emerging field of imaging PPG technologies has provided some of the first quantitative insights into effective and comprehensive interpretation of remote physiological assessments. In this study, we have shown that a high-sensitivity CMOS camera and low-cost webcam exhibited comparable capabilities in measuring heart rate and the effect of exercise on this variable. Moreover, the results revealed an independent relationship between the ambient light intensity and the amplitude of normalized plethysmographic signals. Nevertheless, variations in ambient light intensity did not affect the ability of both camera systems to track remotely and accurately heart rate at rest and changes in heart associated with exercise. The results of this study thereby provide further support for the applicability of webcam-based imaging PPG systems in the remote assessment of physiological parameters such as heart and respiration rate, indicating a promising alternative to conventional cPPG with clear applications in triage and home-based monitoring systems.
This work was supported by the National Institute for Health Research under Grant No. PD1: II–FS–0109–11005. The authors are grateful to The Research School of Systems Engineering, Loughborough University and Shanghai Jiao Tong University for their support.