Photoplethysmogram Analysis and Applications: An Integrative Review

1Photoplethysmography (PPG) is a non-invasive method for measuring blood volume changes in a microvascular bed of the skin based on optical properties, such as absorption, scattering, and transmission properties of human body composition under a specific light wavelength. PPG is a compound word that consists of “photo,” meaning light; “plethysmo,” meaning volume; and “graphy,” meaning recording. In 1937, Hertzman found that the amount of light detected by back scattering after irradiating light to the skin was significantly changed according to cardiac activity. He suggested that PPG was a technique for measuring blood volume changes in a specific area irradiated with light. PPG records the amount of light transmitted or reflected by the change in concentration of substances in the blood and the optical path according to pulsation, which can be explained by the Beer–Lambert law that defines the attenuation of light intensity by the extinction coefficient, concentration, and optical path length of a medium when light passes through it. The Beer–Lambert law, as shown inI = I0e−εlc, defines that the transmitted light intensity (I) through a medium will decrease exponentially in irradiated light intensity (I0) in relation to the absorption coefficient (ε), optical path length (l), and concentration of the medium (c). The exponent part of the Beer–Lambert law is defined as absorbance (A), which can be expressed as A = −εlc. The Beer–Lambert law is used in various PPG applications that include calculating oxygen saturation and developing multi-layer light–skin interaction models. A recent study, based on modified Beer–Lambert law, measured PPG depending on skin depth by applying different extinction coefficients according to characteristics of the microvascular bed of the skin. Figure 1 shows skin structure, optical path, and light intensity change represented by the Beer–Lambert law in photoplethysmogram measurement. Light irradiated into the skin will pass through skin structures, such as tissues, veins, and arteries; then, finally it is detected by a photodetector. The amount of light absorbed or scattered during this process may vary depending on the composition of the skin structure. In Figure 1, the total absorbance throughout skin layers is equal to the total sum of the absorbances of the k layers (Ak = −εkcklk), where ε, c, and l are the extinction coefficient, concentration, and optical path length, respectively, and the amount of light that is finally transmitted can be expressed as I = I0e∑Ak. In this case, the total absorbance depends on the skin structure.

2Unlike transmissive-mode PPG that has a straight optical pathway, reflective-mode PPG requires a more complex physical model, because the optical path between the emitter and the photodetector is curved and has a nonlinear pathway. Rubynok and Kyriacou assumed that the optical path between the emitter and the photodetector has multiple “canoe” shapes and modeled the absorbance of the Beer–Lambert law Apiλ as through the banana-shaped mean light pathway representing each “canoe” shape, where, IDpiλ and IEpiλ are the radiation and detection light intensity, respectively, in the banana-shaped light pathway, μλ is the absorption coefficient for the whole optical pathway in the scattering sample, lpiλ is the mean optical pathway corresponding to the pi fraction of the transmitted light power in the vascular tissue, m is the matter segments along the mean light pathway with different absorption coefficients, μsjλ is the total absorption coefficient tilde within the scattering matter segment sj, and lpisjλ is a part of the mean light pathway within the scattering matter segment sj. The total absorption coefficient μsjλ can be further extended by absorptivities and concentrations of the absorbing components present in the light pathway segment sj:, where nsj is the number of light-absorbing components in the j, εkλis the Beer–Lambert law absorptivity of the absorbing component k at wavelength λ, and cksj is the concentration of the light absorbing component k in the light pathway segment j. In addition, the extinction coefficient of the reflective mode can be modeled as ΔA = log⁡(ΔI0/ΔI) = εΔcl⋅DPF through the differential path length factor (DPF) based on the Modified Beer–Lambert Law (MBLL), where and μa(λ) and are the absorption coefficient and reduced scattering coefficient, respectively.

3The volume of blood volume in the measurement site, arterial diameter, hemoglobin concentration, and hemoglobin direction according to the cardiac cycle are also major factors that affect the detected light intensity. For example, during the diastolic phase, blood volume, arterial diameter, and hemoglobin concentration in the measurement site are minimized. Thus, absorbance is minimized, while the amount of light detected by the photodetector is maximized. Conversely, in the systolic phase, the light intensity detected by the photodetector becomes minimum.

4Photoplethysmography (PPG) can be measured using light sources of various wavelengths. In general, when the wavelength of light increases, the depth of penetration also increases. For example, it is known that wavelengths of 470, 570, and 660 nm or more can reach the epidermis with capillaries, dermis with arterioles, and arteries of subcutaneous tissues, respectively. Major blood vessels and arteries with strong pulsation are mainly located in the skin dermis or subcutaneous tissue. Thus, light with a red wavelength of 640–660 nm and infrared wavelength of 880–940 nm is mainly used for PPG measurement. PPG is mainly obtained at the extremities of the human body, such as fingers, toes, and earlobes that are advantageous for measuring changes in blood volume, because the vascular bed is shallow and widely spread. PPG can also be obtained from the forehead, esophagus, and nose.

5A PPG device is composed of a light-emitting diode (LED) that emits light, and a photodetector that detects the emitted light. The device can be divided into transmissive type and reflective type according to the position of the LED and photodetector. Figure 2 shows configurations for a photoplethysmogram measurement device. For the transmissive type, the photodetector is located on the opposite side of the LED, with skin tissues in between. For the reflective type, the photodetector is located next to the LED. Since the transmissive type measures attenuated light intensity after the light passes through skin tissues, it is mainly used for measuring PPG in the distal part of the body, where skin tissues, such as those of fingers, toes, and earlobes, are thin. The transmission-type PPG sensor shows more stable PPG measurement performance than the reflective type. On the other hand, since the reflective type measures scattered light intensity after light irradiates the skin tissue, the measured light intensity is relatively smaller than that of the transmissive type, and the quality of the signal may be degraded. However, it has the advantage of being able to measure PPG not only in the distal part of the body but also in parts of the body, such as the forehead, wrist, carotid artery, and esophagus, where light transmission is difficult. The PPG measurement system has the basic hardware structure of an LED to irradiate light, and a photo detector to measure the amount of transmitted light; in addition, it includes an emitter driver to drive the LED, a filter to remove noise and enhance the quality of the obtained signal, an analog-to-digital converter, and a microprocessor. Due to its low cost and a simple hardware structure characteristic, PPG has been used in various applications.

6In a clinical environment, PPG is typically used for measuring blood oxygen saturation (pulse oximetry), peripheral vascular tone, and changes in peripheral blood flow according to the respiratory cycle. Blood oxygen saturation is calculated as the ratio of the concentration of oxyhemoglobin to total hemoglobin in the blood. Traditionally, both infrared wavelength (∼880 nm) and red wavelength (∼660 nm) are used for measuring oxygen saturation, because deoxyhemoglobin absorbs more red wavelength, while oxygenated hemoglobin absorbs more infrared wavelength.

7Perfusion index measured with PPG is defined as the ratio of pulsatile component to non-pulsatile component of PPG. It indicates the contraction of peripheral vascular smooth muscle. It is used for peripheral vascular tone evaluation related to hypertension and coronary artery diseases. The Pleth variability index indicates the fluctuation of perfusion index, which is known to have an inverse relationship with blood flow in blood vessels. Changes in blood flow in peripheral blood vessels according to the respiratory cycle can be measured to monitor patients with respiratory distress or heart failure; this technique is also used to evaluate the intrathoracic pressure–cardiac function correlation. PPG is also used in arterial blood pressure estimation, heart function evaluation, and pain assessment studies. Using PPG, arterial blood pressure can be estimated by hemodynamic modeling. It can also be estimated using a linear or nonlinear regression model based on pulse transit time (PTT) derived by PPG. In pain assessment research using PPG, the surgical Pleth index (SPI; GE Healthcare, Chicago, IL, United States) has been calculated through the amplitude and heart beat interval of PPG for intraoperative pain evaluation. Another study has shown that the amplitude variation, area, triangulated area, width, ascending slope, and descending slope of PPG are significantly correlated with pain. PPG measured with a mobile device can be used to evaluate the exercise state, sleep state, and stress index of a user through various approaches based on pulse rate and respiratory rate analysis or waveform analysis. Compared with other hemodynamic analysis devices, PPG is an inexpensive and noninvasive technique with higher mobility. It is also an easy technique for attaching electrodes and measuring signals. Thus, its use in the clinical and mobile fields is increasing. However, PPG is easily affected by various external factors, such as the body temperature of the measurement site, intensity of ambient light in the experimental space, and individual differences, such as skin type; therefore, additional research on advanced signal processing techniques is needed to obtain a robust PPG waveform.

8The purpose of this study was to examine PPG from an engineering viewpoint through the previous research and literature, and review the current status and vision of PPG, including its measurement principle and mechanism, waveform characteristics, representative noise, pre-processing technology, feature extraction technology, and post-processing technology. Reviewing the results of the research performed to date on the above contents is expected to contribute to the application of PPG, which, with the recent growth of mobile healthcare for daily health care or clinical environment, is increasingly being utilized.

9A review of the literature was conducted using the following five databases: PubMed, Institute of Electrical and Electronics Engineers (IEEE), Google Scholar, ScienceDirect, and Web of Science. Search terms photoplethysmogram, review, motion artifacts (MA), preprocessing, signal processing, noise reduction, derivative, feature, feature detection, peak, peak detection, noise, waveform, signal quality, and perfusion were combined.

10To be eligible for inclusion in this review, the primary requirement was that an article needed to focus on signal characteristics, waveform analysis, noise reduction, peak detection, waveform reconstruction, or quality assessment of PPG. If possible, the literature review was focused on recently published articles or articles with a high number of citations, but reports were not excluded because of their year of publication. However, review articles and original articles not published in English were excluded.

11The searched articles were reviewed, and detailed subcategories were organized according to the characteristics and processing procedures of PPG. In this process, the authors selected appropriate articles focusing on subcategories, and detailed technological items were listed through in-depth review. In discussion, all the authors presented the details and trends of subcategories and drew conclusions based on common trends.

12Figure 3 shows that PPG waveform is obtained from the amount of light absorption by inverting the light intensity recorded with a photodetector after the light is transmitted through or reflected from human tissue. In general, the PPG waveform is divided into a pulsatile component and a non-pulsatile component. The pulsatile component, known as the alternating current (AC) component, is related to changes in blood volume in the artery. It is synchronized with the cardiac cycle and is related to vasodilation, vasomotor, and vascular tones. It can be used to detect ventricular tachycardia and ventricular fibrillation. The non-pulsatile component, known as the direct current (DC) component, refers to the remaining components excluding the pulsatile component of the PPG waveform. Non-pulsatile components are affected by biological characteristics, such as tissue composition and basic blood volume of the measurement site, as well as external factors, such as ambient light and measurement device specifications. It has been reported that respiration, vasomotor activity, Traube–Hering–Mayer wave, and thermoregulation can also affect the non-pulsatile component. The amplitude of the PPG waveform has an arbitrary unit, because the physical characteristics, such as oxygen-carrying capacity, bone size, skin color, blood vessel distribution, cardiac output, vascular stiffness, and vascular compliance, differ from person to person. Its measurement depends on experimental environment, such as ambient light.

13The PPG waveform changes according to cardiac activity. It may also change because of respiration, autonomic nervous system activity, arterial activity, and venous activity. The PPG waveform includes cardiac activity and lung activity by frequency analysis. Shin and Min reported that most of the energy of the waveform is contained up to the 3rd harmonics. The PPG waveform has a rising curve according to increase in capillary blood volume by cardiac contraction, and a descending curve according to decrease in capillary blood volume by cardiac dilation. It is repeated according to cardiac activity. At that time, rising curve is defined as the systolic phase of the PPG waveform, while descending curve is defined as the diastolic phase of the PPG waveform. Figure 3 shows the PPG waveform of one pulsation and various feature points. Pulse onset is defined as the point where pulsation begins at the point where blood volume is lowest before the systolic phase. Systolic peak is defined at the point where blood volume is maximized. Transient rising and falling of the PPG waveform during diastole occur when blood volume in capillaries temporarily increases again because of the occurrence of a pressure gradient in the opposite direction to the blood flow, just before the aortic valve closes. At this time, recessed point is defined as a dicrotic notch, and the point at which the first derivative of the waveform is closest to zero after the systolic peak is defined as a diastolic peak. PPG waveform can change because of body composition, physiological status, and external stimuli. A previous study reported that it is difficult to use the absolute value of PPG amplitude for comparison, because it can change according to the characteristics of body tissues and individual characteristics, such as race, skin color, fingernail color, and finger size. Moreover, PPG baseline is affected by respiration, vascular compliance, vascular tone, pain, and drug use. The amplitude of the systolic peak, a representative characteristic of the PPG waveform, has been reported to have a significant correlation with microvascular expansion, and is in proportion to the cardiac output. In addition, results from studies related to anesthesia, sympathetic activation, and use of vasoconstrictors related to autonomic nervous system activity have confirmed that when the peripheral vasculature is dilated, the amplitude of the systolic peak is increased, while when vasculature is constricted, it is decreased. Dicotic notch changes with vascular tone and vascular compliance. It has been found that the location of notch occurrence is advanced at a high vascular tone. In addition, it has been reported that the time difference between diastolic peak and systole peak decreases with aging.

14Figure 4 shows the basic features obtained directly from the PPG waveform. Such PPG features are frequently used clinically (see Table 1). Systolic amplitude refers to the maximum amplitude of the PPG systolic phase. This is a feature related to the pulsatile component of blood volume. Systolic amplitude is highly correlated to stroke volume. It is directly proportional to the vasodilatation of the local body site where PPG is measured. A pulse width related index, PW50, refers to the pulse width between points corresponding to 50% of the PPG systolic peak amplitude, and shows a high correlation with systemic vascular resistance. Regarding pulse area, this is a feature that is calculated as the total area of the PPG waveform; it changes according to surgical skin incision. Inflection point area ratio is calculated as the area ratio between the systolic and diastolic sections based on the dicrotic notch, and is correlated with total peripheral resistance. Pulse-to-pulse interval is obtained from the time interval between the characteristic points of two adjacent pulses of PPG. Pulse onset, systolic peak, and maximum value of derivative PPG are mainly used to measure pulse-to-pulse intervals. Pulse-to-pulse interval refers to one cycle of cardiac activity. By calculating the pulse width ratio at different systolic amplitudes, the characteristic of an individual’s cardiovascular system by exercise could be determined. Pulse rate variability obtained through the pulse-to-pulse interval of PPG shows high correlation with the traditional heart rate variability obtained through electrocardiogram, and has been introduced as a surrogate method for measuring electrocardiogram-based heart rate variability under resting conditions. However, it was reported that PRV could be differ from HRV under dynamic conditions, such as exercise or mental stress conditions.

15Features that combine several characteristic points of PPG include perfusion index, large artery stiffness index, PPG augmentation index, and PTT. Perfusion index is calculated as the ratio of the pulsatile component to the non-pulsatile component of the PPG. It is used as an index to evaluate peripheral perfusion. Aortic stiffness index is calculated by dividing the height of a subject by the time interval of the maximum amplitude of the systolic and diastolic peaks. It represents the stiffness of an artery). PPG augmentation index is used as a feature for the stiffness of arterial vessels; it is calculated as the ratio of the amplitude of the systolic peak to the amplitude of the diastolic peak or by dividing the difference between the amplitude of the systolic and diastolic peaks by the amplitude of the systolic peak. PTT is obtained through the time difference between specific feature points of PPGs measured in two different body sites. It is used as a feature to estimate blood pressure. Table 1 describes the common features.

16Since the 1970s, studies have shown that the differential waveform of PPG has physiological significance. After showed a correlation between the second derivative PPG and aging, PPG derivative studies began to receive full-scale attention. Figure 5 shows a PPG waveform, derivative PPG, and second derivative PPG. Derivative and second derivative PPGs are advantageous for representing spatiotemporal variations of PPG with respect to peak position, inflection point, number of peaks, ascending slope, and descending slope. They can be used as an alternative method to detect dicrotic and diastolic peaks that are difficult to detect in original PPG waveforms. The first-order derivative waveform of PPG is also called velocity plethysmography (VPG). The first derivative waveform of PPG can be used to extract crest time, the time taken to contract from the pulse onset of the original signal to the systolic peak, or time interval ΔT from the systolic peak to the diastolic peak. Crest time can be defined as the time taken from the start point of the VPG waveform to the following zero-crossing. and proposed that crest time could be longer in patients with vascular disease or hypertension than in a normal group. reported that among the features extracted from the first derivative PPG, ΔT, defined as the time difference between the first and second zero-crossing points proceeding in the positive to negative value in the VPG waveform and crest time shows high accuracy for predicting cardiovascular disease. They showed that ΔT is related to the time it takes for blood ejected from the heart to pass to peripheral blood vessels, and that it can classify cardiovascular diseases with an accuracy of 87.5% using a support vector machine. The second-order derivative PPG waveform is also called the second derivative of phothoplethysmogram (SDPTG), second derivative of the digital volume pulse (SDDVP), and acceleration plethysmogram (APG). defined the peaks and valleys of the second-order differentiated PPG waveform as a, b, c, d, and e, as shown in Figure 5. They showed that combined indices, such as b/a, c/a, d/a, and e/a, had a significant correlation with aging.

17In addition, studies for predicting various parameters or diagnosing diseases have been conducted using PPG. In addition to basic heart rate estimation, PPG is used for blood pressure estimation, vascular aging assessment, arterial fibrillation prediction, diabetes prediction, peripheral vascular disease assessment, surgical and postoperative pain assessment, heterogeneous bio-signal (e.g., ECG) reconstruction, hemodynamic parameter estimation such as cardiac output or stroke volume, sleep monitoring including apnea and hypopnea detection, and emotional recognition.

18The results of our literature research related to PPG noise reduction are summarized. Representative noises that affect PPG analysis results include MAs related to body movement and sensor attachment, baseline change due to respiration and body movement, and hypoperfusion due to decreased peripheral perfusion. Figure 6 describes these representative photoplethysmogram distortions. Each noise is described in the following subsections.

19Motion artifact, which is mainly caused by body motions, such as hand movement, walking, and running, is a critical noise when measuring PPG. Depending on probe type and light source, PPG measurement may be more sensitive to MA; it has been reported that red and green wavelengths are more robust to MA. In addition, depending on measuring sites, it was shown that MA in ear PPG is less than in finger or forehead PPG. Since MA is known to have a frequency range of 0.01–10 Hz, the major component of PPG can be distorted by overlapping with the main frequency band (0.5– 5 Hz) of PPG. Such distortion makes it difficult to detect important features during analysis, and that causes false diagnosis. Therefore, an MA must be removed or corrected prior to analysis. In MA removal using a frequency domain filter, a high-pass filter is mainly used. Joseph et al. reported that a high-pass filter with a cut-off frequency of 0.15 Hz does not change pulse shape, while maintaining an ideal ratio of the pulsatile and non-pulsatile components of PPG. In addition, a study by Allen and Murray comparing the performance of a total of 90 filters by combining 9 filter types and 10 filter orders found the fourth-order Chebyshev type II filter to have the best performance in improving PPG signal quality. However, since the frequency domain filter alone has limitations in removing MA according to various motion intensities and motion types, studies on removal of MAs are being conducted using algorithms based on filters, accelerometers, and multiple wavelengths. The MA reduction method by independent component analysis (ICA) is a method of removing only the MA component by extracting independent components corresponding to PPG and MA from PPG containing MAs, assuming that PPG and MA are random vectors. qualitatively confirmed that the PPG and MA components can be separated by ICA. proposed a method to reduce MA by applying ICA to the multi-channel PPG obtained with a multi-wavelength light source. In their study, the MA included in PPG during walking, fast walking, and running was reduced by ICA. PPG peak was then detected. The position of the detected PPG peak was 99, 96.2, and 82.0%, consistent with the QRS position of the ECG in walking, fast walking, and running, respectively. In MA removal using adaptive noise cancelation (ANC), the accelerometer and PPG are measured simultaneously. The damaged part of the PPG is found and removed by the motion detected by the accelerometer. used ANC to remove the MA generated from light motion, while used ANC to remove the MA generated from walking and running. In addition, proposed a method of removing MA by simultaneously measuring PPG and acceleration, and applying a two-dimensional active noise cancelation algorithm. This algorithm can reduce the signal distortion rate from 52.3 to 3.53 at a frequency of 1–2.5 Hz using the 4th-order normalized least mean square (NLMS) adaptive filter. proposed that adaptive filtering based on the Kalman filter may be effectively used for MA reduction. A study by reduced the normalized root mean squared error by 35 dB after eliminating MA components in a frequency domain by cycle-by-cycle Fourier series analysis for each pulse in PPG. showed that MA for vertical finger movement and rotational movement could be removed through stationary wavelet transform. The error with HR and HRV obtained from ECG can be reduced.

20The baseline of the pulsatile component of PPG and AC amplitude of PPG can be changed by various factors, such as respiration, sympathetic nervous system activities, and thermoregulation. The change in PPG baseline interferes with the analysis of the AC component of PPG. Therefore, to accurately analyze the AC component of PPG, proposed a method of directly removing the change in baseline and a method of removing the change in baseline by subtraction from the measured signal based on estimation of the change in baseline. reported that high-pass filtering (HPF) is frequently performed in the method of directly removing the baseline. The frequency component of the AC of PPG is a component related to pulsation. This is normally higher than 0.5 Hz (30 bpm) in a healthy person. However, the respiratory component that causes baseline change has a frequency range of 0.15–0.5 Hz. HPF is performed to remove baseline movement located in the low-frequency range without damaging the AC component, based on the frequency range difference of signals. HPF is simpler and more convenient to performed than the method of baseline removal based on direct estimation. However, when the frequency component of PPG AC is lower than the cut-off frequency band of HPF, this method may cause signal distortion. As a method of indirectly estimating and removing the baseline, interpolation methods, such as linear interpolation and cubic spline interpolation, can be used for baseline estimation. A method combining wavelet and least mean square (LMS) adaptive filter can also be used. The linear interpolation method can simply estimate the baseline with a low-order polynomial. However, linear interpolation has the disadvantage that it is not very precise and the interpolant is not differentiable. Cubic spline interpolation can compensate for this discontinuity of signal by estimating the change in baseline through a cubic polynomial. In baseline removal using the interpolation technique, baseline wander is removed by subtracting the estimated baseline from PPG. In the method of removing baseline variation by combining wavelet transformation and LMS adaptive filter, the baseline component extracted by wavelet transformation is applied to the LMS adaptive filter to remove the baseline component. Then, the PPG from which the baseline is removed is obtained through inverse wavelet transform. Considering that PPG has non-stationary characteristics, wavelet-based baseline estimation may be appropriate. However, since both wavelet and adaptive filtering must be performed, its computational complexity may be high compared to other methods. In addition, due to the transition band of the filter, such method is unsuitable for cases with short signals.

21Hypovolemia, hypothermia, vasoconstriction, and decreased cardiac output or mean arterial pressure may weaken changes of blood volume in blood vessels, called poor perfusion or low perfusion. Hypoperfusion becomes more pronounced toward the peripheries of the body. It affects the pulsatile component of PPG, thus weakening amplitude change. To improve the low perfusion waveform, Foo and Wilson applied a non-causal Wiener filter with a 0.1- to 15-Hz pass band; they showed that the heart rate error estimated from low-perfusion PPG could be reduced to less than 5.12%. proposed a method to improve low perfusion by simultaneously measuring PPG using a transmission-type and a reflection-type measuring device, and reconstructing the PPG using a summing amplifier. The reconstituted PPG showed higher sensitivity than single-mode PPG in PPG measurement in a low perfusion state that was forcibly generated using the cuff. Oxygen saturation measurement also showed lower failure rate than commercial products.

22In addition to the movement, respiration, and low perfusion of a subject, there are numerous factors that can distort the PPG waveform. Typical examples include ambient light, temperature of the measuring site, skin pigmentation in the measurement body site, alignment of light source and photodetector, method of attaching the sensor to the skin, contact pressure between the sensor and the skin, and posture of a subject. Ambient noise reduction is mainly attempted through hardware improvement. developed a PPG readout chip equipped with a technique that can remove the effect of ambient light through a charge redistribution method after cross-sampling PPG mixed with ambient light with complementary metal–oxide–semiconductor (CMOS) process. Cold site temperature causes vasoconstriction of the measurement site and reduces perfusion, thereby degrading the quality of the measured signal. Massage or warming is known to be effective for increasing blood flow or perfusion, and improvement of signal quality through this method has also been reported. It is known through several studies that the signal-to-noise ratio of PPG measured according to skin color or pigmentation shows a significant difference. suggested multi-wavelength measurement to be effective as a method to reduce deviation by skin type. In addition, reported that high-resolution PPG can be obtained for various skin types with green wavelength under resting conditions, and green or blue wavelength under exercise conditions. When measuring PPG, probe pressure causes change in PPG waveform and could affect analysis result. A method of adjusting the contact force by optimizing the housing design of the PPG probe or using a measuring platform with a built-in force regulator in the probe has been proposed as a method to improve non-uniform contact force.

23Table 2 summarizes the pre-processing techniques of PPG. Because of the simplicity of its waveform, PPG has a relatively simple pre-processing process. Our literature search found that most PPG pre-processing was dependent on frequency filtering to remove high-frequency or low-frequency noise. In frequency filtering, the lower bound of the passband in most studies is about 0.5 Hz to remove the DC component below 0.1 Hz and respiratory component in the 0.1–0.5 Hz band while obtaining only the AC component of PPG. The upper bound of the bandpass filter is usually determined considering that the main frequency components of PPG are included within the fourth harmonics in the frequency domain. The upper bound of the frequency filter at 10 Hz as the position of the fourth harmonics is often used when heart rate is 150 bpm (2.5 Hz). Thus, in the general case, the low pass filter that has a 10-Hz cutoff frequency can include most PPG frequencies. The Butterworth, Chebychev I, and finite impulse response (FIR) filters are mainly used for frequency filtering. PPG pre-processing is also performed by decomposing the waveform into several frequency components, removing noise for each component, and then recombining them. A representative of these methods is the method based on empirical mode decomposition (EMD) or wavelet decomposition. With the EMD-based method, the noise component is removed by excluding the intrinsic mode function (IMF) based on a specific frequency after obtaining the IMF of PPG and then recombining it. removed low-frequency noise and the trend of PPG by recombining only IMF with a dominant frequency > 0.5 Hz. Similarly, in a study using a wavelet transform, noise is removed by obtaining a sub-band signal through wavelet decomposition and combining specific sub-bands. showed that low-frequency and high-frequency noise of PPG can be effectively removed in the preprocessing step to detect the peak by recombining the sub-band signal after applying the stationary wavelet transform. used the discrete cosine transform to remove noise outside the 0.5- to 10-Hz band, and found that it can be used for PPG pre-processing with sparse frequency characteristics. showed that a high-order polynomial can be used to handle non-stationary dynamics. In addition to noise reduction, pre-processing is also performed for signal enhancement purposes. proposed an amplitude regularization technique using an envelope curve to reduce the fluctuation of PPG amplitude. used a moving differentiation filter to sharpen PPG upslope and eliminate high-frequency noise.

24Peak detection is essential for analyzing PPG. Detection methods based on zero-crossing, local maxima or minima (LCM), adaptive threshold, and machine learning have been proposed. Zero-crossing is a method that can find the point where the sign of the slope changes, in the same way as a quasi-periodic signal peak detection method. However, since the zero-crossing-based method is highly likely to erroneously detect peaks due to tiny fluctuations of signals, various filtering methods must be applied in the peak detection method based on zero-crossing to simplify the PPG waveform. To detect PPG peaks using the zero-crossing method, used a 0.5- to 10-Hz 4th order Butterworth filter and a moving difference filter for the detection of pulsating wave peaks, while segmented the PPG signal and divided it by the sign of each slope. In addition, a method for detecting peaks through zero-crossing after wavelet or Hilbert transform of the PPG signal has been reported. detected onsets and systolic peaks of a pulse wave with low complexity and low computation cost; however, their study was validated with only a small number of study subjects (N = 10) in a noise-free environment. decomposed the PPG component through wavelet decomposition and then detected systolic and onset peaks, without by knowledge rule-based post-processing. This approach showed over 99% of sensitivity and predictivity on the total number of 116,255 beats taken from three PPG databases; however, it has relatively high complexity from the use of wavelet decomposition. Also, it is hard to apply for real-time application because of being designed for a non-causal system. One of the most frequently used PPG peak detection methods is a method based on LCM detection. LCM is a method of finding the maximum or minimum value within a specific region based on a pre-defined threshold. In LCM peak detection, peaks are detected by repeated window sliding and peak detection. The detection threshold can have a fixed value or an adaptive value. determined the threshold at a certain ratio of the maximum PPG value. set the threshold based on pulse height and detected peaks by comparing the heights of candidate peaks within a 2-s window. The LCM method requires appropriate window size selection. It has the disadvantage that if there are large-scale baseline changes due to respiration or other various causes, accurate detection becomes difficult. proposed an adaptive threshold PPG peak detection method based on a dynamic threshold that tracks the signal amplitude and finds peaks at the maximum amplitude outside the refractory period. Adaptive threshold is known to overcome the shortcoming of the LCM method that is vulnerable to baseline noise, such as baseline fluctuations due to respiration, with better detection performance than the LCM method for detecting the peaks of PPG signals. proposed a method of estimating the local maxima by obtaining a scalogram of wavelet transformation and then rescaling it. In this method, the local maxima scalogram was first calculated and rescaled. Peaks were then detected by row-wise summation and column-wise standard deviation. The proposed method has high robustness against high-frequency and low-frequency noise, and has a potential to be used for detection of various signal peaks. Recently, there have been attempts to apply deep learning to PPG peak detection. proposed a PPG peak detection method based on a self-organized map. Although the PPG peak detection method using machine learning has not yet been confirmed to have stable performance, performance improvement is expected in the future through continuous development. The PPG peak detection methods mentioned above can detect peaks with high accuracy in PPG signals without noise. However, their PPG peak detection performance may be greatly degraded because of MAs, baseline wandering, and low perfusion. In addition, in the case of systolic peak, there is the possibility of erroneous detection due to interference of the dicrotic and diastolic peaks. Therefore, noise removal through proper signal pre-processing and restoration of distorted signals remains important for PPG utilization. Table 3 briefly summarizes the PPG peak detection techniques.

25Photoplethysmography (PPG) waveform reconstruction is mainly performed to restore the damage to PPG caused by noise, such as MAs. If distortion of PPG is not severe with preservation of the main components of the waveform, PPG can be decomposed into wavelet components through discrete wavelet transform, and noise can be removed for each component to restore PPG. In addition to the reconstruction method in the time–frequency domain using discrete wavelet transform, a method of reconstructing PPG using eigen-decomposition has also been proposed. In this method, after eigen-decomposition is performed to extract the eigen components of PPG, PPG is restored only with the main components from which the noise components are removed. When most of the waveform information is lost because of severe distortion of PPG, detecting the damaged part and estimating the waveform of the corresponding part to restore it using a machine learning technique, such as recurrent neural network, have been reported. In addition to restoring distorted parts, reconstruction of the PPG waveform can be performed to enhance the waveform. To equalize PPG amplitude fluctuations when severe fluctuations in the PPG baseline or amplitude occur, proposed a method of compensating the PPG amplitude using an amplitude compensation curve generated from the envelope of the PPG waveform. Figure 7 shows an example of PPG waveform reconstruction.

26Signal quality index (SQI) is generally used to evaluate signal quality, such as signal-to-noise ratio. It is applied before signal analysis to evaluate the usability of a signal (see Figure 8). Pulse quality index refers to the quality of pulses constituting the signal, and is used to evaluate the quality of the pulse waveform as part of the SQI. Waveform quality is the most important factor in deriving accurate analysis results. A signal of low quality increases the false alarm, as well as probability of occurrence of an analysis error, which can lead to clinical misdiagnosis. For example, if part of the waveform is lost when calculating heart rate, an error may occur in peak detection, resulting in change in heart rate.

27Such a case may also occur in a patient-monitoring device that monitors the physiological signals of a patient in real time. Patient monitoring alerts medical staff when vital signs, such as HR, deteriorate. As in the previous case, false alarms may occur because of deterioration of waveform quality caused by movement or sensor attachment condition, although the condition of a patient is normal. These false alarms cause noise stress to medical staff and can interfere with their accurate and immediate response. In addition, because of recent increase in the use of PPG in the field of mobile healthcare, there is an increasing demand to improve its usability in the mobile environment. However, PPG is very vulnerable to MAs. It may suffer from signal quality degradation due to various factors, such as low perfusion or ambient light. Therefore, it is very important to distinguish between analyzable and non-analyzable sections of the measured PPG signals. To improve the accuracy of analysis results, SQI evaluation of PPG is becoming more important, especially in the mobile environment.

28Table 4 summarizes previous studies on signal quality assessment. Among methods for evaluating SQI, the rule-based method can determine the availability of a signal by sequentially determining various parameter values, such as amplitude, beat interval, and feature value, describing the PPG waveform based on specific thresholds. evaluated signal quality using thresholds for amplitude, rise time, pulse-to-pulse interval, number of diastolic peaks, and waveforms of a pulsation. similarly proposed a method for evaluating SQI by applying a decision tree to amplitude, beat interval, waveform width, ensemble mean of all beats, and Euclidean distance; the quality of PPG was distinguished into three grades and was evaluated with an accuracy of 83 ± 11% and sensitivity of 89 ± 10% compared to the expert-labeled gold standard.

29evaluated the quality of PPG signal in two grades using heart rate, PPI interval and ratio, and template matching, resulting in sensitivity and specificity of more than 90%. Skewness and kurtosis are also frequently used features for signal quality evaluation. evaluated signal quality based on skewness and kurtosis. evaluated signal quality in two grades through kurtosis and Shannon entropy. classified PPG into three grades (excellent, acceptable, and unfit), and compared the performance of SQI evaluation indices, such as perfusion index, kurtosis, skewness, relative power, non-stationarity, zero-crossing, and entropy. Kurtosis and skewness are statistical measures for quantifying the characteristics of a normal distribution. Morphologically, “How sharp is the shape?” and “In which direction and by how much is the shape skewed?” can be quantified. From this morphological point of view, the kurtosis and skewness of the PPG pulse can comprehensively reflect the amplitude or position of the PPG shape, such as pulse width, systolic peak, diastolic peak, and dicrotic notch. In addition, since the kurtosis or skewness of the PPG pulse can be clearly distinguished from motion noise, this can be an effective means of distinguishing the PPG waveform from noise. On the other hand, kurtosis and skewness may be inefficient to detect the distortion caused by amplitude or pulse width in an abnormal range, because they are determined by relative shape, not by absolute value. The ratio of AC component to DC component of PPG is called perfusion index (PI), and it has been used in several studies to evaluate signal quality. PI is useful in detecting waveform degradation by low perfusion, because it is known to reflect vasomotor tone that may affect the pulsatile absorption component; moreover, it is a direct indicator of low perfusion by itself.

30proposed PQR as a method for evaluating signal quality through high-frequency noise effect (P), baseline effect (Q), and MA effect (R). In the PQR method, a PQI score called rSQI is calculated by adding each score of P, Q, and R, where P is the ratio before and after applying the low pass filter, Q is the ratio before and after applying the baseline removal filter, and R is calculated by the computation of extreme point dispersion. In a study that evaluates SQI based on a template, the template for a normal-quality waveform is generated and compared with the input waveform to evaluate the quality. proposed a method for evaluating waveform quality using HR, RR interval range, ratio of the maximum RR interval to the minimum RR interval, and result of adaptive template matching for ensemble average waveform of the whole pulsatile waveform. normalized the length between the template and each pulse signal by dynamic time warping when matching the template. In their study, the template was created by ensemble-averaging pulsation waves within the first 30 s. used a template created by applying dynamic time warping barycenter averaging to PPG measured for an hour in template-based signal quality evaluation. Unlike existing methods, this template generation method does not require an alignment process for ensemble averaging. Thus, it offers more robust performance. proposed a technique to evaluate signal quality in the range of 0–100 by calculating the cross correlation between successive beats and inputting a normalized cross-correlation coefficient to a nonlinear scaling function; this algorithm showed reasonable performance, but because it is based on exponential operation, it requires high computing power. In addition to the SQI evaluation method based on shape characteristics or templates of PPG or rule-based, studies on the SQI evaluation of PPG using machine learning have been actively conducted in recent years.

31evaluated PPG SQI using a five-layer fuzzy neural network. In their study, the quality of the signal was classified into three grades from the error of stroke volume measured with a commercial device. Stroke volume was calculated from PPG, and SQI evaluation performance was evaluated by inputting parameters extracted from PPG to the developed model. As a result, sensitivity of 0.81 and specificity 0.9 were shown for high-quality PPG, while sensitivity of 0.84 and specificity of 0.93 were shown for low-quality PPG. In another study by, PPG and derivative PPG were segmented for each beat and merged into a two-dimensional image to be used as input, and a machine learning model, a deep convolutional neural network (DCNN), VGG-19, or a residual DCNN (ResNet-50) was used to classify PPG segments into three grades of high, middle, and low. As a result, the study showed that the machine learning method using two-dimensional (2D) residual DCNN (RestNet-50) could more accurately evaluate signal quality than the method using general DCNN. introduced a CNN-based method to evaluate the quality of PPG in an Internet-of-things-based health monitoring system. Their study performed binary classification of “reliable or unreliable” for PPG quality using an entire 60-s PPG signal as a CNN input, not extracted features, showing a precision of 0.89, and a recall of 0.83. conducted a study comparing the performance of five machine learning classifiers (k-nearest neighbor, multi-class support vector machine, naive Bayes, decision tree, and random forest) to evaluate the SQI of PPG using a wrist-wearable device. In their study, PPG quality was classified into five grades; it was found that the random forest SQI evaluation algorithm had the highest classification accuracy, with an accuracy of 74.5%. In a recent study, detected wearable PPG artifacts with a DICE score of 0.87–0.91 through a combination of active-contour-based loss and an adapted U-Net architecture; compared to the existing general research methods, this method shows superior performance. However, to sufficiently verify the performance of the deep-learning model, verification using more abundant data is required.

32As seen in previous studies, most PPG pre-processing techniques rely on frequency domain filtering, which is effective in removing noise in a range that does not overlap with the core frequency of PPG. However, frequency domain filtering has limitations in handling non-stationary noise, making it possible to predict limitations that existing popular pre-processing technologies face when presuming increase in the use of PPG in future mobile environment. In the mobile environment, various types of non-stationary noise representing MAs can be introduced. This is expected to provide a completely different experience from measurement in an existing well-controlled environment. EMD or wavelet-based pre-processing technology can be a good alternative for dealing with frequency noise that does not overlap with the frequency component of PPG or non-stationary signals. However, it is also difficult to cope with severe distortion of the signal, such as saturation due to MAs and poor contact. Therefore, an innovative countermeasure against severe signal distortion and non-stationary dynamics is needed in the future by pursuing PPG pre-processing.

33In relation to heartbeat, since PPG has a relatively simple waveform, the complexity of the pulsatile feature detection algorithm is relatively low for PPG signals compared to other physiological signals. The pulsatile feature point detection accuracy PPG may depend on the pre-processing algorithm with superior noise removal or waveform recovery performance rather than a pulsatile feature point detection algorithm. On the other hand, while the use of PPG intrapulse waveform feature continues to increase, there is no clearly verified detection algorithm. Nor is related research active. From this point of view, future PPG feature detection can be performed by focusing on an intrapulse feature detection algorithm related to differential pulse waves or dicrotic features rather than an algorithm that detects pulsatile features such as pulse onset and systolic peak.

34Spatiotemporal features of PPG have already been analyzed in great detail for all inflection points of the waveform. Therefore, rather than finding completely new morphological features from the PPG waveform, it may be more effective to find the clinical significance of existing features or discover a combination feature. However, as features become more sophisticated, more effort is required to detect a feature that might increase false detection rate. Therefore, when discovering and selecting features, it is important to keep in mind that the minimum number of features should always be used to obtain maximum effect. From this point of view, a machine learning-based analysis method that can estimate a specific result by inputting a raw signal without a special feature extraction process can have the potential for a new breakthrough for research on a PPG feature with increasing complexity.

35For the representative noise of PPG, such as MAs, baseline wandering, and low perfusion, it has been reported that the baseline wandering noise of PPG can be effectively reduced with improved PPG detection performance through a relatively simple and easy-to-implement algorithm, such as a frequency filter or interpolation method. In addition, there have been attempts to decrease noise caused by low perfusion through hardware improvement, as well as software methods, such as adaptive filtering. However, a method that can completely remove the distortion of PPG waveform due to low perfusion remains unknown. Therefore, further research is needed to improve PPG distortion due to low perfusion. An approach from the viewpoint of noise removal technology and waveform reconstruction can be considered. MA as the most important topic of PPG signal processing can lead to the complete loss of PPG. Due to increased PPG measurement in a mobile environment, most in-depth research has been conducted for MA, compared to other noise factors. Despite various sophisticated algorithms that have been proposed for reducing MAs, a standard method for removing motion noise has yet to be introduced. Reviewing published studies on the removal of MAs revealed that an ICA method, an acceleration sensor-based, and an adaptive filtering method using a Kalman filter could be used. In the case of removing motion noise through simple frequency domain filtering using a high-pass filter, motion noise cannot be removed sensitively according to the intensity or type of motion. The ICA method and the adaptive filtering method can relatively improve the performance of motion noise removal. However, when the degree of motion noise is severe, they cannot be applied; for example, when the signal is saturated and completely lost because of motion. In such a case, a method of dividing the measured PPG into sections in which a signal exists, and a section in which the signal is lost, and analyzing selectively according to the classified section, has been proposed. In this method, the section in which motion noise can be removed is analyzed by applying motion noise removal technology, while the section in which motion noise could not be removed is excluded from analysis. Recently, research studies on SQI as an index for evaluating signal quality to distinguish between an analyzable section and an unanalyzable section have significantly increased. By evaluating the quality of a signal using SQI, false alarms in a patient monitoring device can be prevented, and the accuracy of clinical analysis can be improved by excluding error sections when interpreting signals. SQI is expected to be used in parallel with signal processing technology in the pre-processing stage. As mobile healthcare or wearable technology develops, its utilization will increase further. Machine learning technology is being applied in all areas of PPG signal processing, such as noise reduction, feature detection, and result analysis.

36Machine learning in physiological analysis can omit complex and high error probability processing stages, such as feature detection, and derive results through end-to-end learning. This is expected to improve accuracy in analysis. For example, if a machine learning technique is applied, heart rate may be derived from the PPG signal itself, without other procedures, such as frequency domain transform, and peak detection or peak detection and feature detection can be excluded when deriving analytical results, such as SQI. In addition, since machine learning can be used to remove noise or generate new waveforms, its application to PPG processing is expected to increase in the future. Although machine learning is a promising method for analyzing PPG signals to be used in various applications, it is necessary to secure a highly relevant large data set and develop specialized models for each subdivided application. In particular, attempts to find meaningful information from PPG using various deep learning models are continuously increasing. Representative applications of PPG analysis using deep learning include heart rate estimation, cuff-less blood pressure estimation, and arterial fibrillation prediction. In addition, PPG-based deep learning models are being used for respiratory rate estimation, sleep monitoring, diabetes, vascular aging estimation, and peripheral arterial disease classification. In addition, to explain the causal relationship between input data and output results, an in-depth approach using technologies such as explainable AI, which has been recently studied, needs to be conducted. With respect to bio-signals, although explainable AI has been mainly applied to ECG, it is difficult to find a clear application case for medical purposes in PPG. Although it is difficult to say that the application of explainable AI to PPG has been generalized yet, it seems clear that explainable AI will be introduced into PPG analysis given the tendency for the development of machine learning to be introduced into other fields. Machine learning is currently being continuously researched and developed. Finding and utilizing recent techniques and new methods, including explainable AI, will help in the analysis of PPG signals.

37HSh contributed to the conception and design of the manuscript, and drafting, writing, and critical review of the final document. JP, HSe, and S-SK contributed to the literature search, data collection and analysis, drafting and writing, and figure design and drawing. All authors contributed to the article and approved the submitted version.

38The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

39All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.