Next Article in Journal
Anti-TNFα Drugs and Interleukin Inhibitors: Epidemiological and Pharmacovigilance Investigation in COVID-19 Positive Patients
Next Article in Special Issue
Development of a Multi-Channel Wearable Heart Sound Visualization System
Previous Article in Journal
The Psychiatric Consequences of Long-COVID: A Scoping Review
Previous Article in Special Issue
Identification of Patients with Potential Atrial Fibrillation during Sinus Rhythm Using Isolated P Wave Characteristics from 12-Lead ECGs
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Calculation of an Improved Stiffness Index Using Decomposed Radial Pulse and Digital Volume Pulse Signals

1
Department of Electrical Engineering, Dong Hwa University, Hualien 97401, Taiwan
2
Taichung Tzuchi Hospital, The Buddhist Tzuchi Medical Foundation, Taichung 42743, Taiwan
3
School of Post-Baccalaureate Chinese Medicine, Tzu Chi University, Hualien 97002, Taiwan
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2022, 12(11), 1768; https://doi.org/10.3390/jpm12111768
Submission received: 14 September 2022 / Revised: 14 October 2022 / Accepted: 24 October 2022 / Published: 26 October 2022
(This article belongs to the Special Issue Physiological Signal Analysis Methods in Healthcare)

Abstract

:
The stiffness index (SI) is used to estimate cardiovascular risk in humans. In this study, we developed a refined SI for determining arterial stiffness based on the decomposed radial pulse and digital volume pulse (DVP) waveforms. In total, 40 mature asymptomatic subjects (20 male and 20 female, 42 to 76 years of age) and 40 subjects with type 2 diabetes mellitus (T2DM) (23 male and 17 female, 35 to 78 years of age) were enrolled in this study. We measured subjects’ radial pulse at the wrist and their DVP at the fingertip, and then implemented ensemble empirical mode decomposition (EEMD) to derive the orthogonal intrinsic mode functions (IMFs). An improved SI (SInew) was calculated by dividing the body height by the mean transit time between the first IMF5 peak and the IMF6 trough. Another traditional index, pulse wave velocity (PWVfinger), was also included for comparison. For the PWVfinger index, the subjects with T2DM presented significantly higher SInew values measured according to the radial pulse (SInew-RP) and DVP signals (SInew-DVP). Using a one-way analysis of variance, we found no statistically significant difference between SInew-RP and PWVfinger when applied to the same test subjects. Binary logistic regression analysis showed that a high SInew-RP value was the most significant risk factor for developing T2DM (SInew-RP odds ratio 3.17, 95% CI 1.53–6.57; SInew-DVP odds ratio 2.85, 95% CI 1.27–6.40). Our refined stiffness index could provide significant information regarding the decomposed radial pulse and digital volume pulse signals in assessments of arterial stiffness.

Graphical Abstract

1. Introduction

Contour analysis of pulse waves is an important noninvasive method for assessing arterial stiffness based on photoplethysmography (PPG) pulses [1,2] or pressure pulses [3]. Recent studies have established that arterial stiffness increases with age [4] and is associated with cardiovascular risks, including hypertension [5] and the need for cardiac output monitoring [6], diabetes-associated arteriosclerosis [7,8], and end-stage renal disease [9]. Pulse waves, which provide an abundance of physical information, are signals comprising systolic and diastolic components. Systolic waves are forward-moving signals transmitted from the left ventricle to the location of measurement (e.g., finger or wrist), while diastolic waves flow backward from the lower limbs [2,3]. Among the typical methods for pulse wave contour analysis, determination of the stiffness index (SI) and related measurements represent easy and reliable approaches for determining the stiffness of large arteries in a clinical setting [2,3].
Millasseau and colleagues first proposed the method of dividing the height (in meters) by the time between the peaks of the systolic and diastolic components to obtain the SI parameter for use as an index [1]. In general, highly atherosclerotic subjects (e.g., older or diabetic) present diastolic components that flow backward faster than those of younger subjects (i.e., the time between the peaks of the systolic and diastolic components is shorter due to atherosclerosis) [1]. Although estimating the SI is easy for a pulse wave with prominent systolic and diastolic peaks, such as in young healthy subjects without significant arterial stiffness (i.e., with smaller SI values), the diastolic peaks are not well-defined (i.e., the diastolic component is not discernible) in older subjects and those with premature arterial stiffening, especially when assessed using photoplethysmography (PPG) [1]. Fortunately, several commercialized pulse wave analysis systems, such as the PulseTrace PCA2 (CareFusion, San Diego, CA, USA) [2,10,11] and PortaPres noninvasive hemodynamic monitoring device (FinaPres Medical Systems, Amsterdam, The Netherlands) [3], can accurately calculate the SI and related measurements even in very old patients or in those with cardiovascular disease. For example, researchers have measured the arterial stiffness index (ASI) at the index fingertip using finger photoplethysmography [2], finding that an increased ASI is associated with an increased risk of cardiovascular disease [2]. The authors of [3] defined the SI using the digital pulse propagation index (DPPI), based on the digital pressure pulse wave measured via a finger cuff. They found that a high DPPI was associated with established cardiovascular risk factors, including mean arterial blood pressure and smoking (all with p < 0.001).
In previous studies, we attempted to refine the diastolic pulse waveform with ensemble empirical mode decomposition (EEMD) [12] for SI computation [13,14,15] using prototype pulse analysis systems (i.e., an ECG-PWV system [13,14] and an air-pressure-sensing system [15]). EEMD is the first stage of the Hilbert–Huang transformation (HHT), which separates physiological signals into sets of distinct and orthogonal physiological information known as intrinsic mode functions (IMFs). After implementing EEMD, numerous orthogonal intrinsic mode functions (IMFs) are obtained. We initially chose IMF5 for SI computation, as it presented much larger amplitudes than the other functions, resembling the systolic and diastolic waveforms, and energy distribution analysis showed that its frequency distribution was between 1 and 4 Hz. We therefore selected IMF5 as the appropriate noise-free pulse wave [13,14,15]. We proposed that IMF5 most accurately represents the digital volume pulse (DVP) [13,14] and radial pulse [15] waveforms, and can be used as a basis for calculating the SI. However, our results were problematic. We had selected three subjects of different ages and health statuses included in [13,14] who presented distinct diastolic pulses according to the DVP measurements at the index fingertips. As expected, the younger adults exhibited lower SI values (subject A vs. subject C: 7.36 m/s vs. 10.30 m/s; Table S1). However, the SI values computed from IMF5 were higher for the younger adults (subject A vs. subject C: 8.44 m/s vs. 6.65 m/s; Table S1), which is illogical considering the definition of the SI. Some of the SI results based on IMF5 after EEMD among the four groups, measured according to the radial arterial waveforms at the wrist [15], are listed in Table S2 (young subjects vs. poorly controlled diabetes: 4.83 ± 0.63 vs. 2.77 ± 0.58 m/s). Unexpectedly, the poorly controlled diabetes group showed the smallest SI values, which is also illogical considering the definition of the SI. Thus, the second peak of IMF5 does not represent the diastolic pulse peak and cannot demonstrate the validity of the SI by itself.
Although the SI values derived from IMF5 alone showed statistically significant differences that could be used to differentiate between the groups in [13], the idea that IMF5 most accurately represents the DVP or pressure pulse waveforms through which the SI can be calculated is contentious. Therefore, there was an urgent need to develop an improved stiffness index, such as through using the decomposed radial pulse and DVP waveforms. We previously proposed interpretations of certain IMFs [15], as the interrelationships among the relevant IMFs are poorly understood, and could demonstrate the value of EEMD for signal analysis [16]. Our objectives are to determine: (1) an appropriate stiffness index for radial pulse and/or DVP signals after EEMD [17,18] and (2) a refined time-difference (ΔTnew) parameter for the success of the new index (SInew). This manuscript is organized as follows: In Section 2, we define an appropriate stiffness index for the two decomposed pulse signals (radial arterial waveforms at the wrist and DVPs at the fingertip) after describing the study population, pulse signals and systems, and statistical analysis methods. In Section 3, we outline the refined time difference parameter for arterial stiffness assessment, measured between the first IMF5 peak and the IMF6 trough of the same heartbeat period, factors which were decomposed from DVP or RPP waveforms. Subsequently, we evaluate the performance of the new stiffness index by assessing its correlation with risk factors. To test the validity of the new index in translational signaling and medical applications, we compared the results with those obtained using the pulse wave velocity index by performing a one-way analysis of variance. We discuss the findings in Section 4 and conclude the manuscript in Section 5.

2. Materials and Methods

2.1. Study Population, Grouping, and Experimental Procedure

2.1.1. Study Protocol

In this paper, we propose an improved stiffness index based on decomposed radial pulses and DVPs for arterial stiffness assessment in humans. Using the PWV index for comparison, we investigated variations in the radial pulse and DVP SI values of healthy middle-aged subjects and T2DM patients according to the differences in their clinical risk factors.

2.1.2. Grouping

A. Inclusion criteria.
Eighty middle-aged participants (Group 1: n = 40, HbA1c < 6.5%; Group 2: n = 40, HbA1c ≥ 6.5%) were recruited for the final investigation (with de-identification of the data) between July 2009 and October 2011 in our previous studies [13,14,15]. All of the study subjects in Group 1 were recruited from a health-screening program at Hualien Hospital in Taiwan. The subjects in Group 2 attended a checkup every three months in the diabetes outpatient clinic at the same hospital (Table 1).
B. Exclusion criteria.
Subjects excluded from this study were those with a history of atherosclerosis-related complications, such as angina, myocardial infarction, stroke, and peripheral vascular diseases, within the past six months (as reported in our previous studies). We also excluded a minority of examinees who could not tolerate an upper-arm cuff pressure of up to 180 mmHg for 3 min during radial pulse signal measurement.
Table 1 lists the anthropometric and serum biochemical parameters of the two groups. The difference in age between the two groups was of little practical significance (p = 0.048 < 0.050).

2.1.3. Experimental Procedure

All subjects fasted for 8 h before testing. On the day of measurement, the participants arrived at the outpatient clinic department in Hualien Hospital for medical assessment and blood sampling (including total cholesterol, triglycerides, low-density lipoprotein, high-density lipoprotein, fasting plasma glucose, and glycosylated hemoglobin). Subsequently, they waited to be assessed by a doctor outside the clinic. Following the medical assessment, the subjects arrived at a health clinic for physiological data recording (including age, body weight, height, waist circumference, and blood pressure), completion of the family-life questionnaire, and measurement of the radial pulse and DVP. We conducted all pulse measurements in a quiet room where the temperature was kept at 26 ± 1 °C. Firstly, we used the six-channel ECG-PWV system [7] for PWVfinger assessment and DVP signal measurement. The subjects rested for three minutes, and we then attached two pressure cuffs (i.e., a wrist cuff and an upper-arm cuff) in a refined air-pressure-sensing system (APSS) [15] to the left upper-arm and wrist for radial pulse measurement over 16 min. All the subjects provided written consent during the experimental procedure. The Institutional Review Board (IRB) of Hualien Hospital and Taichung Tzu Chi Hospital provided approval, and the data was used this study.

2.2. Measurement Instrument Description and Related Indices

2.2.1. DVP and Radial Pulse Signal Measurements

PWV-ECG system for DVP measurement and PWVfinger index.
We measured the distance from points of reference in the sternal notch to the left-hand fingertip while the subjects were in the supine position (e.g., Lfinger). The six-channel ECG-PWV system [7] had a sampling frequency of 500 Hz, and we included the digitized signals acquired over 18 s (i.e., 9000 samples) for SInew-DVP offline computation. We also chose the R wave ECG at lead II as a reference point, and defined the time it took for a pulse to travel from this point to the left-hand fingertip as the time difference (T). Hence, the PWVfinger value was calculated as Lfinger/T, averaging the values over 18 s of successive cardiac cycles.
APSS for radial pulse measurement.
We included the original radial pulse signal measurements acquired at the wrist over representative 18-s periods during the first 5 min of wrist waveform collection (via the refined APSS [15] with a sampling frequency of 500 Hz) from the baseline phase only. The piezo-resistive sensor, which was connected to the second pressure cuff at the wrist, is widely adopted for the noninvasive measurement of blood pressure. We used this sensor for radial pulse wave detection and waveform analysis. The pressure detected by the piezo-resistive sensor was then converted into electrical signals prior to amplification and filtering to obtain the analog signals. After EEMD, we calculated the SInew-RP.

2.2.2. SI Computation

A. Computation of SI by DVP waveforms.
DVP waves are complex physical signals generally composed of systolic and diastolic components. The systolic components are the forward-moving waves transmitted from the left ventricle to the finger (the recording location), while the diastolic components are the backward-flowing signals produced when the pulse is transmitted along the aorta to the small arteries in the lower limbs. As shown in Figure 1, the stiffness index (SI) is a reliable index for determining the stiffness of large arteries [19,20]; a smaller value indicates a greater degree of stiffness. However, an important issue when using the SI to assess arterial stiffness is the ambiguity associated with the diastolic wave peak in older and atherosclerotic subjects (e.g., those with T2DM), which precludes accurate determination of the SI. Hence, many researchers have adopted EEMD to reconstruct the diastolic peak [21,22].
B. Ensemble empirical mode decomposition algorithm review.
This section starts with a brief review of the original empirical mode decomposition (EMD) method and ensemble EMD (EEMD). For a non-linear signal x(t), the EMD algorithm consisted of the following steps [18]:
(1) Connecting the sequential local maxima or local minima to derive the upper or lower envelopes using cubic spline, respectively.
(2) Averaging the upper and lower envelopes to derive the median of envelope, m(t).
(3) Extracting the temporary oscillation signal h(t) = x(t) − m(t).
(4) Repeat steps (1)–(3) on the temporary oscillation signal h(t) until m(t) is close to zero. Then, h(t) is considered as an IMFn(t).
(5) Compute the residue r(t) = x(t) − IMFn(t).
(6) Repeat steps from (1) to (5) using r(t) for x(t) to generate the next IMF (IMFn+1) and residue.
Subsequently, the EEMD algorithm first generates an ensemble of data sets obtained by adding different realizations of the white-noise signal w(t) to the input signal x(t). The EMD analysis is then applied to these new signal sets Y(t). Considering m and n as the number of realizations and the IMF index, respectively, the EEMD algorithm is then briefly summarized below in [17]:
(1) In each realization i, calculate the perturbed signal Yi(t):
Y i ( t ) = x ( t ) + ƞ · std [ x ( t ) ] · w ( t ) ,
where ƞ is defined as the input noise amplitude, and std stands for the standard deviation operation.
(2) Apply EMD with N iterations to decompose Yi(t) into multiple IMFs.
Y i ( t ) = n IMFi , n ( t ) .
(3) Repeat step (1) and step (2) using a different series of white noise.
(4) The resultant IMF in EEMD is calculated as
IMF n ( t ) = 1 m k = 1 m IMFk , n ( t ) .
In the current study, ƞ is set as 0.2, and N is equal to 200 for quick computing. Accordingly, EEMD is a useful nonlinear and nonstationary time-domain decomposition method. It is not only an adaptive, data-driven algorithm, but also decomposes a physiological signal (e.g., radial pulse or DVP) into limit number empirical modes in Equation (3), known as intrinsic mode functions (IMFs), orthogonal to each other [16,17,18]. Each orthogonal IMF represents a narrow band frequency–amplitude modulation that is often related to a specific physical process or some kind of noise.
C. An Appropriate Stiffness Index for Use after EEMD.
In our previous studies [13,14,15], we chose IMF5 for SI computation, because it resembled systolic and diastolic waveforms, and energy distribution analysis showed that its frequency distribution was between 1 and 4 Hz. We therefore assumed that IMF5 was the ideal noise-free pulse wave. However, IMF6, generated by the impact of arterial pulsation on the pressure cuff or PPG sensor, exhibited a frequency close to that of the heart rate. The transit time (i.e., ΔTnew) between IMF5 and IMF6 constitutes the time difference (in seconds) between the first IMF5 peak and the IMF6 trough within the same period (Figure 2).
Therefore, we defined the improved stiffness index (SInew) for use after EEMD as the ratio of body height to ΔTnew (Figure 2):
SI new =   body   height   /   Δ T new ,   unit :   m / sec .
To avoid confusion, we distinguished between SInew-DVP and SInew-RP as two different stiffness indices based on DVP and radial pulse signals, respectively.

2.3. Statistical Analysis

The values in Table 1 and Table 2 are represented as the means ± standard deviations (SDs) according to independent-samples t-tests. We assessed three arterial stiffness indices, namely, PWVfinger, SInew-RP, and SInew-DVP. We analyzed the data using a one-way ANOVA followed by a Fisher’s least significant difference (LSD) post hoc multiple comparison analysis, and evaluated the association between SInew-RP and SInew-DVP using the Spearman correlation test. We also used this test, alongside the 95% confidence interval (95% CI), to measure the influence of the continuous parameters (e.g., anthropometric and serum biochemical parameters) in Statistical Package for the Social Sciences (SPSS, version 14 for Windows, SPSS Inc., Chicago, IL, USA). For the arterial stiffness indices calculation, we used the signal analysis software package in MATLAB R2020b (MathWorks Inc., trial use (30 days), USA). We developed a fitted binary logistic regression model based on the likelihood ratio estimates in SPSS to analyze the incidence risk of T2DM with different odds ratios.

3. Results

3.1. Use of EEMD for Decomposing IMF5 and IMF6 in Older and Diabetic Subjects

Figure 3 shows the effectiveness of decomposing IMF5 and IMF6 for assessing arterial stiffness (i.e., SInew-RP and SInew-DVP) in a middle-aged diabetic patient, as reflected by the higher value compared with that obtained for the middle-aged non-diabetic subject (5.82 m/s vs. 4.02 m/s for SInew-RP; 4.29 m/s vs. 3.60 m/s for SInew-DVP, respectively). EEMD [17,18] was applied to radial pulse and DVP signals using Equation (3) for decomposition of IMF5 and IMF6 to calculate the SInew-RP and SInew-DVP indices via Equation (4). The resulting values allowed distinguishing between the diabetics (Group 2) and non-diabetics (Group 1) in the population of similarly aged subjects based on statistically significant differences (all p < 0.05) (Table 2).

3.2. One-Way ANOVA for Three Arterial Stiffness Indices

We compared the mean performance of the three arterial stiffness assessment indices (PWVfinger, SInew-RP, and SInew-DVP) using one-way analysis of variance at a 0.05 level of significance, and the results are presented in Table 3(A). The mean performance of PWVfinger and SInew-RP were similar (4.90 vs. 4.96 m/s, respectively). The p-value for source of variance indicated significant difference between indices (p < 0.001); therefore, we applied Fisher’s least significant difference (LSD) post hoc multiple comparisons analysis, as presented in Table 3(B). The results of this analysis revealed that the mean score obtained for PWVfinger was similar to that of SInew-RP (mean difference = −0.058; p = 0.658) but not to that of SInew-DVP (mean difference = 0.524; p < 0.001). Finally, the results revealed that the mean score of SInew-RP, which presented a high level of stiffness, differed significantly in comparison to that of SInew-DVP (mean difference = 0.582; p < 0.001), which presented a low level of stiffness.
In other words, we found no statistically significant differences in the arterial stiffness assessment based on PWVfinger and SInew-RP for the same test subjects.

3.3. Correlation between SInew-DVP and SInew-RP

We found no statistically significant differences between the two indices SInew-RP and PWVfinger (4.96 ± 0.98 vs. 4.90 ± 0.42 m/s, p = 0.658; mean difference 0.058 ± 0.218 m/s) (Table 3). Accordingly, SInew-DVP was significantly correlated with SInew-RP (r = 0.772, p < 0.001) (Figure 4). Both SInew-RP and SInew-DVP were significantly correlated with age, body weight, waist circumference, glycosylated hemoglobin, and triglyceride (Table 4).

3.4. Effects of Risk Factors on SInew-RP and SInew-DVP Indices

Among the 80 test subjects, 40 were healthy and 40 had T2DM. Subjects with T2DM had significantly higher arterial stiffness than those without T2DM, as determined by either radial pulse (4.51 ± 0.49 vs. 5.41 ± 1.13 m/s, p < 0.001, 95% CI 0.38 to 1.42 m/s) or DVP (4.02 ± 0.61vs 4.74 ± 1.09 m/s, p < 0.001, 95% CI 0.56 to 1.26 m/s).
Binary logistic regression analysis showed that subjects with t2dm had higher sinew-rp and sinew-dvp scores than those without t2dm, as determined by both novel arterial stiffness indices (sinew-rp odds ratio 3.17, 95% ci 1.53 to 6.57; sinew-dvp odds ratio 2.85, 95% ci 1.27 to 6.40; hosmer–lemeshow test p = 0.336 vs. p = 0.241, respectively).

4. Discussion

Commercialized pulse wave analysis systems, such as PulseTrace PCA2 [2,10,11] and the PortaPres noninvasive hemodynamic monitoring device [3], can accurately determine SI values, even for very old subjects or those with cardiovascular disease. However, the DVPs of most type 2 diabetic patients and the radial pulses of all subjects as measured by our prototype systems [13,14,15] did not present diastolic peaks and therefore preclude the direct computation of the stiffness index. In our earlier work, we demonstrated that EEMD could be applied rapidly and easily for computation of the stiffness index based on IMF5 [13,14,15]. Although this system was found to differentiate between the groups based on statistically significant differences, the fact that the SI values were lower in the older and type 2 diabetic patients was problematic. In the current study, we developed a new method for calculating the stiffness index using radial pulse and DVP signals subjected to EEMD (Figure 3) that demonstrated high efficacy for measuring arterial stiffness (Table 2). As with the PWV index, a higher SInew value was associated with the presence of risk factors (Table 4). In our proposed method, we improve the accuracy of calculating the stiffness index (SInew) by adjusting the time difference according to the distance between the first IMF5 peak and the IMF6 trough within the same period (ΔTnew) for subsequent EEMD (Figure 2). Our findings indicate that the method for calculating SInew based on DVP and radial pulse signals is feasible for assessing arterial stiffness, though determining the feasibility for clinical application requires further evaluation.
Many studies have indicated that the wrist pressure pulse is related to the DVP [23]. Whereas SInew-DVP uses measurements from the fingertip, SInew-RP relies on air-pressure pulse signals from the wrist. The calculated SInew-RP index values corresponding to high stiffness differ significantly from the SInew-DVP index values corresponding to low stiffness (mean difference = 0.582; p < 0.001) (Table 3); Group 1 vs. Group 2 = 4.51 ± 0.49 vs. 5.41 ± 1.13 m/s for SInew-RP and 4.02 ± 0.61 vs. 4.74 ± 1.09 m/s for SInew-DVP, respectively (all p < 0.05, Table 2). The arterial stiffness assessments of the SInew-DVP and SInew-RP indices presented statistically significant differences (p < 0.001) for the same test subjects. Conversely, SInew-DVP was significantly correlated with SInew-RP (r = 0.772, p < 0.001) (Figure 4). Thus, the SInew values provided by the two techniques (SInew-DVP and SInew-RP) are not identical. Determination of the SInew-RP index (i.e., pressure sensing) is more easily implementable on a wearable bracelet [24], whereas the DVP, unlike the stable radial pulse, is suitable for innovative wearable technology applications due to its advantages as a noninvasive and convenient diagnostic tool [23]. For example, PPG sensors could be used in eardrops, finger cots, and toe sleeves for acquisition of peripheral volume pulse information from the ear, index finger, and toe, respectively.
Arterial stiffness is an independent prognostic indicator of cardiovascular risk, and arterial stiffness is typically measured according to the pulse wave velocity [25,26,27]. The CAVI is also an important and independent risk marker in patients with chronic and acute coronary heart disease [28,29]. Values determined for our prototype index (SInew-RP) were not significantly different, statistically, from the PWVfinger index calculated for the same test subjects (mean: 4.90 vs. 4.96 m/s; mean difference: −0.058; p = 0.658) (Table 3(B)). However, binary logistic regression analysis showed that subjects with T2DM presented higher SInew-RP and SInew-DVP values than those without T2DM (SInew-RP odds ratio 3.17, 95% CI 1.53 to 6.57; SInew-DVP odds ratio 2.85, 95% CI 1.27 to 6.40; Hosmer–Lemeshow test p = 0.336 vs. p = 0.241, respectively). Therefore, our findings for wrist air-pressure pulse measurement were consistent with those in [23,24,30], which indicates the efficacy of using radial pulse waves in many applications. Finally, the optimized EEMD algorithm used in the current study can operate in real-time and at a sampling rate of up to 3500 Hz [17]. Therefore, our EEMD algorithm for decomposing IMF5 and IMF6 for SInew-RP and SInew-DVP calculation is a computationally efficient method that can be applied to large datasets in clinical applications.
This study has some limitations. Both groups comprised middle-aged subjects. Hence, this was not a wide-ranging clinical study, and the number of participants was limited. Furthermore, the subjects were not age-controlled (p = 0.048 < 0.050) to allow for unbiased analysis. This was an outpatient clinic-based cross-sectional study that relied on the accuracy of the data reported by the subjects. Therefore, a gap existed between the middle-aged asymptomatic group and the diabetic group. Although a positive association exists between heart rate and T2DM risk, average heart rate was significantly different between in the two groups (about 75 vs. 88 bpm) in our study, so it was difficult to prevent bias when grouping. We acquired 9000 wrist radial pulse and 9000 DVP data samples from our own dataset for computation of the SInew-RP and SInew-DVP under the same standard processes. As a result, the details regarding diet, exercise, and the medical control of diabetes may be incomplete and, thus, errors are inevitable. Finally, we recommend that future studies be conducted to include comparisons with other commercialized pulse wave analysis systems.

5. Conclusions

This study successfully solved the controversial problem of decomposing the radial pulse or DVP without discernible diastolic peaks to calculate stiffness index. Our results demonstrated that using a refined time difference between the first peak of IMF5 and the trough of IMF6 (i.e., ΔTnew) for the decomposed signals with EEMD may serve as a useful tool, not only in the early detection of cardiovascular disease, but also in assessing disease progression in the area of translational signaling and medicine.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jpm12111768/s1, Table S1: Comparison of stiffness indices (SIs) based on digital volume pulse from original pulse wave and IMF5 after EEMD [13,14]; Table S2: Stiffness index values based on pressure pulse among four different groups [15]; ΔT defined as in Figure 1 using only IMF5.

Author Contributions

Conceptualization, H.-T.W.; data curation, H.-T.W. and J.-J.C.; investigation, J.-J.C.; methodology, H.-T.W.; software, H.-T.W.; supervision, J.-J.C.; visualization, J.-J.C.; writing—original draft, H.-T.W.; writing—review and editing, J.-J.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Boards of the Taichung Tzu Chi Hospital (protocol no.TTCRD106-18; date of approval: 14 July 2017) and Hualien Hospital (protocol no. 98-06-02; date of approval: 16 July 2010).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data structures are accessible upon demand from the authors.

Acknowledgments

The authors are grateful for the support of Texas Instruments, Taiwan, for providing the analog chips and MCU for the non-invasive instruments developed in this study as a contribution to preventive medicine. The first author also acknowledges Bagus Haryadi and Na Ta for their help in plotting the figures. The authors would like to sincerely appreciate the Academic Editor and the anonymous Reviewers for their valuable comments.

Conflicts of Interest

The authors declared no potential conflicts of interest.

References

  1. Millasseau, S.C.; Ritter, J.M.; Takazawa, K.; Chowienczyk, P.J. Contour Analysis of the Photoplethysmographic Pulse Measured at the Finger. J. Hypertens. 2006, 24, 1449–1456. [Google Scholar] [CrossRef] [PubMed]
  2. Said, M.A.; Eppinga, R.N.; Lipsic, E.; Verweij, N.; van der Harst, P. Relationship of Arterial Stiffness Index and Pulse Pressure with Cardiovascular and Disease and Mortality. J. Am. Heart Assoc. 2018, 22, e007621. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. De Jong, M.A.; Van Roon, A.M.; Bakker, J.T.; Bijen, H.T.J.; Mulder, D.J.; Brouwers, F.P.; Van Gilst, W.H.; Voors, A.A.; Gansevoort, R.T.; Bakker, S.J.L.; et al. Digital Arterial Pressure Pulse Wave Analysis and Cardiovascular Events in the General Population: The Prevention of Renal and Vascular End-Stage Disease Study. J. Hypertens. 2020, 38, 1064–1071. [Google Scholar] [CrossRef] [PubMed]
  4. Wu, S.; Jin, C.; Li, S.; Zheng, X.; Zhang, X.; Cui, L.; Gao, X. Aging, Arterial Stiffness, and Blood Pressure Association in Chinese Adults. Hypertension 2019, 73, 893–899. [Google Scholar] [CrossRef] [PubMed]
  5. Boutouyrie, P.; Chowienczyk, P.; Humphrey, J.D.; Mitchell, G.F. Arterial Stiffness and Cardiovascular Risk in Hypertension. Circ. Res. 2021, 128, 864–886. [Google Scholar] [CrossRef]
  6. Grensemann, J. Cardiac Output Monitoring by Pulse Contour Analysis, the Technical Basics of Less-Invasive Techniques. Front Med. 2018, 5, 64. [Google Scholar] [CrossRef]
  7. Hsu, P.-C.; Wu, H.-T.; Sun, C.-K. Assessment of Subtle Changes in Diabetes-Associated Arteriosclerosis Using Photoplethysmographic Pulse Wave from Index Finger. J. Med. Syst. 2018, 42, 43. [Google Scholar] [CrossRef]
  8. Xu, M.; Huang, Y.; Xie, L.; Peng, K.; Ding, L.; Lin, L.; Wang, P.; Hao, M.; Chen, Y.; Sun, Y.; et al. Diabetes and Risk of Arterial Stiffness: A Mendelian Randomization Analysis. Diabetes 2016, 65, 1731–1740. [Google Scholar] [CrossRef] [Green Version]
  9. London, G.M. Arterial Stiffness in Chronic Kidney Disease and End-Stage Renal Disease. Blood Purif. 2018, 45, 154–158. [Google Scholar] [CrossRef]
  10. Zekavat, S.M.; Aragam, K.; Emdin, C.; Khera, A.V.; Klarin, D.; Zhao, H.; Natarajan, P. Genetic Association of Finger Photoplethysmography-Derived Arterial Stiffness Index with Blood Pressure and Coronary Artery Disease. Arterioscler. Thromb. Vasc. Biol. 2019, 39, 1253–1261. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Tomson, J.; Hin, H.; Emberson, J.; Kurien, R.; Lay, M.; Cox, J.; Hill, M.; Arnold, L.; Leeson, P.; Armitage, J.; et al. Effects of Vitamin D on Blood Pressure, Arterial Stiffness, and Cardiac Function in Older People after 1 year: BEST-D (Biochemical Efficacy and Safety Trial of Vitamin D). J. Am. Heart Assoc. 2017, 6, e005707. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Wu, Z.; Huang, N.E. Ensemble Empirical Mode Decomposition: A Noise-Assisted Data Analysis Method. Adv. Adapt. Data Anal. 2009, 1, 1–41. [Google Scholar] [CrossRef]
  13. Wei, H.-C.; Xiao, M.-X.; Chen, H.-Y.; Li, Y.-Q.; Wu, H.-T.; Sun, C.-K. Instantaneous Frequency from Hilbert-Huang Space as an Indicator of Diabetes and Arterial Stiffness in Middle-Aged and Elderly Subjects. Sci. Rep. 2018, 8, 15771. [Google Scholar] [CrossRef] [Green Version]
  14. Wei, H.-C.; Li, Y.-Q.; Wu, G.-S.; Xiao, M.-X.; Tang, X.-J.; Chen, J.-J.; Wu, H.-T. New Application of an Instantaneous Frequency Parameter for Assessing Far Infrared Fabric Effect in Aged Subjects. Electronics 2020, 9, 138. [Google Scholar] [CrossRef] [Green Version]
  15. Wu, H.-T.; Lee, C.-H.; Liu, A.-B.; Chung, W.-S.; Tang, C.-J.; Sun, C.-K.; Yip, H.-K. Arterial Stiffness Using Radial Arterial Waveforms Measured at the Wrist as an Indicator of Diabetic Control in the Elderly. IEEE Trans. Biomed. Eng. 2011, 58, 243–252. [Google Scholar]
  16. Stallone, A.; Cicone, A.; Materassi, M. New Insights and Best Practices for the Successful Use of Empirical Mode Decomposition, Iterative Filtering and Derived Algorithms. Sci. Rep. 2020, 10, 15161. [Google Scholar] [CrossRef] [PubMed]
  17. Wang, Y.H.; Yeh, C.H.; Young, H.W.V.; Hu, K.; Lo, M.T. On the Computational Complexity of the Empirical Mode Decomposition Algorithm. Phys. A Stat. Mech. Its Appl. 2014, 400, 159–167. [Google Scholar] [CrossRef]
  18. Yeh, J.R.; Shieh, J.S.; Huang, N.E. Complementary Ensemble Empirical Mode Decomposition: A Novel Noise Enhanced Data Analysis Method. Adv. Adapt. Data Anal. 2010, 2, 135–156. [Google Scholar] [CrossRef]
  19. Birukov, A.; Cuadrat, R.; Polemiti, E.; Eichelmann, F.; Schulze, M.B. Advanced Glycation End-Products, Measured as Skin Autofluorescence, Associate with Vascular Stiffness in Diabetic, Pre-diabetic and Normoglycemic Individuals: A Cross-Sectional Study. Cardiovasc. Diabetol. 2021, 20, 110. [Google Scholar] [CrossRef]
  20. El-Naggar, H.M.; Anwar, H.S.; Helmy, H.A.; Demitry, S.R. Aortic Elasticity Indices as Predictors of Coronary Artery Disease Severity Assessed by SYNTAX Score. J. Cardiovasc. Echogr. 2021, 31, 234–241. [Google Scholar] [CrossRef]
  21. Guo, C.; Jiang, Z.; He, H.; Liao, Y.; Zhang, D. Wrist Pulse Signal Acquisition and Analysis for Disease Diagnosis: A Review. Comput. Biol. Med. 2022, 143, 105312. [Google Scholar] [CrossRef] [PubMed]
  22. Roy, B.; Gupta, R. MoDTRAP: Improved Heart Rate Tracking and Preprocessing of Motion-Corrupted Photoplethysmographic Data for Personalized Healthcare. Biomed. Signal Process. Control. 2020, 56, 101676. [Google Scholar] [CrossRef]
  23. John, A.; Dingchang, Z.; Panicos, A.K.; Mohamed, E. Photoplethysmography, 1st ed.; Academic Press: London, UK, 2021. [Google Scholar]
  24. Meng, K.; Xiao, X.; Wei, W.; Chen, G.; Nashalian, A.; Shen, S.; Xiao, X.; Chen, J. Wearable Pressure Sensors for Pulse Wave Monitoring. Adv. Mater. 2022, 34, 2109357. [Google Scholar] [CrossRef] [PubMed]
  25. Venkata Giri Kumar, P.; Deshpande, S.; Joshi, A.; More, P.; Nagendra, H.R. Significance of Arterial Stiffness in Tridosha Analysis: A Pilot Study. J. Ayurveda Integr. Med. 2017, 8, 252–256. [Google Scholar] [CrossRef]
  26. Sequí-Domínguez, I.; Cavero-Redondo, I.; Álvarez-Bueno, C.; Pozuelo-Carrascosa, D.P.; Nuñez de Arenas-Arroyo, S.; Martínez-Vizcaíno, V. Accuracy of Pulse Wave Velocity Predicting Cardiovascular and All-Cause Mortality. A Systematic Review and Meta-Analysis. J. Clin. Med. 2020, 9, 2080. [Google Scholar] [CrossRef]
  27. Tuttolomondo, A.; Cirrincione, A.; Casuccio, A.; Del Cuore, A.; Daidone, M.; Di Chiara, T.; Di Raimondo, D.; Della Corte, V.; Maida, C.; Simonetta, I.; et al. Efficacy of Dulaglutide on Vascular Health Indexes in Subjects with Type 2 Diabetes: A Randomized Trial. Cardiovasc. Diabetol. 2021, 20, 1. [Google Scholar] [CrossRef]
  28. Bonarjee, V.V.S. Arterial Stiffness: A Prognostic Marker in Coronary Heart Disease. Available Methods and Clinical Application. Front. Cardiovasc. Med. 2018, 5, 64. [Google Scholar] [CrossRef] [Green Version]
  29. Tajima, T.; Ikeda, A.; Steptoe, A.; Takahashi, K.; Maruyama, K.; Tomooka, K.; Saito, I.; Tanigawa, T. The Independent Association between Salivary Alpha-Amylase Activity and Arterial Stiffness in Japanese Men and Women: The Toon Health Study. Hypertens. Res. 2022, 45, 1249–1262. [Google Scholar] [CrossRef]
  30. Mej´ıa-Mej´ıa, E.; Allen, J.; Budidha, K.; El-Hajj, C.; Kyriacou, P.A.; Charlton, P.H. Photoplethysmography Signal Processing and Synthesis. In Photoplethysmography; Kyriacou, P.A., Allen, J., Eds.; Elsevier: Amsterdam, The Netherlands, 2021. [Google Scholar]
Figure 1. Measurement of digital volume pulse (DVP) by transmission of infrared rays through the finger. Generally, DVP comprises a systolic peak (the first peak) and a diastolic peak (the second peak). ΔT = the time difference between the first and second peak; stiffness index (SI) = body height/ΔT.
Figure 1. Measurement of digital volume pulse (DVP) by transmission of infrared rays through the finger. Generally, DVP comprises a systolic peak (the first peak) and a diastolic peak (the second peak). ΔT = the time difference between the first and second peak; stiffness index (SI) = body height/ΔT.
Jpm 12 01768 g001
Figure 2. We chose IMF5 and IMF6 from Equation (3) to calculate SI indexes after decomposition of the radial pulse and DVP using EEMD. We automatically computed the time difference (ΔTnew) between the first IMF5 peak (P1) and IMF6 trough (T) within the same period. We attributed IMF7 to respiratory signals, with a frequency of around 0.2 Hz. Since this signal did not affect the accuracy of the IMF5 signals, we deemed its measurement unnecessary.
Figure 2. We chose IMF5 and IMF6 from Equation (3) to calculate SI indexes after decomposition of the radial pulse and DVP using EEMD. We automatically computed the time difference (ΔTnew) between the first IMF5 peak (P1) and IMF6 trough (T) within the same period. We attributed IMF7 to respiratory signals, with a frequency of around 0.2 Hz. Since this signal did not affect the accuracy of the IMF5 signals, we deemed its measurement unnecessary.
Jpm 12 01768 g002
Figure 3. Variation in the radial pulse and DVP curve with age and diabetes. Non-stationary waveform signals were decomposed using ensemble empirical mode decomposition (EEMD) into nine intrinsic mode functions (IMFs), including IMF5 and IMF6. (A) Radial pulse from subject A (healthy older individual; 1.73 m, age 50) with ΔTnew = 0.43 sec and SInew-RP = 4.02 m/s; (B) DVP from subject A, with ΔTnew = 0.48 sec and SInew-DVP = 3.60 m/s; (C) radial pulse from subject B (type 2 diabetic patient; 1.63m, age 52) with ΔTnew = 0.28 sec and SInew-RP = 5.82 m/s; (D) DVP from subject B, with ΔTnew = 0.38 sec and SInew-DVP = 4.29 m/s. The graphs show lower ΔTnew values for the type 2 diabetic patient regardless of the signal type (radial pulse or DVP). For ease of viewing, the radial pulse and DVP signals of only 1600 samples are shown.
Figure 3. Variation in the radial pulse and DVP curve with age and diabetes. Non-stationary waveform signals were decomposed using ensemble empirical mode decomposition (EEMD) into nine intrinsic mode functions (IMFs), including IMF5 and IMF6. (A) Radial pulse from subject A (healthy older individual; 1.73 m, age 50) with ΔTnew = 0.43 sec and SInew-RP = 4.02 m/s; (B) DVP from subject A, with ΔTnew = 0.48 sec and SInew-DVP = 3.60 m/s; (C) radial pulse from subject B (type 2 diabetic patient; 1.63m, age 52) with ΔTnew = 0.28 sec and SInew-RP = 5.82 m/s; (D) DVP from subject B, with ΔTnew = 0.38 sec and SInew-DVP = 4.29 m/s. The graphs show lower ΔTnew values for the type 2 diabetic patient regardless of the signal type (radial pulse or DVP). For ease of viewing, the radial pulse and DVP signals of only 1600 samples are shown.
Jpm 12 01768 g003
Figure 4. Significant correlation between the SI measured by six-channel ECG-PWV system [7] and SI calculated using the new method based on decomposed radial pulse signals (measured by a refined air pressure sensing system) [15]. SInew-RP—SI calculated using the new method based on decomposed radial pulse signals proposed in Equation (4); SInew-DVP—SI calculated using the new method based on decomposed DVP signals proposed in Equation (4).
Figure 4. Significant correlation between the SI measured by six-channel ECG-PWV system [7] and SI calculated using the new method based on decomposed radial pulse signals (measured by a refined air pressure sensing system) [15]. SInew-RP—SI calculated using the new method based on decomposed radial pulse signals proposed in Equation (4); SInew-DVP—SI calculated using the new method based on decomposed DVP signals proposed in Equation (4).
Jpm 12 01768 g004
Table 1. Anthropometric and serum biochemical parameters of Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects (T2DM)).
Table 1. Anthropometric and serum biochemical parameters of Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects (T2DM)).
ParameterGroup 1Group 2p-Values
Gender (male/female)40 (20/20)40 (23/17)N/A
Age (years)52.45 ± 10.9957.80 ± 7.45 *0.048
Body height (cm)163.84 ± 7.83163.83 ± 7.390.994
Body weight (kg)64.08 ± 11.7273.96 ± 11.43 **<0.001
WC (cm)82.58 ± 11.4393.90 ± 10.17 **<0.001
BMI (kg/m2)23.79 ± 3.6927.54 ± 3.89 **<0.001
SBP (mmHg)121.20 ± 14.36121.65 ± 27.910.928
DBP (mmHg)75.63 ± 8.5775.30 ± 17.160.915
PP (mmHg)45.58 ± 11.9246.83 ± 15.810.691
HR (beats/min)75.19 ± 17.2287.65 ± 14.81*0.001
HDL (mg/dL)53.18 ± 17.2140.53 ± 14.97*0.001
LDL (mg/dL)120.15 ± 41.09128.45 ± 34.290.330
Cholesterol (mg/dL)175.60 ± 50.63190.83 ± 46.550.165
Triglyceride (mg/dL)97.30 ± 47.32171.23 ± 85.22 **<0.001
HbA1c (%)5.77 ± 0.348.86 ± 2.11 **<0.001
FPG (mg/dL)96.85 ± 16.08169.08 ± 48.91 **<0.001
The total number of test subjects was 80. Group 1, middle-aged asymptomatic subjects; Group 2, middle-aged type 2 diabetic subjects. WC, waist circumference; BMI, body mass index; SBP, systolic blood pressure; DBP, diastolic blood pressure; PP, pulse pressure; HR, heart rate; HDL, high-density lipoprotein cholesterol; LDL, low-density lipoprotein cholesterol; HbA1c, glycosylated hemoglobin; FPG, fasting plasma glucose. ** p < 0.001, * p < 0.05, Group 1 vs. Group 2. p values larger than 0.05 indicate differences are not statistically significant.
Table 2. Stiffness indices for large arteries (PWVfinger, SInew-RP, and SInew-DVP) in Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects).
Table 2. Stiffness indices for large arteries (PWVfinger, SInew-RP, and SInew-DVP) in Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects).
Parameter Group 1 Group 2 p-Values
PWVfinger (m/s)4.76 ± 0.455.04 ± 0.34 *0.002
SInew-RP (m/s)4.51 ± 0.495.41 ± 1.13 **<0.001
SInew-DVP (m/s)4.02 ± 0.614.74 ± 1.09 *0.001
The total number of test subjects was 80. Group 1—middle-aged asymptomatic subjects; Group 2—middle-aged type 2 diabetic patients. PWVfinger—pulse wave velocity, measured by the PWV-ECG system [7]; SInew-RP—SI calculated using the new method based on decomposed radial pulse signals proposed in Equation (4); SInew-DVP—SI calculated using the new method based on decomposed DVP signals proposed in Equation (4). ** p < 0.001, * p < 0.05, Group 1 vs. Group 2. p values lower than 0.05 indicate differences are statistically significant.
Table 3. (A). One-way analysis of variance for the three indices (PWVfinger, SInew-RP, and SInew-DVP) applied to Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects). (B). Fisher’s LSD post hoc test for the three indices (PWVfinger, SInew-RP, and SInew-DVP) applied to Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects).
Table 3. (A). One-way analysis of variance for the three indices (PWVfinger, SInew-RP, and SInew-DVP) applied to Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects). (B). Fisher’s LSD post hoc test for the three indices (PWVfinger, SInew-RP, and SInew-DVP) applied to Group 1 (healthy middle-aged subjects) and Group 2 (type 2 diabetic subjects).
(A)
IndexNMeanSD
PWVfinger804.90 m/s0.42 m/s
SInew-RP804.96 m/s0.98 m/s
SInew-DVP804.38 m/s0.95 m/s
Total 2404.75 m/s0.86 m/s
Source of VarianceSum of SquaresdfMean SquareF-ratiop-value
Between groups16.45528.22712.112<0.001
Within groups160.9872370.679--
Total177.441239---
(B)
Multiple ComparisonsNMeanMean Differencep-Value
PWVfinger vs. SInew-RP80 vs. 804.90 vs. 4.96 m/s−0.0580.658
PWVfinger vs. SInew-DVP80 vs. 804.90 vs. 4.38 m/s0.524 **<0.001
SInew-RP vs. SInew-DVP80 vs. 804.96 vs. 4.38 m/s0.582 **<0.001
** Significant at 0.001 level; p < 0.001. PWVfinger—pulse wave velocity, measured by the PWV-ECG system [7]; SInew-RP—SI calculated using the new method based on decomposed radial pulse signals proposed in Equation (4); SInew-DVP—SI calculated using the new method based on decomposed DVP signals proposed in Equation (4).
Table 4. Correlations between SInew-RP/SInew-DVP and age, body weight, waist circumference, glycosylated hemoglobin, cholesterol, and triglyceride.
Table 4. Correlations between SInew-RP/SInew-DVP and age, body weight, waist circumference, glycosylated hemoglobin, cholesterol, and triglyceride.
ParameterSInew-RPSInew-DVP
Ager = 0.415 (p < 0.001)r = 0.439 (p < 0.001)
Body weightr = 0.257 (p = 0.041)r = 0.233 (p = 0.038)
Waist circumferencer = 0.281 (p = 0.012)r = 0.273 (p = 0.014)
Glycosylated hemoglobinr = 0.400 (p < 0.001)r = 0.365 (p = 0.001)
Cholesterolr = 0.219 (p = 0.051)r = 0.229 (p = 0.041)
Triglycerider = 0.333 (p = 0.003)r = 0.307 (p = 0.006)
SInew-RP—SI calculated using the new method based on decomposed radial pulse signals proposed in Equation (4); SInew-DVP—SI calculated using the new method based on decomposed DVP signals proposed in Equation (4).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wu, H.-T.; Chen, J.-J. Calculation of an Improved Stiffness Index Using Decomposed Radial Pulse and Digital Volume Pulse Signals. J. Pers. Med. 2022, 12, 1768. https://doi.org/10.3390/jpm12111768

AMA Style

Wu H-T, Chen J-J. Calculation of an Improved Stiffness Index Using Decomposed Radial Pulse and Digital Volume Pulse Signals. Journal of Personalized Medicine. 2022; 12(11):1768. https://doi.org/10.3390/jpm12111768

Chicago/Turabian Style

Wu, Hsien-Tsai, and Jian-Jung Chen. 2022. "Calculation of an Improved Stiffness Index Using Decomposed Radial Pulse and Digital Volume Pulse Signals" Journal of Personalized Medicine 12, no. 11: 1768. https://doi.org/10.3390/jpm12111768

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop