Next Article in Journal
Effect of the Particle Size Distribution of Irregular Al Powder on Properties of Parts for Electronics Fabricated by Binder Jetting
Previous Article in Journal
A Location and Velocity Prediction-Assisted FANET Networking Scheme for Highly Mobile Scenarios
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

CEEMDAN-ICA-Based Radar Monitoring of Adjacent Multi-Target Vital Signs

1
Beijing Institute of Technology Chongqing Innovation Center, Chongqing 401120, China
2
Chongqing Key Laboratory of Novel Civilian Radar, Chongqing 401120, China
3
School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China
4
Key Laboratory of Electronic and Information Technology in Satellite Navigation (Beijing Institute of Technology), Ministry of Education, Beijing 100081, China
*
Author to whom correspondence should be addressed.
Electronics 2023, 12(12), 2732; https://doi.org/10.3390/electronics12122732
Submission received: 10 May 2023 / Revised: 14 June 2023 / Accepted: 17 June 2023 / Published: 19 June 2023
(This article belongs to the Section Bioelectronics)

Abstract

:
In recent years, radar, especially frequency-modulated continuous wave (FMCW) radar, has been extensively used in non-contact vital signs (NCVS) research. However, current research does not work when multiple human targets are close to each other, especially when adjacent human targets lie in the same resolution cell. In this paper, a novel method based on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN)–independent component analysis (ICA) was proposed to obtain the vital-sign information (including respiratory rate and heart rate) of adjacent human targets by using a single FMCW radar. Firstly, the data observed at a single angle were decomposed by the CEEMDAN separation algorithm to construct virtual multi-angle observations. It can effectively transform the undetermined blind source separation (UBSS) problem into an overdetermined blind source separation (BSS) problem. Thus, a BSS algorithm based on FastICA can be used to reconstruct each person’s vital-sign signal and then calculate their respiratory rate/heart rate. To validate the effectiveness of the proposed method, experiments based on the measured data were conducted and the results show that the proposed method can obtain multi-target vital-sign information even when they are in the same resolution cell.

1. Introduction

An individual’s vital signs, especially respiration rate (RR) and heart rate (HR), are important indicators of the physical health of high-risk groups, such as those with cardiovascular diseases, elders at home, infants, etc. In addition, such micro-movement information can also be used for personal recognition due to its uniqueness [1]. Many types of equipment have been developed to monitor vital signs. One of the most popular observation systems is the frequency-modulated continuous wave (FMCW) radar, which overcomes privacy issues and can meet the needs of long-term real-time observation.
Numerous studies have been conducted to improve the performance of vital signs measurement by FMCW radar. Anitori et al. found that the respiratory and heartbeat information can be calculated from the FMCW signal’s phase [2]. On this basis, a hybrid radar system that combines the linear-frequency-modulated continuous-wave (LFMCW) mode and the interference measurement mode was developed to continuously track individuals’ vital signs within complex indoor environments [3]. Adib et al. proposed a vital-radio technology to increase the vital sign detection range [4]. In addition, to separating different vital signs with high accuracy, a dual-parameter least mean square (LMS) filter [5], a compressive sensing based on the orthogonal matching pursuit (CS-OMP) method, and a rigrsure adaptive soft threshold noise reduction based on discrete wavelet transform (RA-DWT) [6] were proposed. However, these methods are only applicable to a single human target and would fail when there are multiple targets.
Since actual application scenarios often involve multiple targets, researchers have improved the methods for separating different targets before vital sign measurement. There are two main methods for multi-target vital-sign monitoring. One is based on target distance information and the other is based on target azimuth information. Lee et al. proposed a target separation method by improving distance resolution [7]. However, they were still unable to separate the vital sign signals of multiple targets located in the same range cell.
In order to separate targets in the same range cell, it is necessary to estimate the angle-of-arrival (AOA) of different targets. This technique can be further divided into hardware-based methods [7,8,9,10,11,12,13] and software-based methods [14,15,16,17]. Hardware-based methods obtain non-contact vital signs information by designing the radar hardware structure. For example, a mechanical scanning (MS)-based solution achieves beam scanning by rotating the radar antenna. In [9], Islam separated the respiration signals by rotating the radar module and used independent component analysis with joint approximate diagonalization of the eigenmatrices algorithm (ICA-JADE) to separate the respiration signals of two targets located within the beam width. Nosrati et al. developed a 2.4 GHz dual-beam phased array continuous wave multi-input multi-output (MIMO) radar, which use phase shifters for controlling the phase of each receiving channel [13]. In [12], Mingle et al. designed a bidirectional leaky wave antenna (LWA) with beam scanning.
The above methods require prior knowledge of the angle of the measured target. Therefore, software-based methods, such as digital beamforming (DBF), are proposed. The DBF technique multiplies each channel with a weight vector during signal processing to boost the signal strength in a certain direction. Ahmad et al. proposed an FMCW radar featuring three transmitting antennas and four receiving antennas for detecting the respiration signals of multiple people [14]. Xiong et al. proposed a method based on CW radar for the detection of the respiration signals of multiple targets located in the same distance bin [17]. This method estimates the direction-of-arrival (DOA) to obtain the number and angle of each target and then uses adaptive DBF (ADBF) technology to extract respiration signals for specific targets. Kakouche et al. proposed the incoherent signal subspace method (ISSM) and linearly constrained minimum variance (LCMV), which realize a respiratory rate error of about 2% [16]. Additionally, Dang et al. sued an IR-UWB radar and proposed an optimization algorithm, CIR-SS, based on the channel impulse response (CIR) smoothing spline method, achieving through-wall multi-person NCVS detection with an average accuracy of 92.20% [15].
However, these methods can only separate multi-target vital signs that are far away from each other. That is, existing methods cannot be used to detect the vital signs of a couple or a new mother sleeping with her infant in the same bed. The separation of multi-target vital signs with close distances and inseparable azimuth angles still requires further research. When multiple targets cannot be distinguished in the space domain, signal separation can be considered from the signal domain, and the method of blind source separation can be introduced. Qiao et al. achieved the separation of micro-Doppler signals by using short-time fractional Fourier transform (STFrFT) and morphological component analysis (MCA) [18]. Yue et al. designed the DeepBreath system, a radio frequency (RF)-based respiratory monitoring system that can separate respiratory signals even when multiple targets are adjacent [19]. Nevertheless, this system failed to separate multi-target heartbeat signals and relied on the size of the antenna array.
To solve the above problems, this paper proposed a multi-target vital sign monitoring method based on CEEMDAN-ICA, which can separate targets in the same resolution cell with a single FMCW radar. The method models the multi-target vital sign monitoring problem as a blind source separation (BSS) problem, and fully utilizes the different frequency characteristics of different people to convert the underdetermined blind source separation (UBSS) problem into an overdetermined one, enabling the separation of human bodies with only a single radar. Firstly, this method adopts the complete ensemble empirical mode decomposition algorithm (CEEMDAN) to pre-separate the echo signal. The decomposition results can be regarded as virtual multi-angle observations. Then, the FastICA algorithm was used to separate each person’s vital sign signal and calculate their respiratory rate/heart rate based on the spectrum’s peak value. Finally, the experimental results show that the proposed method can obtain the multi-target vital sign information even when targets are in the same resolution cell and have high separation accuracy. This paper’s contributions are as follows.
1. This paper proposed a multi-target vital-sign signal processing framework that can accurately separate each person’s signal even when the people are in the same resolution cell. Compared with traditional methods with a single radar that can only extract single-target information, this method can extract both respiratory rate and heart rate for each person simultaneously.
2. This paper proposed a multi-target vital-sign separation method based on CEEMDAN-ICA. The method innovatively uses the CEEMDAN algorithm to reconstruct multiple angle observations, allowing accurate signal separation with only a single radar system.
The structure of this paper is as follows. Section 2 introduces the multi-target vital signs echo signal model. Section 3 presents the proposed method based on CEEMDAN-ICA for multi-target vital signs detection. Section 4 provides the experimental data processing results and compares different algorithms to demonstrate the superiority of the proposed algorithm. The conclusion is in Section 5.

2. Modeling Mixtures of Multi-Target Vital Signs Echo Signal

Consider that there are P stationary human targets at distances R 0 , 1 , R 0 , 2 , , R 0 , P . For the p-th human target, the FMCW radar echo intermediate frequency (IF) signal can be expressed as:
s p ( t ) = A I F , p exp [ j ( 2 π 2 K R p ( t ) c t + 4 π R p ( t ) λ c ) ] ,
R p ( t ) = R 0 , p + x p ( t ) ,
where x p ( t ) is the chest displacement information of the p-th human target, which contains the information of human breathing and heartbeat movement. Generally, it can be approximated as a sine function:
x p ( t ) = A R , p sin ( 2 π f R , p t ) + A H , p sin ( 2 π f H , p t ) ,
where A R , p , A H , p are the respiration and heartbeat movement amplitudes of the p-th human target and f R , p , f H , p are the respiration rate and heart rate of the p-th human target, respectively.
The frequency response of the IF signal is:
h ( R ( t ) , f ) = A I F , p T c exp ( j 2 π f c K c f ) s i n c ( R p ( t ) c 2 B + T c f ) exp ( 2 π j ( f c B + 1 2 ) ( R p ( t ) c 2 B + T c f ) ) ;
therefore, the frequency domain of the IF signals of P targets can be expressed as:
H ( R ( t ) , f ) = i = 1 P h ( R i ( t ) , f ) .
From (4) and (5), it can be seen that, when there are multiple targets in the scene, the function H ( R ( t ) , f ) cannot be expressed as a linear sum of P independent components. Expanding h ( R i ( t ) , f ) to h ( R 0 , i + x i ( t ) , f ) . Using Taylor series to first-order terms, it can be approximated as
h ( R i ( t ) , f ) = h ( R 0 , i , f ) + x i ( t ) h ( R 0 , i , f ) ,
where h ( R 0 , i , f ) is the derivative with respect to range domain. Therefore, the total frequency response of P independent sources (human echo signal) is:
H ( R ( t ) , f ) = i = 1 P h ( R 0 , i , f ) + i = 1 P h ( R 0 , i , f ) x i ( t ) .
The first term of (7) is just the average frequency response of all sweep time units. So, we can subtract the first term from the model without affecting the vital signs signal. The second term of (7) can be regarded as the model of the BSS method, since x i ( t ) is not related to the frequency f and h ( R 0 , i , f ) corresponds to the mixing coefficient for each f.

3. Multi-Target Vital Signs Detection Method Based on CEEMDAN-ICA

The general ICA method cannot solve the UBSS problem (i.e., the number of receiving channels is less than that of source signals) but can only solve the overdetermined or positively determined situations. In this section, the CEEMDAN method was used to pre-separate the signal. After that, the intrinsic mode functions (IMF) components with a frequency in the range of 0.15–2.0 Hz (i.e., the effective vital sign frequency) were screened to establish a virtual multi-channel, so the UBSS problem can be transformed into an overdetermined/positive one. Then, the FastICA algorithm was used to separate the breathing and heartbeat signals of multi-human targets. The flowchart is shown in Figure 1.

3.1. Background Clutter Cancellation

3.1.1. Background Clutter Cancellation

For the convenience of subsequent signal processing, the radar echo data need to be reconstructed first. The FMCW millimeter-wave radar echo data were reshaped into a matrix D ( n , m ) according to the received order of chirps, where n is the fast-time point (i.e., the number of analog-to-digital converter (ADC) sampling points in each chirp), which correspond to the chirp cycle Tc and m is the slow-time point (i.e., the number of frames), which correspond to the frame cycle Tm.
In actual scenarios, there may exist some random environmental noise and some stationary irrelevant targets, such as walls, tables, and chairs. To eliminate the influence of background/stationary clutter, this paper adopted clutter cancellation: the unmanned scene echo D 0 ( n , m ) was subtracted from the processed echo matrix D ( n , m ) :
D ( n , m ) = D ( n , m ) D 0 ( n , m ) .
This can greatly weaken the influence of background stationary targets.

3.1.2. Range-Bin Selection

The range profile information H ( k , m ) of the target can be obtained by performing K-point fast Fourier transform (FFT) on the discrete radar data in the range direction, where k is the FFT point and the position of the peak of the spectrum reflects the distance of the target. According to (7), the average frequency response is obtained for the multi-frame range image information and the reconstructed signal that can be applied to ICA can be calculated as:
H I C A ( k , m ) = H ( k , m ) 1 M m = 1 M H ( k , m ) .
To effectively extract the phase containing human thoracic displacement information, it is of great necessity to select the effective range cell where the human body is located. As in (10), the energy of data at the same range-bin in each frame (also each chirp) are superimposes and those which have the highest energy are selected. By extracting all the k 0 range-bin of each frame, a slow-time signal containing human respiration and heartbeat information can be formed as (11).
k 0 = max ( i = 1 M | H ( k , i ) | 2 )
M ( m ) = H I C A ( k 0 , m ) .

3.1.3. Phase Extraction

We can find from (1) that the phase of the intermediate frequency (IF) signal in the radar backscatter contains information on the displacement of the human chest moving (physiological signal). Therefore, the slow-time signal’s phase can be written as:
M ( m ) = 4 π R 0 + x ( m T m ) λ c = 4 π λ c x ( m T m ) + ϕ 0 .
The phase angle radians of each slow-time data can be calculated by:
θ ( m ) = arctan ( Im ( M ( m ) ) Re ( M ( m ) ) ) ,
where Re ( M ( m ) ) and Im ( M ( m ) ) are the real and imaginary parts of M ( m ) , respectively.
However, phase wrapping may occur during calculation, so it is necessary to correct, also called phase unwrapping. Specifically, when the absolute value of the phase difference between the current and the previous frames is greater than π , the phase difference was subtracted or added to obtain a new difference whose absolute value was less than π . The previous phase was then added to the new difference value to obtain the phase with unwrapping:
θ ( m + 1 ) = { θ ( m + 1 ) ,   θ ( m + 1 ) + 2 π , θ ( m + 1 ) 2 π , i f π θ ( m + 1 ) θ ( m ) π   i f   θ ( m + 1 ) θ ( m ) < π   i f   θ ( m + 1 ) θ ( m ) > π .
As can be seen from (12), the directly calculated phase signal still has a direct current (DC) bias due to the human distance from the radar. To eliminate the DC bias, a first-order difference method can be used, also known as phase difference, that is, subtracting the previous phase from the current phase:
x ( m ) = θ ( m + 1 ) θ ( m ) ,
where x ( m ) is the phase signal containing the human chest movement (respiratory and heartbeat) information. In addition, phase difference can also enhance the amplitude of the heartbeat signal.
The ratio of the amplitude of the heart rate signal to the respiratory signal amplitude in (3) is:
A H , p A R , p .
Taking the first-order difference of the physiological signal model, we can get:
Δ x p ( m T m ) = 2 π f R , p A R , p cos ( 2 π f R , p m T m ) + 2 π f H , p A H , p cos ( 2 π f H , p m T m ) .
At this time, the ratio of the heart rate signal amplitude to the respiratory signal amplitude becomes:
2 π f H , p A H , p 2 π f R , p A R , p = f H , p f R , p · A H , p A R , p .
Comparing (18) with (16), it can be seen that the ratio has more coefficients. Since the heart rate frequency is generally in the range of 0.8–2.0 Hz and the respiratory rate is in the range of 0.15–0.5 Hz, this coefficient is greater than 1.6, indicating that the heart rate signal is enhanced compared to the respiratory signal

3.2. Virtual Multi-Channel Construction

3.2.1. Respiratory/Heart Rate Signal Separation

The respiratory rate of adults is generally within the range of 0.1–0.5 Hz and the heart rate is within the range of 0.8–2.0 Hz. Therefore, separating the respiratory and heart rate signals only requires designing corresponding bandpass filters. General digital filters are mainly divided into finite impulse response (FIR) filters and infinite impulse response (IIR) filters. Considering the low complexity of respiratory/heartbeat signals and focus on amplitude-frequency characteristics, this article selects IIR filters, which have a faster calculation speed.
Commonly used IIR filter design methods include Butterworth, Chebyshev type I, Chebyshev type II, and elliptic. From these four design methods, four different IIR bandpass filters were designed for respiratory and heartbeat signals. Compared to high-order filters, low-order filters can better compromise the performance and robustness of the system and are easy to implement. To reduce calculation complexity, a 6th-order IIR filter with a passband of 0.15–0.6 Hz was designed for respiratory signals and an 8th-order IIR filter with a passband of 0.8–2.0 Hz was designed for heartbeat signals. The magnitude response of the designed filters is shown in Figure 2.
Based on the comparison of the magnitude response chart, it can be found that the Chebyshev type II passband is more stable but too narrow, while the Butterworth type is stable but with a wider transition band. Although Chebyshev type I and elliptic passbands have fluctuations, they are wider, and the roll-off speed is faster. The elliptic type has a faster roll-off speed than the Chebyshev type I, so the elliptic type IIR filter is selected.

3.2.2. Virtual Multi-Channel Construction Based on CEEMDAN

The complete EEMD with adaptive noise (CEEMDAN) algorithm is a new signal decomposition algorithm that solves the mode mixing phenomenon of the empirical mode decomposition (EEMD) [20]. The principle of the CEEMDAN method is to add white noise (or IMF components with white noise) to the residual after obtaining the first-order IMF component, and to iterate by taking the mean of the IMF component at this time. In this paper, CEEMDAN was used to separate the mixed signal to obtain multiple IMF components and then screen them to construct a virtual multi-channel. This method sequentially processed the filtered signal obtained in the previous section, and the processing steps were as follows.
Step 1: Add Gaussian white noise with a mean of 0 and an amplitude of ε to the signal to be decomposed, such as (19), to construct the I signals to be decomposed.
x i ( m ) = x ( m ) + ε δ i ( m ) , i = 1 , 2 , , I . ;
Step 2: Perform empirical mode decomposition (EMD) decomposition on x i ( m ) in Step 1 to obtain the first IMF component and take the average as the first IMF component of CEEMDAN, such as (20), where I M F 1 ( m ) is the first IMF component and r 1 ( m ) is the residual signal after the first decomposition.
I M F 1 ( m ) = 1 I i = 1 I I M F 1 i ( m )   r 1 ( m ) = x ( t ) I M F 1 ( m ) ;
Step 3: Add specific noise to the residual signal decomposed after the kth iteration and continue to EMD decomposition, such as (21), where I M F k ( m ) is the kth IMF component obtained by CEEMDAN decomposition; E k 1 ( · ) is the k − 1th IMF component obtained by EMD decomposition; ε k 1 is the coefficient of adding noise to the residual signal during the k − 1th iteration of CEEMDAN; and r k ( m ) is the residual signal after the kth iteration.
I M F k ( m ) = 1 I i = 1 I E 1 ( r k 1 ( t ) + ε k 1 E k 1 ( δ i ( m ) ) )   r k ( m ) = r k 1 ( m ) I M F k ( m ) ;
Step 4: If the residual signal r k ( m ) after the Kth decomposition is a monotonic signal, stop the iteration. If it is not satisfied, return to Step 3;
Step 5: The obtained IMFs are used to perform FFT and obtain the peak value to obtain the IMF frequency. Selecting IMFs with a frequency in the 0.15–0.6 Hz range for multi-human respiratory signals separation, and IMFs with a frequency in the 0.8–2.0 Hz for multi-human heartbeat signals separation. This Step can reduce the dimensions of IMFs and can also remove low/high frequency noise.
After the above steps, virtual multi-channels containing breathing/heartbeat information of multiple people can be constructed.

3.3. Vital Signs Signal Separation Based on FastICA

To obtain breathing/heartbeat information for each individual, an independent component analysis (ICA) can be performed on the mixed signal. Before applying the ICA algorithm to the data, a series of preprocessing steps can be performed to simplify the calculations, including centering and whitening.
Centering is performed to simplify the ICA algorithm; the data can be zero-centered, i.e., the mixed data are subtracted from its mean vector.
Whitening is a linear transformation of the observed mixed variables x, resulting in a whitened vector x ˜ with unit variance and uncorrelated components. The covariance matrix is a unit matrix, i.e., E { x ˜ x ˜ T } = I . The commonly used whitening method is eigenvalue decomposition (EVD), and the data can be whitened as:
        x ˜ = E D 1 / 2 E T x D 1 / 2 = d i a g ( d 1 1 / 2 , d 2 1 / 2 , , d n 1 / 2 ) ,
where E is the orthogonal matrix of the eigenvectors of the covariance matrix, d i is the eigenvalue.
Whitening can reduce the number of parameters to be estimated, which leads to reducing the complexity of the ICA problem. Additionally, whitening can also reduce the noise effect and prevent overfitting by reducing the dimensionality of the data during the whitening process.
The principle of FastICA is to find a vector w that makes w T x , owning the most non-Gaussianity [21]. The basic steps of univariate FastICA are as follows:
Step 1: Select an initial (random) weight vector w;
Step 2: Let w + = E { x g ( w T x ) } E { g ( w T x ) } w , where g ( u ) = u 3 ;
Step 3: Let w = w + / w + ;
Step 4: If convergent, i.e., the dot product of new and old w (almost) equals 1, end step, otherwise return to Step 2.
When estimating several independent components, the output after each iteration ( w 1 T x , w 2 T x , , w n T x ) needs to be decorrelated to prevent these vectors from converging to the same maximum value. The simplest decorrelation method is the scaling method based on the Gram–Schmidt procedure, i.e., when estimating w p + 1 , subtract the projection of the already-estimated p vectors w 1 , w p , , w p , and then normalize it.
Combining the above decorrelation algorithm with the univariate FastICA algorithm yields the multivariate FastICA algorithm, whose flowchart is shown in Figure 3. The independent components obtained by FastICA are the required respiratory/heartbeat signals of multiple people. Then, the respiration rate/heartbeat rate of each person can be obtained by performing FFT on each component and taking the peak value.

4. Experimental Analysis

4.1. Equipment Introduction

This study used the AWR1642BOOST-ODS radar device [22] and the DCA100 evaluation module (EVM) produced by Texas Instruments (TI). The device is shown in Figure 4.
The AWR1642BOOST-ODS radar parameters were set as shown in Table 1. In addition, the AWR1642BOOST-ODS was configured with two transmitting antennas and four receiving antennas. When the system operated in time-division multiplexing (TDM) MIMO mode, a non-uniform composite array composed of eight antennas was virtually generated [23]; this study only applied its four horizontal channels.
In order to verify the validity and accuracy of the separation and extraction of vital signs, it is necessary to make use of other equipment that can accurately measure human breathing and heartbeat signals in the medical field. This study selected two relatively accurate contact-type devices: an abdominal belt respiratory sensor (HKH-11C) [24] and an infrared pulse sensor (HKG-07C) [25], respectively, for collecting reference signals for breathing and heartbeat.

4.2. Scene Setup and Data Acquisition

If there were two people nearby each other in the scenario, with a distance of 1.5 m from the radar, the scene was as shown in Figure 5. The receiving information of multiple channels of a single radar was used. Due to the size of the human body—for example, the shoulder width of an adult is about 36 cm—when two people sit side by side facing the radar at a distance of 1.5 m, the length across the radial distance of the radar is about 4.25 cm, which is smaller than the distance resolution of the radar used in this study, which was 5.58 cm. As shown in Figure 6, at this time, the two people were located in the same distance resolution unit and could not be distinguished from the spatial envelope, which means that the traditional methods based on the distance dimension or based on DOA were no longer applicable.

4.3. Results and Analysis

4.3.1. Simple Scenario

For the simplest scene where two people faced the radar side by side, the method proposed in this paper was compared with the algorithms from other literature. Figure 6 shows the mixed respiratory signal of multiple people extracted from different radar channels and Figure 7 shows the separation result of different methods.
It can be seen that the spatial arrangement of the radar antennas used in this study was too close, which led to the signals of different channels being similar: the time domain of the four channels’ mixed respiratory signals appear to have consistent ups and downs and highly consistent periods, as well as also being concentrated in the same frequency band in the frequency domain. The ICA method proposed in [19] and the ICA-JADE method proposed in [26] failed to separate the respiratory signals of two people, as Figure 7a shows: the two-way (R1 and R2) results output by these two methods are highly consistent. The CEEMDAN-ICA method was proposed in this paper to solve this problem of the lack of effective channels. As shown in Figure 7, the proposed method successfully separated two completely different signals.
Next, we compared one of the results of the scene where two people were side by side, as shown in Figure 8a,c, with the reference signal. In Figure 8, the following can be observed from the trends of the respiratory time-domain waveforms of the two results and the corresponding reference signals: the first result, respiration CEEMDAN-ICA(T1), can fit well with target 1′s reference respiratory waveform, that is, the result is valid and reliable. At the same time, the second result does not fit well with the reference respiration signal of target 2 in the period of 5 to 10 s. However, looking at the entire period, the peak values of the separated signal are equal to those of the reference signal and, at the same time, the peak values of these two are also very close in the frequency domain. The main method of general vital sign detection equipment to estimate the value of specific signs is to calculate the number of peaks within a period of time (peak counting method) or to take the frequency of the peak of the spectrum (spectrum method). As shown by the experimental results displayed in Figure 8, the frequencies of the respiratory signals of the two targets separated by the CEEMDAN-ICA method are 0.55 Hz and 0.4 Hz and the frequencies of the heartbeat signals are 1.13 Hz and 1.03 Hz, respectively. Comparing the estimation results with the reference signals, the absolute value errors of the respiratory rates of the two targets are 1.02 breaths/minute and 1.38 breaths/minute, and the absolute value errors of the heart rates are 3.6 beats/minute and 0.6 beats/minute. Table 2 shows the respiration and heartbeat estimation results and errors of five experiments of the proposed CEMDAN-ICA method in the simple scene shown in Figure 8a,c. At this time, it can be calculated that the average breathing error is 1.24 breaths/minute and the average heartbeat error is 2.63 beats/minute.

4.3.2. Scenarios of Subjects with Different Orientations

This paper set up multiple experimental scenarios to verify the effectiveness of the algorithm. In addition to the simple experimental scene (that is, two people sitting side by side and facing the radar), as shown in Figure 8a,c, we added three other scenes: one person facing the radar and the other at a 45° angle side facing the radar, which is shown in Figure 9a,c; one person facing the radar and the other facing the radar at a 90° angle, which is shown in Figure 10a,c; two people facing the radar at −90° and 90°, respectively, that is, two people back to back and facing the radar sideways, which is shown in Figure 11a,c.
Comparing the three scenarios in Figure 9, Figure 10 and Figure 11, it can be seen that the time-domain waveforms of breathing or heartbeat obtained in all scenarios can fit well with the reference waveform, which proves the effectiveness and reliability of the algorithm. It is worth mentioning that, generally, the human body facing the radar is the most ideal scene for breathing and heartbeat extraction. In the scene in Figure 11, two people are facing the radar back-to-back. At this time, the spectral width of breathing obtained by comparing different scenes does not change much. However, the spectral width of the heartbeat is narrowed. This may be because, when the human body is turned sideways, the breathing amplitude detected by the radar becomes smaller, that is, the heartbeat amplitude will be more obvious. At the same time, in the scene where the left side of the body is close to the target of the radar—here it is target 2, since the heart is located on the left side of the body—the heartbeat information will be more obvious, and it can be seen that the spectrum of T2 is indeed narrower. Above all, we can see that the method proposed in this paper can effectively separate the respiratory and heartbeat signals of two people in different scenarios.
In order to analyze the reliability of the results, the concept of mean accuracy is introduced:
Accuracy = 1 N i = 1 N ( 1 | e i g i | e i ) × 100 % ,
where ei is the estimated rate from the proposed method, gi is the ground truth frequency, which is obtained by the respiratory belt or infrared pulse sensor, and N is the number of experiments.
Table 3 shows the mean respiration rate (RR) accuracy and mean heartbeat rate (HR) accuracy obtained in the experiments of the two-person scene. It can be seen that, in the four experimental scenes, the method proposed in this paper successfully separated the respiration and heartbeat signals of two people. The accuracy of the extracted vital sign signals is the highest in the scene where the two people face the radar side by side. At this time, the mean RR accuracies of target 1 and target 2 are 95.55% and 94.99%, and the mean HR accuracies are 98.18% and 97.01%. However, when the two targets face the radar back to back from the (−90°, 90°) orientation, the accuracy drops. The RR and HR accuracy of Target1 drops to 88.94% and 93.82%, respectively. In the scene where the human body is not directly facing the radar, the accuracy will decrease. This is mainly due to the change in the detectable amplitude of the human chest displacement in different orientations. By averaging the results of all experimental scenarios, the overall mean accuracy for the breathing and heartbeat of the method proposed in this paper is 92.24%.

5. Conclusions

This paper proposed a radar multi-target vital signs detection method based on CEEMDAN-ICA, which overcomes the limitation of detecting vital signs of each human target when multiple human targets exist within the same range and angular resolution cell. The proposed method fully utilizes the motion information of the human body, converts the human chest motion features into virtual multi-angle observation results using the CEEMDAN algorithm, and then applies the FastICA algorithm to obtain the breathing rate/heart rate of each individual. The processed experimental data results show that only the proposed method can obtain multiple targets’ vital signs detection results within the same resolution cell. Four different adjacent multi-target scenarios were tested and the experiments proved that the proposed method achieves a 92.24% accuracy for respiratory rate and a 96.77% accuracy for heart rate signal detection.

Author Contributions

X.D. and Y.F. had the research idea, were involved in the research design and contributed to revising the manuscript. Y.F. and C.C. performed the simulation and wrote this manuscript. Y.F., C.C. and J.L. contributed to revising and improving the research. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded in part by the Distinguished Young Scholars of Chongqing (Grant No. cstc2020jcyj-jqX0008) and the Postdoctoral Science Foundation of Chongqing in China (2022NSCQ-BHX5720).

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Qiao, X.; Li, G.; Shan, T.; Tao, R. Human activity classification based on moving orientation determining using multistatic micro-Doppler radar signals. IEEE Trans. Geosci. Remote Sens. 2021, 60, 5104415. [Google Scholar] [CrossRef]
  2. Anitori, L.; de Jong, A.; Nennie, F. FMCW radar for life-sign detection. In Proceedings of the 2009 IEEE Radar Conference, Pasadena, CA, USA, 4–8 May 2009; pp. 1–6. [Google Scholar]
  3. Wang, G.; Gu, C.; Inoue, T.; Li, C. A hybrid FMCW-interferometry radar for indoor precise positioning and versatile life activity monitoring. IEEE Trans. Microw. Theory Tech. 2014, 62, 2812–2822. [Google Scholar] [CrossRef]
  4. Adib, F.; Mao, H.; Kabelac, Z.; Katabi, D.; Miller, R.C. Smart Homes that Monitor Breathing and Heart Rate. In Proceedings of the Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea, 18 April 2015; pp. 837–846.
  5. He, M.; Nian, Y.; Gong, Y. Novel signal processing method for vital sign monitoring using FMCW radar. Biomedical Signal Process. Control 2017, 33, 335–345. [Google Scholar] [CrossRef]
  6. Wang, Y.; Shui, Y.; Yang, X.; Li, Z.; Wang, W. Multi-target vital signs detection using frequency-modulated continuous wave radar. EURASIP J. Adv. Signal Process. 2021, 2021, 103. [Google Scholar] [CrossRef]
  7. Islam, S.M.; Yavari, E.; Rahman, A.; Lubecke, V.M.; Boric-Lubecke, O. Multiple subject respiratory pattern recognition and estimation of direction of arrival using phase-comparison monopulse radar. In Proceedings of the 2019 IEEE Radio and Wireless Symposium (RWS), Orlando, FL, USA, 20–23 January 2019; pp. 1–4. [Google Scholar]
  8. Hsu, C.-Y.; Chuang, C.-Y.; Wang, F.-K.; Horng, T.-S.; Hwang, L.-T. Detection of vital signs for multiple subjects by using self-injection-locked radar and mutually injection-locked beam scanning array. In Proceedings of the 2017 IEEE MTT-S International Microwave Symposium (IMS), Honololu, HI, USA, 4–9 June 2017; pp. 991–994. [Google Scholar]
  9. Islam, S.M.; Boric-Lubecke, O.; Lubekce, V.M. Concurrent respiration monitoring of multiple subjects by phase-comparison monopulse radar using independent component analysis (ICA) with JADE algorithm and direction of arrival (DOA). IEEE Access 2020, 8, 73558–73569. [Google Scholar] [CrossRef]
  10. Lu, C.; Yuan, Y.; Tseng, C.-H.; Wu, C.-T.M. Multi-target continuous-wave vital sign radar using 24 GHz metamaterial leaky wave antennas. In Proceedings of the 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC), Nanjing, China, 6–8 May 2019; pp. 1–4. [Google Scholar]
  11. Mercuri, M.; Sacco, G.; Hornung, R.; Zhang, P.; Visser, H.J.; Hijdra, M.; Liu, Y.-H.; Pisa, S.; van Liempd, B.; Torfs, T. 2-D localization, angular separation and vital signs monitoring using a SISO FMCW radar for smart long-term health monitoring environments. IEEE Internet Things J. 2021, 8, 11065–11077. [Google Scholar] [CrossRef]
  12. Mingle, S.; Kampouridou, D.; Feresidis, A. Bidirectional Leaky-Wave Antenna Based on Dielectric Image Line for Remote Vital Sign Detection at mm-Wave Frequencies. IEEE Open J. Antennas Propag. 2022, 3, 1003–1012. [Google Scholar] [CrossRef]
  13. Nosrati, M.; Shahsavari, S.; Lee, S.; Wang, H.; Tavassolian, N. A concurrent dual-beam phased-array Doppler radar using MIMO beamforming techniques for short-range vital-signs monitoring. IEEE Trans. Antennas Propag. 2019, 67, 2390–2404. [Google Scholar] [CrossRef]
  14. Ahmad, A.; Roh, J.C.; Wang, D.; Dubey, A. Vital signs monitoring of multiple people using a FMCW millimeter-wave sensor. In Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA, 23–27 April 2018; pp. 1450–1455. [Google Scholar]
  15. Dang, X.; Zhang, J.; Hao, Z. A Non-Contact Detection Method for Multi-Person Vital Signs Based on IR-UWB Radar. Sensors 2022, 22, 6116. [Google Scholar] [CrossRef] [PubMed]
  16. Kakouche, I.; Abadlia, H.; El Korso, M.N.; Mesloub, A.; Maali, A.; Azzaz, M.S. Joint Vital Signs and Position Estimation of Multiple Persons Using SIMO Radar. Electronics 2021, 10, 2805. [Google Scholar] [CrossRef]
  17. Xiong, J.; Hong, H.; Zhang, H.; Wang, N.; Chu, H.; Zhu, X. Multitarget respiration detection with adaptive digital beamforming technique based on SIMO radar. IEEE Trans. Microw. Theory Tech. 2020, 68, 4814–4824. [Google Scholar] [CrossRef]
  18. Qiao, X.; Shan, T.; Tao, R.; Bai, X.; Zhao, J. Separation of human micro-Doppler signals based on short-time fractional Fourier transform. IEEE Sens. J. 2019, 19, 12205–12216. [Google Scholar] [CrossRef]
  19. Yue, S.; He, H.; Wang, H.; Rahul, H.; Katabi, D. Extracting multi-person respiration from entangled RF signals. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2018, 2, 86. [Google Scholar] [CrossRef] [Green Version]
  20. Torres, M.E.; Colominas, M.A.; Schlotthauer, G.; Flandrin, P. A complete ensemble empirical mode decomposition with adaptive noise. In Proceedings of the 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 22–27 May 2011; pp. 4144–4147. [Google Scholar]
  21. Cheng, W.; Lee, S.; Zhang, Z.; He, Z. Independent component analysis based source number estimation and its comparison for mechanical systems. J. Sound Vib. 2012, 331, 5153–5167. [Google Scholar] [CrossRef]
  22. AWR1642BOOST-ODS Evaluation Board | TI.com. Available online: https://www.ti.com/tool/AWR1642BOOST-ODS (accessed on 19 April 2023).
  23. Instruments, T. Obstacle Detection Reference Design Using 77GHz mmWave Sensor. Available online: https://www.ti.com.cn/cn/lit/pdf/zhcu583 (accessed on 23 April 2023).
  24. HKH-11C Breathing Wave Sensor. Available online: http://www.hfhuake.com/chanpinzhanshi/yiliaochuanganqi/huxichuanganqi/2015/0101/hkh-11c.html (accessed on 20 April 2023).
  25. HKG-07C Infrared Pulse Sensor. Available online: http://www.hfhuake.com/chanpinzhanshi/yiliaochuanganqi/hongwaimaibochuang/2014/1231/hkg-07c.html (accessed on 20 April 2023).
  26. Islam, S.M.; Yavari, E.; Rahman, A.; Lubecke, V.M.; Boric-Lubecke, O. Separation of respiratory signatures for multiple subjects using independent component analysis with the JADE algorithm. In Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA, 18–21 July 2018; pp. 1234–1237. [Google Scholar]
Figure 1. Radar multi-adjacent-target vital signs signal separation method based on CEEMDAN-ICA.
Figure 1. Radar multi-adjacent-target vital signs signal separation method based on CEEMDAN-ICA.
Electronics 12 02732 g001
Figure 2. The magnitude response of the designed IIR bandpass filters: (a) Magnitude response of the filter for respiratory signal (0.15–0.6 Hz); (b) Magnitude response of the filter for heartbeat signal (0.8–2.0 Hz.).
Figure 2. The magnitude response of the designed IIR bandpass filters: (a) Magnitude response of the filter for respiratory signal (0.15–0.6 Hz); (b) Magnitude response of the filter for heartbeat signal (0.8–2.0 Hz.).
Electronics 12 02732 g002
Figure 3. Multivariate FastICA algorithm process.
Figure 3. Multivariate FastICA algorithm process.
Electronics 12 02732 g003
Figure 4. Connection diagram of radar module and data acquisition module.
Figure 4. Connection diagram of radar module and data acquisition module.
Electronics 12 02732 g004
Figure 5. Experimental scene: (a) Adjacent multi-target experimental scene; (b) the range profile of radar echo signal.
Figure 5. Experimental scene: (a) Adjacent multi-target experimental scene; (b) the range profile of radar echo signal.
Electronics 12 02732 g005
Figure 6. Mixed respiratory signal time domain of different channels.
Figure 6. Mixed respiratory signal time domain of different channels.
Electronics 12 02732 g006
Figure 7. Time Domain Results of Different Methods: (a) CEENDAN-ICA method; (b) ICA method in [19]; (c) ICA-JADE method in [26].
Figure 7. Time Domain Results of Different Methods: (a) CEENDAN-ICA method; (b) ICA method in [19]; (c) ICA-JADE method in [26].
Electronics 12 02732 g007
Figure 8. Signal separation results of CEEMDAN-ICA method for the 2-person scene: (a) (0°, 0°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain; (c) (0°, 0°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain.
Figure 8. Signal separation results of CEEMDAN-ICA method for the 2-person scene: (a) (0°, 0°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain; (c) (0°, 0°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain.
Electronics 12 02732 g008
Figure 9. Signal separation results of CEEMDAN-ICA method for 2-person scene: (a) (0°, 45°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in time domain and frequency domains; (c) (0°, 45°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in time domain and frequency domains.
Figure 9. Signal separation results of CEEMDAN-ICA method for 2-person scene: (a) (0°, 45°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in time domain and frequency domains; (c) (0°, 45°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in time domain and frequency domains.
Electronics 12 02732 g009
Figure 10. Signal separation results of CEEMDAN-ICA method for 2-person scene: (a) (0°, 90°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain; (c) (0°, 90°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain.
Figure 10. Signal separation results of CEEMDAN-ICA method for 2-person scene: (a) (0°, 90°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain; (c) (0°, 90°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain.
Electronics 12 02732 g010aElectronics 12 02732 g010b
Figure 11. Signal separation results of CEEMDAN-ICA method for the 2-person scene: (a) (−90°, 90°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain; (c) (−90°, 90°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain.
Figure 11. Signal separation results of CEEMDAN-ICA method for the 2-person scene: (a) (−90°, 90°) experimental scene photo; (b) The comparison between the respiratory signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain; (c) (−90°, 90°) experimental schematic diagram; (d) The comparison between the heartbeat signals of 2 human targets (results of CEEMADN-ICA method) and reference signals in the time domain and frequency domain.
Electronics 12 02732 g011
Table 1. Radar parameters.
Table 1. Radar parameters.
Parameter NameValue
Number of Transmitting Antennas2
Number of Receiving Antennas4
Frequency77 GHz
Sweep Slope105 MHz/us
ADC Sampling Points256
ADC Sampling Rate10 MHz
Bandwidth2.688 GHz
Frame Period40 ms
Number of Frames1500
Table 2. Separation results and errors of CEEMDAN-ICA method in simple scenario.
Table 2. Separation results and errors of CEEMDAN-ICA method in simple scenario.
NumTarget IDRR *
(bpm)
RR * (Ref)
(bpm)
RR * Errors
(bpm)
HR *
(bpm)
HR * (Ref)
(bpm)
HR * Errors
(bpm)
1(1)34.2033.181.0267.8064.203.6
(2)24.0025.381.3861.8062.400.6
2(1)19.8018.181.6263.6062.640.96
(2)22.2022.800.666.0063.302.7
3(1)13.2013.800.669.6066.603
(2)25.8027.601.860.0064.204.2
4(1)12.0013.201.263.6068.404.8
(2)25.8024.001.861.8066.604.8
5(1)16.2015.001.267.8066.361.44
(2)21.6022.801.264.2064.020.18
* RR is Respiration Rate, HR is Heartbeat Rate.
Table 3. Mean accuracy of RR and HR under different scenes.
Table 3. Mean accuracy of RR and HR under different scenes.
Seq.ScenesRR AccuracyHR Accuracy
Target1Target2Target1Target2
(a)(0°,0°)95.55%94.99%98.18%97.01%
(b)(0°,45°)94.71%91.67%96.18%97.00%
(c)(0°,90°)93.29%87.26%97.11%97.54%
(d)(−90°,90°)88.94%91.55%93.82%97.31%
Mean92.24%96.77%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Dong, X.; Feng, Y.; Cui, C.; Lu, J. CEEMDAN-ICA-Based Radar Monitoring of Adjacent Multi-Target Vital Signs. Electronics 2023, 12, 2732. https://doi.org/10.3390/electronics12122732

AMA Style

Dong X, Feng Y, Cui C, Lu J. CEEMDAN-ICA-Based Radar Monitoring of Adjacent Multi-Target Vital Signs. Electronics. 2023; 12(12):2732. https://doi.org/10.3390/electronics12122732

Chicago/Turabian Style

Dong, Xichao, Yun Feng, Chang Cui, and Jun Lu. 2023. "CEEMDAN-ICA-Based Radar Monitoring of Adjacent Multi-Target Vital Signs" Electronics 12, no. 12: 2732. https://doi.org/10.3390/electronics12122732

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop