Next Article in Journal
An Explainable Radiogenomic Framework to Predict Mutational Status of KRAS and EGFR in Lung Adenocarcinoma Patients
Next Article in Special Issue
WA-ResUNet: A Focused Tail Class MRI Medical Image Segmentation Algorithm
Previous Article in Journal
Evaluation of Whole-Tumor Texture Analysis Based on MRI Diffusion Kurtosis and Biparametric VI-RADS Model for Staging and Grading Bladder Cancer
Previous Article in Special Issue
Detecting Safety Anomalies in pHRI Activities via Force Myography
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Prediction of Sleep Apnea Events Using a CNN–Transformer Network and Contactless Breathing Vibration Signals

1
School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
2
Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
3
Shanghai Yueyang Medtech Co., Shanghai 200131, China
4
Department of Sleep Medical Center, Beijing Anzhen Hospital, Capital Medical University, No. 2 Anzhen Road, Beijing 100029, China
5
Department of Ultrasound, Xinhua Hospital Affiliated to Shanghai Jiaotong University School of Medicine, Shanghai 200092, China
6
School of Electronics and Information Technology, Soochow University, Suzhou 215006, China
*
Authors to whom correspondence should be addressed.
Bioengineering 2023, 10(7), 746; https://doi.org/10.3390/bioengineering10070746
Submission received: 8 May 2023 / Revised: 8 June 2023 / Accepted: 15 June 2023 / Published: 21 June 2023
(This article belongs to the Special Issue Monitoring and Analysis of Human Biosignals)

Abstract

:
It is estimated that globally 425 million subjects have moderate to severe obstructive sleep apnea (OSA). The accurate prediction of sleep apnea events can offer insight into the development of treatment therapies. However, research related to this prediction is currently limited. We developed a covert framework for the prediction of sleep apnea events based on low-frequency breathing-induced vibrations obtained from piezoelectric sensors. A CNN-transformer network was utilized to efficiently extract local and global features from respiratory vibration signals for accurate prediction. Our study involved overnight recordings of 105 subjects. In five-fold cross-validation, we achieved an accuracy of 85.9% and an F1 score of 85.8%, which are 3.5% and 5.3% higher than the best-performed classical model, respectively. Additionally, in leave-one-out cross-validation, 2.3% and 3.8% improvements are observed, respectively. Our proposed CNN-transformer model is effective in the prediction of sleep apnea events. Our framework can thus provide a new perspective for improving OSA treatment modes and clinical management.

1. Introduction

Obstructive sleep apnea (OSA) is a highly prevalent disorder characterized by the instability of the upper airway during sleep, which results in markedly reduced (hypopnea) or absent (apnea) airflow at the nose/mouth, leading to disrupted sleep and drops in blood oxygen levels [1]. OSA can have substantial consequences in the long term, such as hypertension and cardiovascular morbidities [2,3,4]. According to a systematic review, the prevalence of OSA in the average adult, with an Apnea–Hypopnea Index (AHI) of ≥15 events/h, ranges from 6% to 17%. The prevalence can be as high as 49% in advanced ages [5]. Another study estimated that 936 million adults aged 30–69 years have mild to severe OSA [6].
Positive airway pressure (PAP) is the primary treatment for OSA. It provides a positive airflow to the upper airway to prevent airway collapse and obstruction, thereby improving respiratory events, sleep quality, and quality of life [7]. To improve treatment compliance and effectiveness, in addition to the original continuous PAP (CPAP), more PAP therapy modes have been developed, including automatic titration CPAP and bi-level PAP. A recent study showed that positional OSA was present in 53% of the general population and in 75% of OSA subjects [8]. Positional therapy can diminish OSA severity in positional OSA patients. Thus, some studies have focused on inducing head and posture changes with a pillow [9,10]. The prediction of sleep apnea events may provide strategies for developing PAP therapy modes and pillow adjustment algorithms.
Many studies have been conducted in sleep apnea detection. Pant et al. [11] proposed an ECG-based sleep apnea detection method using flexible analytic wavelet transform and optimize ensemble classifier. Nassi et al. [12] developed a neural network approach based on WaveNet and a respiratory effort signal from a single belt to screen for sleep apnea. Chen et al. [13] proposed a lightweight multi-scaled neural network for sleep apnea detection based on single-lead ECG signals. Meanwhile, few methods and algorithms have been proposed to predict sleep apnea events using multiple physiological signals. The study in Waxman et al. [14] employed large memory storage and retrieval (LAMSTAR) artificial neural networks to predict apnea and hypopnea using six physiological signals obtained from a set of polysomnography studies. The prediction performed best using 30 s segments to predict events up to 30 s into the future. The study in Taghizadegan et al. [15] used common single signals (EEG, ECG, and respiration) to represent the dynamic behavior of the signals before and during OSA events. ResNet-18 and ShuffleNet were implemented as classifiers and the classification results obtained from different signals are fused using the weighted majority voting method. However, measuring all these signals is obtrusive and inconvenient for the patient. The study in Zhang et al. [16] developed an autonomous system to detect and predict respiratory events during sleep using a covert bed-integrated radio-frequency sensor. The system can retrieve continuous respiratory waveforms without the user’s awareness and feed them into a random forest machine learning model for disorder detection and prediction. However, their study was conducted on 27 participants, excluding individuals diagnosed with severe OSA.
We developed a sleep event prediction framework based on low-frequency breathing-induced vibrations obtained from contactless piezoelectric sensors. According to the scoring criteria of sleep apnea, the respiratory signals are most directly related to respiratory dynamics. Since the breathing vibration signal contains body movement information and similar information with the respiratory signals, it is promising to provide enough information for the event prediction task. Physiological signals are inherently time-varying and sensitive to noise, making accurate feature extraction crucial for optimal classification performance. Deep learning methods enable the automatic extraction of features from data, facilitating their application in time series analysis [13,17,18]. Deep learning methods that have been successfully applied to sleep data analysis include recurrent neural networks (RNNs) [19,20,21], convolutional neural networks (CNNs) [22,23], transformers, and their combinations [24,25,26]. Our method leverages a combination of a CNN and a transformer to effectively capture local and global features in the respiratory vibration signals for accurate prediction. We evaluate our model on a clinical dataset of 105 subjects and demonstrate its effectiveness in the prediction of respiratory events. Our method shows promise for improving the clinical management of OSA.
The main contributions of our work are the following:
  • A novel contactless scheme based on deep learning and breathing vibration signals is developed for sleep apnea event prediction. Our method can effectively predict respiratory events without disturbing the sleep of the subjects.
  • A novel CNN–transformer network is proposed for prediction. It leverages the advantages of both CNN and transformer architectures, to effectively capture both local and global features present in the respiratory signals for prediction.
  • The proposed method is validated on a dataset of 105 subjects from a public hospital and obtained a prediction accuracy of 85.9%. The method outperformed classical time series classification methods in terms of accuracy, sensitivity, and F1 score, demonstrating its effectiveness for the prediction of sleep apnea events. Two types of cross-validation were performed to demonstrate the generalization of our model.

2. Materials and Methods

2.1. Data Collection and Preparation

Our model was trained on a dataset collected from the Beijing Anzhen Hospital, which includes 105 participants (87 males and 18 females). The Ethics Committee of Beijing Anzhen Hospital approved this study. Patients who met any of the following criteria were excluded: (1) previously diagnosed with OSA, currently receiving CPAP therapy, or undergoing oxygen therapy; (2) disabled patients with heart failure or stroke. The detailed demographic information is shown in Table 1. The severity of OSA is determined by AHI, defined as the average number of respiratory events per hour of sleep. AHI scores of less than 5 indicate a normal condition, while scores between 5 and 15 are considered mild OSA. If the AHI falls between 15 and 30, it is classified as moderate OSA, and scores exceeding 30 indicate severe OSA.
As illustrated in Figure 1, Breathing activity is recorded by five piezoelectric sensors placed in rows under the mattress. These sensors measure body recoil micro-movements caused by respiration at a sampling rate of 5 Hz. Each participant took a home sleep apnea test (HSAT) for one night while the micro-movements were recorded simultaneously. HSAT was carried out using Alice PDx (Amsterdam, The Netherlands) [27], which compromises several channels with attached sensors that record oxygen saturation (SpO2), ECG, nasal airflow, respiratory effort, and body position. Recordings with missing respiratory signals due to sensor detachment or misplacement or those with a recording time less than 4 h were excluded from this study. The non-contact respiratory signals and HSAT signals were synchronized based on signal correlation. The HSAT signals was labeled by a sleep center specialist according to the American Academy of Sleep Medicine (AASM) manual [4].
The recordings were segmented into epochs of 40 s with a sliding step of 15 s. We first divided the epochs into two types: respiratory events and normal breathing. If an apnea or hypopnea event occurs for more than 16 s within an epoch, the epoch is defined as a disordered epoch; otherwise, it is considered a normal breathing epoch. Epochs under off-bed conditions and segments affected by artifacts are excluded. We define the three normal breathing epochs before a respiratory event as “prior.” By distinguishing them from other normal breathing epochs, we can predict respiratory events. An example of epoch annotation is shown in Figure 2. Since the number of normal epochs is 5.2 times that of prior epochs, we randomly select the same number of epochs as the latter from the former to form a dataset, with a total of 38,985 epochs.

2.2. Analysis Model

We employ a CNN–transformer network for predicting respiratory events. The prediction architecture is shown in Figure 3. Firstly, we input the respiratory signal into the CNN module for high-dimensional feature learning and dimensionality conversion. Then, we feed the features into the transformer module for sequence modeling and capturing long-range dependencies. Finally, we perform average pooling on the output of the transformer module and feed it into a fully connected layer to perform binary classification, predicting whether the current segment is a precursor to a respiratory event. The following are the details of the model:
  • Feature extraction: We employ three 1D convolutional blocks to extract features. Each of the blocks consists of three sub-layers, which perform in turn: 1D-CNN layer, batch normalization (BN) layer, and ReLU activation layer. The first block has a convolutional kernel size of 3, while the next two blocks have convolutional kernel sizes of 29. The number of output channels is set to 64, and the padding is 1 in the first block and 14 in the last two blocks. The smaller kernel size captures local features with a smaller receptive field, while the larger kernel size captures global features with a larger receptive field. By combining them, the model can capture both local and global features, leading to a more comprehensive representation of the input signals.
  • Transformer encoder: We employ a stack of 2 transformer encoders to encode the high-dimensional features output. These encoded representations can effectively capture long-range dependencies in the sequence, providing strong support for subsequent classification tasks. Each transformer encoder consists of a multi-head self-attention layer and a position-wise feed-forward layer (FFN) [28].
The multi-head attention mechanism allows for the parallel computation of multiple attention heads, which can focus on different subspaces of information, capturing different attentional features. This helps to reduce noise and uncertainty in individual attention heads and improve the robustness of attention. The multi-head self-attention layer is calculated as
M u l t i H e a d Q , K , V = C o n c a t H e a d 1 , , H e a d h W o
where W o denotes the multi-headed trainable parameter weights, and H e a d i refers to the i-th attention head. The latter is calculated as
H e a d i = A t t e n t i o n Q W i Q , K W i K , V W i V
where Q, K, and V are the query, key, and value matrices, respectively, and W i Q , W i K , W i V are the projection matrices for the i-th attention head. The attention score for input features is computed as the dot product of their respective query, key, and value vectors, which are obtained by linearly transforming the input features. The function can be expressed as
A t t e n t i o n Q , K , V = s o f t m a x Q K T d k V
where 1 d k is the scaling factor. The self-attention mechanism allows each position in the input sequence to be computed as a weighted average of the other positions, thus modeling dependencies between different parts of the sequence. The FFN layer consists of two linear layers with a ReLU activation function in between. It applies a non-linear transformation to enhance the model’s representational power. The FFN is calculated as
F F N x = m a x 0 , x W 1 + b 1 W 2 + b 2
After experiments, we set the number of attention heads in each self-attention mechanism to 8. In the FFN, we set a hidden layer with a middle dimension of 128 and use the ReLU activation function. For the input and output dimensions, we set them to 64.
3.
Prediction: After the output of a transformer encoder, an average pooling layer and a dropout layer are typically applied. We use the average pooling layer to reduce the dimensionality of the output. A dropout layer is used to prevent overfitting with a parameter set to 0.5. Then, the result is mapped to the target output dimension through a linear layer and finally mapped to between 0 and 1 through a sigmoid layer to obtain the output probability.
Table 2 summarizes the parameters of the layers in the proposed model. In this table, “d_model” denotes the embedding output size, “nhead” represents the number of attention heads, “dim_feedforward” indicates the dimension of the hidden layer, and “num_layers” specifies the number of stacked transformer encoders.

2.3. Model Evaluation

We adopt commonly used metrics to assess the performance of binary classification, which include accuracy, sensitivity, and F1-score. The sensitivity metric is an important indicator in the field of biomedical research. In our task, the sensitivity metric can help us evaluate the ability of the model to identify real respiratory event precursors. F1-score provides a single value to reflect the overall performance of the model. The details are as follows:
A c c u r a c y = T P + T N T P + F P + F P + F N
S e n s i t i v i t y = T P T P + F N
F 1 = 2 × T P 2 × T P + F P + F N

3. Experiments and Results

3.1. Experiment Details

We adopted two manners to train and test our model. First, we employed the k-fold cross-validations (CV) to test the skill of the model on new data. We divided the whole dataset into a separate training set (70%), validation set (10%), and test set (20%), and the process was repeated five times until all cases had been tested as unseen data. Then, we employed the leave-one-out (LOO) CV to test the skill of the model on data from new subjects. We performed stratified sampling according to the severity of OSA cases and divided the dataset into five groups as shown in Table 3. The process was repeated five times until all subjects had been tested. Stratified sampling according to the severity of OSA cases helps to ensure that each group is represented fairly in the evaluation process.
To validate the effectiveness of our proposed model, we conducted ablation and comparative experiments on our clinical dataset. Firstly, we designed ablation experiments to evaluate the impact of the CNN and transformer modules on the performance. Additionally, since there are few studies related to respiratory prediction, we compared the CNN–transformer model with other commonly used deep learning models for time series data processing and classification tasks, including GRU, LSTM, BiLSTM, and their combinations with a CNN. These comparisons were performed to verify the effectiveness and superiority of our proposed model.
The experiments were performed on a computer with 1 CPU at 2.6 GHz, 1 NVIDIA GeForce RTX2060 GPU, and 64 GB memory. The proposed model was developed using Pytorch [29]. In the model, we used the adaptive moment estimation (Adam) optimizer with default parameters and a learning rate of 1 × 10−4 [30]. Binary cross entropy loss was used as the loss function.

3.2. Ablation Study

To verify the effectiveness of the CNN and transformer modules, a set of ablation experiments were conducted in this study with the same experiment setup. The CNN refers to the modified proposed model with the transformer blocks removed. The transformer refers to the modified proposed model with the CNN blocks removed. A 1D convolution with a kernel size of 1 was employed to realize the dimensionality conversion instead of the original CNN module.
The results are listed in Table 4. It is noted that the proposed model outperforms the other two models. The CNN–transformer model achieved an overall accuracy of 85.9% in the five-fold CV, which demonstrated the effectiveness of the proposed model for the classification of respiratory signals. There was a clear decrease in the model’s ability to identify the prior cases, with the F1-score dropping by 8.8% and 5.9% on the five-fold CV and the LOO CV, respectively, when the transformer module was removed. When the CNN module was removed, there was a decrease in the accuracy, sensitivity, and F1 score metrics by 5.6%, 3.5%, and 5.3%, respectively, on the five-fold CV and by 2.3%, 2.8%, and 2.6%, respectively, on the LOO CV.

3.3. Performance Comparison

We compared multiple commonly used deep learning time series data classification models, including GRU, LSTM, BiLSTM, and their combinations with a CNN. Specifically, the CNN-GRU, CNN-LSTM, and CNN-BiLSTM models were created by replacing the transformer blocks with GRU, LSTM, and BiLSTM blocks, respectively. The GRU, LSTM, and BiLSTM models refer to the CNN-GRU, CNN-LSTM, and CNN-BiLSTM models with the CNN blocks removed. For all these models, the number of hidden layer features is set to the same as it in the transformer encoder, i.e., 128. Additionally, the number of layers is also the same, i.e., 2.
As demonstrated in Table 5, the proposed model outperforms the hybrid models combining a CNN and different RNNs, and the RNN models perform the worst. The hybrid models combined of a CNN and different RNNs achieved similar performances. In the five-fold CV, BiLSTM achieved better performance than the CNN-RNN models. However, in the LOO CV, the performance of BiLSTM was significantly worse than that of the CNN-RNN models. Among the compared models, CNN-BiLSTM achieved the best performance. Our proposed model showed significant improvements over CNN-BiLSTM in both five-fold cross-validation and LOO validation. Regarding the F1 score, our model achieved increases of 5.3% and 3.8%, while in terms of sensitivity, the improvements were 11.3% and 7.4%.
We further analyzed the prediction performance of the first, second, and third segments preceding sleep apnea events. Figure 4 demonstrates that our model achieved the best performance in detecting “prior” segments at three different time intervals. The “first” segment represents the closest segment to the apnea event, while the “third” segment corresponds to the furthest segment preceding the apnea event. Sensitivity represents the detection rate of the segments, and our proposed model achieved detection rates of 88.0%, 86.5%, and 76.4% for the three different time intervals. This performance is higher than that of all other models. Our model achieved a detection rate of 76.4% for the earliest precursor segments, which is 13.9% higher than that of the CNN-BiLSTM model.
Table 6 lists the detection performance of methods in different severity levels of the OSA patients in LOO CV. As can be seen, our method achieved the best results in all severity groups, especially in the subjects with severe OSA. Figure 5 illustrates that our method maintains a good detection rate for the different severity levels, while the detection rates of other methods gradually decrease as the severity decreased.

4. Discussion

In this study, we aim to develop a novel unobtrusive framework for predicting breathing events to improve OSA treatment schemes and clinical management. We proposed a CNN–transformer model to classify normal breathing and breathing event precursors. We evaluated our framework on a clinical dataset of 105 subjects with different types of OSA severities in both five-fold CV and LOO CV. We achieved an accuracy of 85.9%, a sensitivity of 85.8%, and a F1 score of 84.7%, which is better than other common time series classical models.
The results in Table 4 illustrated that combining a CNN and a transformer is advantageous for the prediction of OSA events. CNNs are good at capturing local patterns for modeling short-term dependencies, but they cannot learn long-term dependencies due to the limited receptive field. The CNN model performs much worse than the models with transformer blocks in identifying prior segments. Transformers, on the other hand, are capable of learning global contexts and long-term dependencies. By combining a CNN and a transformer, the proposed method can effectively model both short-term and long-term dependencies within respiratory signals. The addition of CNN modules with different kernel sizes improved the overall performance of the proposed model. Good predictive performance in the OSA population is meaningful as it can help optimize the clinical management of OSA patients. Table 6 further confirms the effectiveness of our model, as our model outperforms individual modules and the classical model in predicting respiratory events in OSA patients across different severity levels. This suggests that our method has the potential to be applied in clinical settings to optimize the treatment of OSA patients.
Our framework has several advantages. First, our method does not interfere with subjects’ sleep or treatment, and the signal acquisition devices are suitable for both hospital and home environments. Secondly, the proposed CNN–transformer model achieves better performance compared to common methods. The CNN–transformer model utilizes self-attention mechanisms to achieve global interaction between any two positions without relying on hidden states to pass information. Apart from this, it utilizes multi-head attention mechanisms to achieve parallel computation in multiple subspaces, thereby capturing features of different levels of the temporal signal. In contrast, RNN models typically only capture features of a single dimension or aspect of the temporal signal. Finally, we performed two modes of validation on a real clinical dataset, including five-fold CV and LOO CV, demonstrating the effectiveness and robustness of our framework for predicting respiratory events. Our model achieved high accuracy and robustness in predicting non-intrusive respiratory events, with an average accuracy of 85.6% using five-fold CV and 75.4% using LOO CV. These results indicate that our method can effectively predict respiratory events in real clinical situations, promising to provide strategies for the treatment and management of OSA.
Table 7 summarizes the inter-subject and intra-subject results of the proposed system and the previous events prediction studies that used respiratory-related signals. The proposed system demonstrated better per-segment prediction results. Taghizadegan et al. [15] computed the recurrence plot (RP) of the signals by selecting appropriate parameters and focused on distinguishing signals before and during the occurrence of OSA events. Our proposed method achieved slightly inferior results in inter-subject results. Zhang et al. [16] extracted 37 features for the prediction of respiratory events, and the proposed method does not require manual feature extraction. These two studies involved 16 and 27 subjects, respectively, with 12 out of the 16 subjects in Taghizadegan et al. [15] having severe OSA, while Zhang et al. [16] did not include subjects with severe OSA. In contrast, our study included 105 subjects with varying degrees of severity, providing a more comprehensive validation of our model.
Further improvements can be made in our study. Our dataset includes 105 whole-night recordings from 87 male patients and 18 female patients. To improve our study, more female subjects could be included in our dataset to achieve a more balanced representation of both genders.

5. Conclusions

We developed a novel deep-learning-based framework for unobtrusive breathing event prediction. We proposed a novel CNN–transformer model for respiratory event prediction, which proved to be effective on a clinical dataset of 105 subjects. Our model combined the strengths of CNN and transformer architectures, allowing it to capture both local and global features of the input signals. Via extensive evaluations, we demonstrated that our model outperformed several classical models, including the RNN-based and CNN-RNN-based models, in terms of accuracy, sensitivity, and F1 score metrics. We believe that our framework can provide a new perspective for improving OSA treatment modes and clinical management.

Author Contributions

Conceptualization, Y.C. and L.W.; methodology, Y.C. and B.W.; software, Y.C.; validation, Y.C. and S.Y.; formal analysis, Y.C.; investigation, H.L.; resources, H.L.; data curation, Y.C.; writing—original draft preparation, Y.C.; writing—review and editing, L.W. and B.W.; visualization, Y.C.; supervision, Y.C. and L.W.; project administration, S.Y. and B.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by National Key R&D Program of China (2020YFC2003600 and 2020YFC2003602).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Beijing Anzhen Hospital (approval number: 2020074X, 2019.10.17).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data are not publicly available.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Somers, V.K.; White, D.P.; Amin, R.; Abraham, W.T.; Costa, F.; Culebras, A.; Daniels, S.; Floras, J.S.; Hunt, C.E.; Olson, L.J.; et al. Sleep apnea and cardiovascular disease: An American Heart Association/American College of Cardiology Foundation Scientific Statement from the American Heart Association Council for High Blood Pressure Research Professional Education Committee, Council on Clinical Cardiology, Stroke Council, and Council on Cardiovascular Nursing. J. Am. Coll. Cardiol. 2008, 52, 686–717. [Google Scholar] [CrossRef] [Green Version]
  2. Shamsuzzaman, A.S.M.; Gersh, B.J.; Somers, V.K. Obstructive Sleep Apnea Implications for Cardiac and Vascular Disease. JAMA 2003, 290, 1906–1914. [Google Scholar] [CrossRef]
  3. Marin, J.M.; Carrizo, S.J.; Vicente, E.; Agusti, A.G.N. Long-term cardiovascular outcomes in men with obstructive sleep apnoea-hypopnoea with or without treatment with continuous positive airway pressure: An observational study. Lancet 2005, 365, 1046–1053. [Google Scholar] [CrossRef] [PubMed]
  4. Berry, R.B.; Brooks, R.; Gamaldo, C.E.; Harding, S.M.; Lloyd, R.M.; Marcus, C.L.; Vaughn, B.V. The AASM manual for the scoring of sleep and associated events. Rules Terminol. Tech. Specif. Darien Ill. Am. Acad. Sleep Med. 2012, 176, 2012. [Google Scholar]
  5. Senaratna, C.V.; Perret, J.L.; Lodge, C.J.; Lowe, A.J.; Campbell, B.E.; Matheson, M.C.; Hamilton, G.S.; Dharmage, S.C. Prevalence of obstructive sleep apnea in the general population: A systematic review. Sleep Med. Rev. 2017, 34, 70–81. [Google Scholar] [CrossRef] [PubMed]
  6. Zhang, Y.; Ren, R.; Lei, F.; Zhou, J.; Zhang, J.; Wing, Y.K.; Sanford, L.D.; Tang, X. Worldwide and regional prevalence rates of co-occurrence of insomnia and insomnia symptoms with obstructive sleep apnea: A systematic review and meta-analysis. Sleep Med. Rev. 2019, 45, 1–17. [Google Scholar] [CrossRef] [PubMed]
  7. Johnson, K.G. APAP, BPAP, CPAP, and New Modes of Positive Airway Pressure Therapy. In Advances in the Diagnosis and Treatment of Sleep Apnea; Springer: Cham, Switzerland, 2022. [Google Scholar]
  8. Heinzer, R.; Petitpierre, N.J.; Marti-Soler, H.; Haba-Rubio, J. Prevalence and characteristics of positional sleep apnea in the HypnoLaus population-based cohort. Sleep Med. 2018, 48, 157–162. [Google Scholar] [CrossRef]
  9. Jeon, Y.J.; Park, S.H.; Kang, S.J. Self-x based closed loop wearable IoT for real-time detection and resolution of sleep apnea. Internet Things 2023, 22, 100767. [Google Scholar] [CrossRef]
  10. Zhang, J.; Zhang, Q.; Wang, Y.P.; Qiu, C. A Real-time Auto-Adjustable Smart Pillow System for Sleep Apnea Detection and Treatment. In Proceedings of the 2013 Acm/Ieee International Conference on Information Processing in Sensor Networks (Ipsn), Philadelphia, PA, USA, 8–11 April 2013; pp. 179–190. [Google Scholar]
  11. Pant, H.; Kumar Dhanda, H.; Taran, S. Sleep Apnea Detection Using Electrocardiogram Signal Input to FAWT and Optimize Ensemble Classifier. Measurement 2021, 189, 110485. [Google Scholar] [CrossRef]
  12. Nassi, T.E.; Ganglberger, W.; Sun, H.; Bucklin, A.A.; Biswal, S.; Van Putten, M.; Thomas, R.; Westover, B. Automated Scoring of Respiratory Events in Sleep with a Single Effort Belt and Deep Neural Networks. IEEE Trans. Biomed. Eng. 2021, 69, 2094–2104. [Google Scholar] [CrossRef]
  13. Chen, X.; Chen, Y.; Ma, W.; Fan, X.; Li, Y. Toward sleep apnea detection with lightweight multi-scaled fusion network. Knowl. -Based Syst. 2022, 247, 108783. [Google Scholar] [CrossRef]
  14. Waxman, J.A.; Graupe, D.; Carley, D.W. Automated prediction of apnea and hypopnea, using a LAMSTAR artificial neural network. Am. J. Resp. Crit. Care 2010, 181, 727–733. [Google Scholar] [CrossRef] [PubMed]
  15. Taghizadegan, Y.; Jafarnia Dabanloo, N.; Maghooli, K.; Sheikhani, A. Obstructive sleep apnea event prediction using recurrence plots and convolutional neural networks (RP-CNNs) from polysomnographic signals. Biomed. Signal Process. Control 2021, 69, 102928. [Google Scholar] [CrossRef]
  16. Zhang, Z.; Conroy, T.B.; Krieger, A.C.; Kan, E.C. Detection and Prediction of Sleep Disorders by Covert Bed-Integrated RF Sensors. IEEE Trans. Biomed. Eng. 2022, 70, 1208–1218. [Google Scholar] [CrossRef]
  17. Dubatovka, A.; Buhmann, J.M. Automatic Detection of Atrial Fibrillation from Single-Lead ECG Using Deep Learning of the Cardiac Cycle. BME Front. 2022, 2022, 9813062. [Google Scholar] [CrossRef]
  18. Meng, L.; Tan, W.; Ma, J.; Wang, R.; Yin, X.; Zhang, Y. Enhancing dynamic ECG heartbeat classification with lightweight transformer model. Artif. Intell. Med. 2022, 124, 102236. [Google Scholar] [CrossRef]
  19. Wang, M.; Rahardja, S.; Fränti, P.; Rahardja, S. Single-lead ECG recordings modeling for end-to-end recognition of atrial fibrillation with dual-path RNN. Biomed. Signal Process. Control 2023, 79, 104067. [Google Scholar] [CrossRef]
  20. Faust, O.; Barika, R.; Shenfield, A.; Ciaccio, E.J.; Acharya, U.R. Accurate detection of sleep apnea with long short-term memory network based on RR interval signals. Knowl. Based Syst. 2020, 212, 106591. [Google Scholar] [CrossRef]
  21. Van Steenkiste, T.; Groenendaal, W.; Deschrijver, D.; Dhaene, T. Automated Sleep Apnea Detection in Raw Respiratory Signals Using Long Short-Term Memory Neural Networks. IEEE J. Biomed. Health Inform. 2019, 23, 2354–2364. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Choi, S.H.; Yoon, H.; Kim, H.S.; Kim, H.B.; Kwon, H.B.; Oh, S.M.; Lee, Y.J.; Park, K.S. Real-time apnea-hypopnea event detection during sleep by convolutional neural networks. Comput. Biol. Med. 2018, 100, 123–131. [Google Scholar] [CrossRef]
  23. Leino, A.; Nikkonen, S.; Kainulainen, S.; Korkalainen, H.; Toyras, J.; Myllymaa, S.; Leppanen, T.; Yla-Herttuala, S.; Westeren-Punnonen, S.; Muraja-Murro, A.; et al. Neural network analysis of nocturnal SpO2 signal enables easy screening of sleep apnea in patients with acute cerebrovascular disease. Sleep Med. 2021, 79, 71–78. [Google Scholar] [CrossRef] [PubMed]
  24. Liu, H.; Cui, S.; Zhao, X.; Cong, F. Detection of obstructive sleep apnea from single-channel ECG signals using a CNN-transformer architecture. Biomed. Signal Process. Control 2023, 82, 104581. [Google Scholar] [CrossRef]
  25. Zarei, A.; Beheshti, H.; Asl, B.M. Detection of sleep apnea using deep neural networks and single-lead ECG signals. Biomed. Signal Process. Control 2022, 71, 103125. [Google Scholar] [CrossRef]
  26. Almutairi, H.; Hassan, G.M.; Datta, A. Classification of Obstructive Sleep Apnoea from single-lead ECG signals using convolutional neural and Long Short Term Memory networks. Biomed. Signal Process. Control 2021, 69, 102906. [Google Scholar] [CrossRef]
  27. Philips. Alice PDx. Available online: https://www.philips.co.in/healthcare/product/HC1043844/alice-pdx-portable-sleep-diagnostic-system (accessed on 6 June 2023).
  28. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.; Kaiser, L.; Polosukhin, I. Attention is all you need. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4–9 December 2017. [Google Scholar]
  29. Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan, G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library. Adv. Neural Inf. Process. Syst. 2019, 32, 8024–8035. [Google Scholar]
  30. Kingma, D.P. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
Figure 1. Illustration of the sleep data recording procedure, where the blue represents the sensors. They are located between the mattress and the bed frame, not in contact with the human body, and positioned near the chest.
Figure 1. Illustration of the sleep data recording procedure, where the blue represents the sensors. They are located between the mattress and the bed frame, not in contact with the human body, and positioned near the chest.
Bioengineering 10 00746 g001
Figure 2. Sample data depicting: the green line in the figure represents the 5-channel respiratory vibration signals, the shaded area represents the occurrence of respiratory events, and the blue and orange lines, respectively, represent labels of “normal” and “prior”.
Figure 2. Sample data depicting: the green line in the figure represents the 5-channel respiratory vibration signals, the shaded area represents the occurrence of respiratory events, and the blue and orange lines, respectively, represent labels of “normal” and “prior”.
Bioengineering 10 00746 g002
Figure 3. Diagram of the respiratory events prediction architecture.
Figure 3. Diagram of the respiratory events prediction architecture.
Bioengineering 10 00746 g003
Figure 4. The F1-scores (a) and sensitivities (b) of different methods in detecting the first, second, and third segments before the respiratory events. The values in parentheses represent 95% confidence intervals.
Figure 4. The F1-scores (a) and sensitivities (b) of different methods in detecting the first, second, and third segments before the respiratory events. The values in parentheses represent 95% confidence intervals.
Bioengineering 10 00746 g004
Figure 5. Sensitivity of different methods in different types of severity cases.
Figure 5. Sensitivity of different methods in different types of severity cases.
Bioengineering 10 00746 g005
Table 1. Demographics of the participants.
Table 1. Demographics of the participants.
Participants (#) (male)105 (87)
Age (years)51.0 ± 13.1
BMI (kg/m2)28.7 ± 4.7
AHI (events/h)21.9 ± 18.8
Normal/mild/moderate/severe OSA cases (#)17/35/20/33
BMI: Body Mass Index; AHI: Apnea and Hypopnea Index; OSA: Obstructive Sleep Apnea.
Table 2. The parameters of the proposed model.
Table 2. The parameters of the proposed model.
Module LayerOutput SizeParameters
Feature
Extraction
Convolutional block32 × 200Kernel size: 3, stride: 1, padding: 1
Convolutional block32 × 200Kernel size: 29, stride: 1, padding: 14
Convolutional block64 × 200Kernel size: 29, stride: 1, padding: 14
Transformer
Encoder
Transformer200 × 64d_model: 64, nhead: 8
dim_feedforward: 128
dropout: 0.3, num_layers: 2
PredictionAverage Pooling64Kernel size: 200
Dropout64p: 0.5
Linear 1
Table 3. Five groups in the leave-one-out CV.
Table 3. Five groups in the leave-one-out CV.
Fold 1Fold 2Fold 3Fold 4Fold 5Total
Normal cases3344317
Mild cases7777735
Moderate cases4444420
Severe cases7766733
Total2121212121105
Table 4. Results of the ablation study.
Table 4. Results of the ablation study.
Five-fold CVLOO CV
AccuracySensitivityF1AccuracySensitivityF1
CNN0.7980.6850.7700.7150.6000.678
Transformer0.8030.8120.8050.7180.6980.711
Proposed0.8590.8470.8580.7410.7260.737
Table 5. Performance comparison of different time series classification models.
Table 5. Performance comparison of different time series classification models.
Five-Fold CVLOO CV
AccuracySensitivityF1AccuracySensitivityF1
GRU0.7340.6920.7240.5690.5830.575
LSTM0.7280.5970.6850.5720.5860.578
BiLSTM0.8090.7460.7970.6220.6000.614
CNN-GRU0.8010.7140.7830.7230.6050.686
CNN-LSTM0.8010.7540.7910.7200.6330.694
CNN-BiLSTM0.8240.7340.8050.7190.6520.699
Proposed
(95%CI 1)
0.859
(0.856 0.860)
0.847
(0.843 0.867)
0.858
(0.856 0.859)
0.741
(0.736 0.743)
0.726
(0.718 0.737)
0.737
(0.735 0.738)
1 CI: Confidence interval.
Table 6. Performance of methods in different types of severity cases.
Table 6. Performance of methods in different types of severity cases.
AccuracySensitivityF1-Score
SevereModerateMildSevereModerateMildSevereModerateMild
CNN0.6770.6780.7340.6600.5620.5100.7220.6550.544
Transformer0.7070.7080.7230.7270.6920.6460.7630.7190.598
CNN-BiLSTM0.7000.6950.7300.7000.6290.5770.7560.6960.575
Proposed0.7380.7160.7430.7610.6940.6920.7940.7300.636
Table 7. Comparison results of sleep apnea event prediction studies using respiratory-related signals.
Table 7. Comparison results of sleep apnea event prediction studies using respiratory-related signals.
StudyNo. of SubjectsSensor TypeMethodPer-SegmentPer-Subject
SenAccSenAcc
[15]16Respiratory beltsShuffleNet0.8030.8080.7660.767
[16]27Radio-frequency sensorsRandom Forest 0.7460.8190.7270.817
Proposed105Piezoelectric sensors.CNN–Transformer0.8470.8590.7260.741
Acc: Accuracy; Sen: sensitivity.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, Y.; Yang, S.; Li, H.; Wang, L.; Wang, B. Prediction of Sleep Apnea Events Using a CNN–Transformer Network and Contactless Breathing Vibration Signals. Bioengineering 2023, 10, 746. https://doi.org/10.3390/bioengineering10070746

AMA Style

Chen Y, Yang S, Li H, Wang L, Wang B. Prediction of Sleep Apnea Events Using a CNN–Transformer Network and Contactless Breathing Vibration Signals. Bioengineering. 2023; 10(7):746. https://doi.org/10.3390/bioengineering10070746

Chicago/Turabian Style

Chen, Yuhang, Shuchen Yang, Huan Li, Lirong Wang, and Bidou Wang. 2023. "Prediction of Sleep Apnea Events Using a CNN–Transformer Network and Contactless Breathing Vibration Signals" Bioengineering 10, no. 7: 746. https://doi.org/10.3390/bioengineering10070746

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop