Next Article in Journal
Prediction of the Old-Age Dependency Ratio in Chinese Cities Using DMSP/OLS Nighttime Light Data
Previous Article in Journal
Effects of Low-Volume High-Intensity Interval Exercise on 24 h Movement Behaviors in Inactive Female University Students
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Automated Wavelet-Based Sleep Scoring Model Using EEG, EMG, and EOG Signals with More Than 8000 Subjects

1
Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad 380026, India
2
Department of Software Engineering, Firat University, Elazig 23119, Turkey
3
Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore
4
Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
5
Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(12), 7176; https://doi.org/10.3390/ijerph19127176
Submission received: 26 February 2022 / Revised: 27 May 2022 / Accepted: 7 June 2022 / Published: 11 June 2022
(This article belongs to the Section Digital Health)

Abstract

:
Human life necessitates high-quality sleep. However, humans suffer from a lower quality of life because of sleep disorders. The identification of sleep stages is necessary to predict the quality of sleep. Manual sleep-stage scoring is frequently conducted through sleep experts’ visually evaluations of a patient’s neurophysiological data, gathered in sleep laboratories. Manually scoring sleep is a tough, time-intensive, tiresome, and highly subjective activity. Hence, the need of creating automatic sleep-stage classification has risen due to the limitations imposed by manual sleep-stage scoring methods. In this study, a novel machine learning model is developed using dual-channel unipolar electroencephalogram (EEG), chin electromyogram (EMG), and dual-channel electrooculgram (EOG) signals. Using an optimum orthogonal filter bank, sub-bands are obtained by decomposing 30 s epochs of signals. Tsallis entropies are then calculated from the coefficients of these sub-bands. Then, these features are fed an ensemble bagged tree (EBT) classifier for automated sleep classification. We developed our automated sleep classification model using the Sleep Heart Health Study (SHHS) database, which contains two parts, SHHS-1 and SHHS-2, containing more than 8455 subjects with more than 75,000 h of recordings. The proposed model separated three classes if sleep: rapid eye movement (REM), non-REM, and wake, with a classification accuracy of 90.70% and 91.80% using the SHHS-1 and SHHS-2 datasets, respectively. For the five-class problem, the model produces a classification accuracy of 84.3% and 86.3%, corresponding to the SHHS-1 and SHHS-2 databases, respectively, to classify wake, N1, N2, N3, and REM sleep stages. The model acquired Cohen’s kappa ( κ ) coefficients as 0.838 with SHHS-1 and 0.86 with SHHS-2 for the three-class classification problem. Similarly, the model achieved Cohen’s κ of 0.7746 for SHHS-1 and 0.8007 for SHHS-2 in five-class classification tasks. The model proposed in this study has achieved better performance than the best existing methods. Moreover, the model that has been proposed has been developed to classify sleep stages for both good sleepers as well as patients suffering from sleep disorders. Thus, the proposed wavelet Tsallis entropy-based model is robust and accurate and may help clinicians to comprehend and interpret sleep stages efficiently.

1. Introduction

Sleep is a daily routine in human life. Sleep can be categorized into two phases, namely, rapid eye movement (REM) sleep, and non-REM (NREM) sleep, as per the Rechtschaffen and Kales (R&K) guidelines [1]. A healthy adult’s one-night sleep contains 4 to 5 cycles of REM and NREM sleep; each cycle lasts for approximately 90 min. NREM sleep is further categorized into four phases: S1, S2, S3, and S4. Sleep stages S3 and S4 are combined into a stage called N3, as per the American Academy of Sleep Medicine’s (AASM) [2] guidelines. Thus, according to the AASM, the NREM stage consists of only three sleep stages, namely N1, N2, and N3 [3,4].
Proper sleep-stage scoring helps doctors diagnose sleep disorders and decide on the relevant course of action for the treatment. The present gold standard for sleep analysis is the scoring of visual sleep phases performed manually by human experts. Sleep stages are graded by technicians and clinicians associated with a visual inspection of neurophysiologic signal patterns [5]. A hypnogram is a visual description of sleep phases throughout the night. It provides a simple picture of sleep that can be used to suspect or confirm sleep problems [6]. Analyzing the hypnograms over a night is a time-consuming process involving the subjectivity of sleep scorers. When given the same polysomnography (PSG) recording, different human sleep-scoring specialists are likely to develop varied sleep-staging assessments, and agreement among them may be around 83% [7]. The sleep-scoring accuracy of individual human experts is about 80% [8]. Even though the same specialist analyzes the same recording twice, the results may be slightly different, and the agreement between both sleep-scoring assessments would be, at most, 90% [9]. Sleep stages help as an asymptomatic instrument to identify sleep issues. The sleep scoring is often performed in a clinical setting by professionals using PSG [10] monitoring, which commonly includes electroencephalogram (EEG), electrooculogram (EOG), electrocardiogram (ECG) data, and electromyogram (EMG) signals, as per the R&K [11] principles or the AASM guidelines [2,12,13]. PSG recordings are first segmented into 30 s epochs, complying with the AASM guidelines. PSG is an effective tool used in sleep medicine to record many biological signals to determine sleep quality. When the patient sleeps, multiple signals, such as overnight EEG, breathing through the nostrils, breathing rate, blood pressure variations, ECG signals, blood oxygen content, EOG signals, and contact EMGs on the chin and legs, are recorded [14]. However, overnight recording using multiple channels causes discomfort in patients, and such data sometimes may not represent natural sleep patterns. PSG analysis for sleep-stage scoring is a costly affair requiring dedicated sleep labs and expensive equipment [15,16,17,18,19]. Recording sleep in a sleep lab cannot be conducted for multiple nights, and only one or two nights’ worth of sleep data may not accurately represent the complete scenario. For accurate sleep analysis, sleep recordings of multiple nights are required, which demands a portable and home-based system that captures only a few desired signals and requires the placement of only a few electrodes and sensors on the subject’s body. The proposed study explores the effectiveness of various channels and their combination for three signals, namely, EEG, EOG, and EMG, which are considered to be the most essential for sleep analysis. Further, this study aims to obtain a simple system that uses a minimum number of electrodes, but at the same time has a comparable performance with PSG-based systems such that it can be used as a portable home-based sleep-scoring system [12,20,21].
The National Sleep Research Resource (NSSR) contains PSG data of the SHHS [22,23] database, which was used for this study. The SHHS is a polycentric cohort developed to observe sleep-disordered ventilation related to an increased chance of heart disease [6]. The PSG recordings of 5793 subjects were collected during the 1995–1998 period. This database is known as the SHHS-1. For the remaining 2651 subjects, recordings were collected during the 2001–2003 period; these are known as the SHHS-2 database. The sampling frequency of both the EEG and EMG signals is 125 Hz, whereas the sampling frequency of the EOG signal is 50 Hz. PSGs were annotated by certified expert sleep scorers in both sessions using modified R&K standards. A single clinician manually assessed every record for sleep stages in 30-s epochs using R&K [11] scoring standards, obtaining multiple sleep stages. The details of both databases are given in Table 1.
It is to be noted that few studies have been performed in the literature to identify sleep stages using the SHHS-1 database. However, to the best of our knowledge, no study has used both SHHS-1 and SHHS-2. Sors et al. [6] employed a convolutional neural network using only the SHHS-1 database to score sleep stages using EEG and obtained an accuracy of 87% and a Cohen’s κ coefficient of 0.81. Biswal et al. [24] conducted a study on sleep-stage classification employing recurrent and convolutional neural networks (RCNN) and achieved 77.9% accuracy for the SHHS-1 dataset. Zhang et al. [5] also used the SHHS-1 dataset for sleep scoring using spectrograms from raw data. In addition, they used recurrent and convolutional neural networks to score sleep stages and obtained 87% accuracy. Zhang et al. [25] performed sleep-stage classification using a bidirectional long short-term memory (BLSTM) neural network to assess the four sleep stages (deep sleep, light sleep, wake, REM) and obtained a prediction accuracy of 80.25%. Fernández-Varela et al. [26] used only 500 random sleep recordings of the SHHS-1 database and achieved an accuracy of 75% by using a convolutional network. Wongsirichot et al. [27] used the k-nearest neighbors classifier with 14 bio-medical channels of the SHHS-2 database and found an accuracy of 83.76%.
In this work, we introduce an automatic sleep-stage scoring system using a wavelet-based Tsallis entropy feature, wherein the model is developed employing the SHHS-1 and SHHS-2 databases together. The deployment of both datasets makes the model robust. The SHHS-1 and SHHS-2 databases contain 5804 and 2651 subjects, respectively. We used C3-A2 and C4-A1 channels for the EEG signal—one EMG channel and two EOG channels (EOG-L and EOG-R). Thus, in contrast to earlier studies that used SHHS-1 only, the proposed study employs a comprehensive database comprising both SHHS-1 and SHHS-2. The wavelet decomposition of the signals is also performed using a new optimal orthogonal filter bank. Furthermore, we used individual channels as well as their varying combinations. We have explored the performance of 15 varying combinations. This is the first study on a joint SHHS database that used the optimal wavelet-based single feature to score sleep stages.

2. Methodology

Figure 1 shows the flow diagram for the suggested system, representing the actions taken in scoring sleep stages. Data acquisition, segmentation, wavelet decomposition, feature extraction, and classification are all part of the process. The PSG data were collected and segmented into an epoch of 30 s. The six sub-bands were acquired using a five-level wavelet decomposition using an orthogonal wavelet filter bank. The Tsallis entropy feature is extracted for these sub-bands. The features are then fed into machine learning classifiers to identify sleep stages.

2.1. Data Gathering

The SHHS database contains 8444 PSG recordings, of which 8326 (5791 from visit-1 and 2535 from visit-2) were selected for this study based on the availability of target signals. We used two bipolar EEG channels, two EOG channels, as well as an EMG channel. Every PSG recording was retrieved as a European data format (.edf) file, which also includes XML files for each subject. Every sleep stage of a 30-s epoch was annotated in the XML file, according to the R&K [11] rules. Recording files, the frequency of the channels, and the header details were obtained from the .edf file. The recording file contains the signal data in matrix form, which is normalized for segmentation into an epoch of 30 s. A total of 5,861,304 and 3,037,838 epochs were obtained from the SHHS-1 and SHHS-2 databases. The details of the sleep-stage epoch distribution for both visits are given in Table 1.

2.2. Orthogonal Wavelet Filter Bank

Instead of using Daubechies standard wavelet dB filters [28,29], we used an optimal orthogonal wavelet filter in this study [30]. The orthogonal filter employed has a minimum time-frequency product [31]. For the chosen length, first, an optimal half-band filter was designed, formulating a convex optimization problem in the form semidefinite program such that the spectral factors had minimum mean squared bandwidths. Then, the optimal spectral factor possessing a minimum mean squared duration was selected. Thus, the low-pass filter chosen had minimum spread both in frequency and time [31,32]. We used a filter with three vanishing moments and with a length of 18 in this study.

2.3. Wavelet Decomposition

The wavelet decomposition of level five was applied to every epoch of the PSG signals using the orthogonal wavelet filter bank. As a result, we obtained six sub-bands, out of which one was an approximate band, and the remaining five were detailed bands.

2.4. Feature Extraction

Feature extraction was performed by extracting the Tsallis entropy features from each sub-band to classify sleep stages. Tsallis entropy is important in non-extensive statistics because it accurately explains complicated systems’ statistical properties. Tsallis entropy is regarded as a valuable metric for defining the thermo-statistical features of a specific class of given system, which includes long-range connections, long-term memories, and multi-fractal systems [33]. The generalization of Boltzmann–Gibbs–Shannon (BGS) entropy [34] gives Tsallis entropy (TE):
T E = i = 1 n x i x i 2
where x i denotes the i t h sample of the wavelet coefficient sequence x(n) of length N.

2.5. Classification Method

Wavelet-based Tsallis entropy features are used to classify sleep stages. Two classification tasks were considered: (i) 3-class classification for distinguishing W vs. NREM vs. REM, and (ii) a 5-class task to discriminate 5 classes, namely, W vs. REM vs. N1 vs. N2 vs. N3. The extracted labeled features were fed to the machine learning classifier, namely, an ensemble bagged decision tree with 10% holdout validation [31,35]. Ensemble learning is a cutting-edge method to solve various machine learning issues by integrating the outputs of many base learners [36,37]. A bagging method and decision tree classifier were combined in the EBT classifier. Bagging is a strategy that uses bootstrap sampling to decrease decision tree variance and increase learning algorithm efficiency by producing a group of learning algorithms that are trained in succession. It employs arbitrary sampling with a replacement rather than a conventional averaging of all outcomes from multiple decision trees [38].

3. Results

The present approach is conducted on an Intel® Core™ i5 eighth-generation CPU @ 1.60 GHz, 8 GB RAM, and Windows 10 (64-bit) OS with MATLAB R2016a. For the classification task, the proposed method employs 8,899,142 epochs (5,861,304 epochs for visit-1 and 3,037,838 epochs for visit-2). A summary of the results obtained for automated sleep-stage scoring with the ensemble bagged tree classifier using 10% holdout validation to classify sleep stages into three stages using the SHHS (1 and 2) datasets can be observed in Table 2 and Table 3, respectively. Additionally, Table 4 and Table 5 summarize the categorization results for five sleep stages.
Signals are divided into six sub-bands using a five-level one-dimensional decomposition. Tsallis entropy is then used to extract features, which are then loaded into the EBT classifier for three-stage and five-stage classification. We merged the sleep stages N1, N2, and N3, and represented them as N for three sleep-stage classifications in this work. Table 2 and Table 3 exhibit each channel’s accuracy alone and collectively for three-class sleep-stage categorization, as acquired from visit-1 and visit-2. It also shows that the maximum accuracy is yielded by integrating all channels rather than individual channels. For three-stage classification using visit-1, by combining all the channels, we scored an accuracy of 90.70% and a Cohen’s κ coefficient of 0.833, whereas, for visit-2, we achieved 91.80% accuracy and a Cohen’s κ coefficient of 0.86. The confusion matrix [39,40] for the three-class sleep-stage classification for both datasets is shown in Table 6. Similarly, for the five-stage classification, by employing all the channels using visit-1, we achieved 84.30% classification accuracy with a Cohen’s κ value of 0.774, and 86.30% accuracy with Cohen’s κ coefficient of 0.80 for visit-2. The confusion matrix for the five-class sleep-stage classification is shown in Table 7.

4. Discussion

The PSG is widely recognized as a key element for assessing sleep phases and diagnosing sleep disorders. PSG-based approaches require the use of many connected sensing devices to capture the actions of various biomedical signals, as well as time-consuming analytic methods. Furthermore, the sleep measurements must be performed nightly in a professional sleep lab or clinic. As a result, it is essential to investigate novel approaches that can yield reliable outputs that are comparable to conventional sleep-staging PSG-based techniques, but that are simpler, less costly, and more comfortable for patients. The suggested method addresses all of the issues associated with earlier methods by employing a basic and straightforward methodology to classify sleep stages reliably.
This proposed study has provided an automatic sleep-stage classification system employing PSG signals. The suggested study considers a five-class and a three-class sleep-stage classification method. We used two unipolar EEG channels (C4-A1 and C3-A2), one EMG channel, and two EOG channels (EOG-L and EOG-R) separately and in combination for the present study. In addition, we used an orthogonal filter bank to decompose PSG epochs using a five-level one-dimensional wavelet filter bank.
As shown in Table 8, the proposed technique has obtained the highest classification accuracies compared to prior studies for three-class and five-class problems. The proposed approach acquired 90.70% and 91.80% accuracy for the three-stage classification by using the visit-1 and visit-2 datasets, respectively. Morevoer, the technique obtained a higher Cohen’s κ coefficient for both datasets compared to previous studies. Biswal et al. [24] employed only the SHHS-1 dataset using RCNN to categorize five-class sleep stages and achieved an accuracy of 77.90% while using only two uni-polar channels. The current study uses both datasets (visit-1 and visit-2) and EEG, EMG, and EOG channels both separately and together. Furthermore, the proposed study focuses on three- and five-stage categorization and achieves high accuracy. Sors et al. and Seo et al. [6,41] employed a single dataset (visit-1) and a single EEG channel to categorize five sleep phases while the suggested method employs a large dataset (visit-1 and visit-2) to score sleep stages. Linda Zhang et al. and Fernandez-Varela et al. [5,26] used a single dataset with three channels (EEG, EMG, and EOG) for five-class classification. Additionally, Wongsirichot et al. [27] used the visit-2 dataset with 14 biomedical channels for 5-class stage classification using a k-nearest neighbor classifier, and achieved an accuracy of 83.76%, which is less than the proposed method. The proposed technique used five channels for three-stage and five-stage classification and employs an ensemble bagged tree classifier, and achieved higher classification accuracy.
The current work is unique because it gives an idea about how different PSG signals contribute to the sleep-scoring capability of a machine learning model. We observed that EEG signals are the most effective in sleep scoring, followed by EOG and EMG signals. A combination of these channels yields even better sleep-scoring capabilities, and helps develop a system that can score sleep stages in an effective, rapid, and simple manner. The following are some additional advantages of the proposed study:
  • This is the first study that employs a huge database with two subsets, visit-1 with 5791 subjects and visit-2 with 2535 subjects, and it is also the first study to employ more epochs (5,861,304 for visit-1 and 3,037,838 for visit-2) than previous research [5,6,24,41]. We have used 75468 h of sleep recordings (48861 h in visit-1 and 26607 h in visit-2);
  • The proposed model demonstrated high recognition accuracy for the three- and five-stage classification tasks examined in this study. Table 2, Table 3, Table 4 and Table 5 show that the EMG is the least-accurate signal in sleep-scoring tasks, whereas EEG is the most-accurate one. EOG-R and EOG-L had similar scoring capabilities, and taking only one did not significantly change the outcome. A combination of all five target signals yielded the best-performing model;
  • We have used orthogonal filters to create a new five-level, one-dimensional wavelet decomposition class. Tsallis entropy is used to extract the features from every sub-band;
  • We extracted Tsallis entropy-based features from two EOG channels, two uni-polar EEG channels, and one EMG, with sampling frequencies of 125 Hz, 50 Hz, and 125 Hz. This made the process easier and more computationally efficient;
  • A system for detecting sleep stages that is simple, rapid, and accurate is being developed;
  • For both SHHS sleep datasets, the suggested model produced high Cohen’s κ coefficient values (greater than 0.75).
The limitations of the proposed method are as follows:
  • Because of the restricted amount of data available in an unbalanced database, the proposed method achieves lower accuracy in categorizing the N1 sleep stage (SHHS). However, balancing the employed data improves the classification of the N1 sleep stage;
  • Wavelet-based features take longer to compute than traditional statistical features. However, interestingly, the same wavelet filter is used to remove noise;
  • The suggested method employs PSG signals with many channels, which may cause a little inconvenience to individuals. The portable recording machines that can be used at homes are also more expensive;
  • Since the database has many participants, the machine learning classifier takes longer to categorize sleep stages.
Deep learning (DL) is now widely used to categorize biomedical signals [42]. However, DL-based algorithms perform well when dealing with large databases [43]. As a result, we plan to incorporate deep learning (DL) techniques such as recurrent neural networks (RNN), long short-term memory (LSTM), and auto-encoders into our future study.

5. Conclusions

The identification of the sleep stages plays a significant role in sleep science. Normal sleep rating in a sleep clinic utilizing human PSG records is costly and difficult for experts. In certain ways, defining the sleep cycle process will reduce costs and accelerate sleep research. In this work, we propose a technique for automatic sleep-stage classification using PSG signals. We employed two unipolar EEG channels (C4-A1 and C3-A2), one EMG channel, and two EOG channels (EOG-L and EOG-R) individually and in various combinations for three-class and five-class classification tasks. We used the PSG signal recordings of 5791 subjects from the visit-1 dataset, and 2535 subjects from the visit-2 dataset. The PSG signals were segmented into numerous 30 s epochs corresponding to three and five classes, and each epoch was subjected to a five-level, one-dimensional wavelet decomposition using an orthogonal filter bank. This was followed by computing the Tsallis entropy-based features for each sub-band.
The proposed method employs an EBT classifier with 10% holdout validation for the three-class and five-class classification problems. The proposed method achieved a maximum accuracy of 90.70% with the visit-1 dataset and of 91.80% with the visit-2 dataset for three-class classification, while for the five-class sleep-stage classification, we achieved an accuracy of 84.30% with visit-1 and 86.30% with visit-2. Further, when the visit-1 and visit-2 datasets were used, the model produced higher Cohen’s κ coefficients (0.838 (visit-1) and 0.86 (visit-2) for the three-class classification and 0.7746 (visit-1) and 0.8007(visit-2) for the five-class one, respectively). The proposed model’s classification accuracy reveals that it can effectively categorize sleep stages utilizing 30 s duration and PSG signals, and it can be employed in home-based systems and clinics to classify sleep stages.

Author Contributions

Conceptualization, M.S.; methodology, M.S. and A.Y.; software, A.Y.; validation, M.S., A.Y. and J.T.; formal analysis, M.S. and J.T.; investigation, M.S. and A.Y.; data curation, A.Y.; writing—original draft preparation, M.S., A.Y. and J.T.; writing—review and editing, M.K., O.Y. and U.R.A.; supervision, U.R.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data used in this work is available upon request on National Sleep Research Resource.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

REMRapid Eye Movement
AASMAmerican Academy of Sleep Stages
PSGPolysomnography
EEGElectroencephalogram
EOGElectrooculogram
ECGElectrocardiogram
EMGElectromyogram
SHHSSleep Heart Health Study
NSRRNational Sleep Research Resource
BMIBody Mass Index
ESSEpworth Sleepiness Scale
EBTEnsemble Bagged Tree
LSTMLong Short-Term Memory

References

  1. Sleep Computing Committee of the Japanese Society of Sleep Research Society (JSSR); Hori, T.; Sugita, Y.; Koga, E.; Shirakawa, S.; Inoue, K.; Uchida, S.; Kuwahara, H.; Kousaka, M.; Kobayashi, T.; et al. Proposed supplements and amendments to ‘A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects’, the Rechtschaffen & Kales (1968) standard. Psychiatry Clin. Neurosci. 2001, 55, 305–310. [Google Scholar]
  2. Berry, R.B.; Brooks, R.; Gamaldo, C.E.; Harding, S.M.; Marcus, C.; Vaughn, B.V. The AASM manual for the scoring of sleep and associated events. Rules Terminol. Tech. Specif. Darien Ill. Am. Acad. Sleep Med. 2012, 176, 2012. [Google Scholar]
  3. Sharma, M.; Bhurane, A.; Acharya, U.R. An expert system for automated classification of phases in cyclic alternating patterns of sleep using optimal wavelet-based entropy features. Expert Syst. 2022, e12939. [Google Scholar] [CrossRef]
  4. Sharma, M.; Patel, V.; Tiwari, J.; Acharya, U.R. Automated Characterization of Cyclic Alternating Pattern Using Wavelet-Based Features and Ensemble Learning Techniques with EEG Signals. Diagnostics 2021, 11, 1380. [Google Scholar] [CrossRef] [PubMed]
  5. Zhang, L.; Fabbri, D.; Upender, R.; Kent, D. Automated sleep stage scoring of the Sleep Heart Health Study using deep neural networks. Sleep 2019, 42, zsz159. [Google Scholar] [CrossRef] [PubMed]
  6. Sors, A.; Bonnet, S.; Mirek, S.; Vercueil, L.; Payen, J.F. A convolutional neural network for sleep stage scoring from raw single-channel EEG. Biomed. Signal Process. Control 2018, 42, 107–114. [Google Scholar] [CrossRef]
  7. Rosenberg, R.S.; Van Hout, S. The American Academy of Sleep Medicine inter-scorer reliability program: Sleep stage scoring. J. Clin. Sleep Med. 2013, 9, 81–87. [Google Scholar] [CrossRef]
  8. Vallat, R.; Walker, M.P. A universal, open-source, high-performance tool for automated sleep staging. bioRxiv 2021. [Google Scholar] [CrossRef]
  9. Fiorillo, L.; Puiatti, A.; Papandrea, M.; Ratti, P.L.; Favaro, P.; Roth, C.; Bargiotas, P.; Bassetti, C.L.; Faraci, F.D. Automated sleep scoring: A review of the latest approaches. Sleep Med. Rev. 2019, 48, 101204. [Google Scholar] [CrossRef]
  10. Yildirim, O.; Baloglu, U.B.; Acharya, U.R. A deep learning model for automated sleep stages classification using PSG signals. Int. J. Environ. Res. Public Health 2019, 16, 599. [Google Scholar] [CrossRef]
  11. Rechtschaffen, A. A manual for standardized terminology, techniques and scoring system for sleep stages in human subjects. Brain Inf. Serv. 1969, 20, 246–247. [Google Scholar]
  12. Dhok, S.; Pimpalkhute, V.; Chandurkar, A.; Bhurane, A.A.; Sharma, M.; Acharya, U.R. Automated phase classification in cyclic alternating patterns in sleep stages using Wigner–Ville distribution based features. Comput. Biol. Med. 2020, 119, 103691. [Google Scholar] [CrossRef] [PubMed]
  13. Rahman, M.; Bhuiyan, M.; Hassan, A.R. Sleep stage classification using single-channel EOG. Comput. Biol. Med. 2018, 102, 211–220. [Google Scholar] [CrossRef]
  14. Boostani, R.; Karimzadeh, F.; Nami, M. A comparative review on sleep stage classification methods in patients and healthy individuals. Comput. Methods Programs Biomed. 2017, 140, 77–91. [Google Scholar] [CrossRef] [PubMed]
  15. Sharma, M.; Patel, V.; Acharya, U.R. Automated identification of insomnia using optimal bi-orthogonal wavelet transform technique with single-channel EEG signals. Knowl.-Based Syst. 2021, 224, 107078. [Google Scholar] [CrossRef]
  16. Bhati, D.; Pachori, R.; Sharma, M.; Gadre, V. Automated Detection of Seizure and Nonseizure EEG Signals Using Two Band Biorthogonal Wavelet Filter Banks; Naik, G., Ed.; Series in BioEngineering; Springer: Singapore, 2020; pp. 137–155. [Google Scholar] [CrossRef]
  17. Sharma, M.; Kumbhani, D.; Yadav, A.; Acharya, U.R. Automated Sleep apnea detection using optimal duration-frequency concentrated wavelet-based features of pulse oximetry signals. Appl. Intell. 2021, 52, 1325–1337. [Google Scholar] [CrossRef]
  18. Sharma, M.; Dhiman, H.; Acharya, U.R. Automatic identification of insomnia using optimal antisymmetric biorthogonal wavelet filter bank with ECG signals. Comput. Biol. Med. 2021, 131, 104246. [Google Scholar] [CrossRef]
  19. Sharma, M.; Tiwari, J.; Patel, V.; Acharya, U.R. Automated Identification of Sleep Disorder Types Using Triplet Half-Band Filter and Ensemble Machine Learning Techniques with EEG Signals. Electronics 2021, 10, 1531. [Google Scholar] [CrossRef]
  20. Loh, H.; Ooi, C.; Dhok, S.; Sharma, M.; Bhurane, A.; Acharya, U.R. Automated detection of cyclic alternating pattern and classification of sleep stages using deep neural network. Appl. Intell. 2022, 55, 2903–2917. [Google Scholar] [CrossRef]
  21. Sharma, M.; Patel, S.; Choudhary, S.; Acharya, U.R. Automated Detection of Sleep Stages Using Energy-Localized Orthogonal Wavelet Filter Banks. Arab. J. Sci. Eng. 2020, 45, 2531–2544. [Google Scholar] [CrossRef]
  22. Quan, S.; Howard, B.; Iber, C.; Kiley, J.; Nieto, F.; O’Connor, G.; Rapoport, D.; Redline, S.; Robbins, J.; Samet, J.; et al. The Sleep Heart Health Study: Design, rationale, and methods. Sleep 1997, 20, 1077–1085. [Google Scholar] [PubMed]
  23. Zhang, G.Q.; Cui, L.; Mueller, R.; Tao, S.; Kim, M.; Rueschman, M.; Mariani, S.; Mobley, D.; Redline, S. The National Sleep Research Resource: Towards a sleep data commons. J. Am. Med. Inform. Assoc. 2018, 25, 1351–1358. [Google Scholar] [CrossRef] [PubMed]
  24. Biswal, S.; Sun, H.; Goparaju, B.; Westover, M.B.; Sun, J.; Bianchi, M. Expert-level sleep scoring with deep neural networks. J. Am. Med. Inform. Assoc. JAMIA 2018, 25, 1643–1650. [Google Scholar] [CrossRef]
  25. Zhang, Y.; Yang, Z.; Lan, K.; Liu, X.; Zhang, Z.; Li, P.; Cao, D.; Zheng, J.; Pan, J. Sleep stage classification using bidirectional lstm in wearable multi-sensor systems. In Proceedings of the IEEE INFOCOM 2019-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Paris, France, 29 April–2 May 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 443–448. [Google Scholar]
  26. Fernández-Varela, I.; Hernández-Pereira, E.; Moret-Bonillo, V. A convolutional network for the classification of sleep stages. Multidiscip. Digit. Publ. Inst. Proc. 2018, 2, 1174. [Google Scholar]
  27. Wongsirichot, T.; Elz, N.; Kajkamhaeng, S.; Nupinit, W.; Sridonthong, N. An Investigation of Data Mining Based Automatic Sleep Stage Classification Techniques. Int. J. Mach. Learn. Comput. 2019, 9, 520–526. [Google Scholar] [CrossRef]
  28. Daubechies, I. Ten Lectures on Wavelets; SIAM: Philadelphia, PA, USA, 1992. [Google Scholar]
  29. Sharma, M.; Shah, S.; Achuth, P. A novel approach for epilepsy detection using time–frequency localized bi-orthogonal wavelet filter. J. Mech. Med. Biol. 2019, 19, 1940007. [Google Scholar] [CrossRef]
  30. Sharma, M.; Kumbhani, D.; Tiwari, J.; Kumar, T.S.; Acharya, U.R. Automated detection of obstructive sleep apnea in more than 8000 subjects using frequency optimized orthogonal wavelet filter bank with respiratory and oximetry signals. Comput. Biol. Med. 2022, 144, 105364. [Google Scholar] [CrossRef]
  31. Sharma, M.; Bhurane, A.A.; Acharya, U.R. MMSFL-OWFB: A novel class of orthogonal wavelet filters for epileptic seizure detection. Knowl. Based Syst. 2018, 160, 265–277. [Google Scholar] [CrossRef]
  32. Sharma, M.; Tan, R.; Acharya, U.R. A novel automated diagnostic system for classification of myocardial infarction ECG signals using an optimal biorthogonal filter bank. Comput. Biol. Med. 2018, 102, 341–356. [Google Scholar] [CrossRef]
  33. Ebrahimzadeh, A.; Giski, Z. Tsallis Entropy of Partitions in Quantum Logics. Int. J. Theor. Phys. 2019, 58, 672–686. [Google Scholar] [CrossRef]
  34. Amigó, J.; Balogh, S.; Hernández, S. A Brief Review of Generalized Entropies. Entropy 2018, 20, 813. [Google Scholar] [CrossRef]
  35. Sharma, M.; Acharya, U.R. Automated detection of schizophrenia using optimal wavelet-based l_1 norm features extracted from single-channel EEG. Cogn. Neurodyn. 2021, 15, 661–674. [Google Scholar] [CrossRef] [PubMed]
  36. Dong, X.; Yu, Z.; Cao, W.; Shi, Y.; Ma, Q. A survey on ensemble learning. Front. Comput. Sci. 2020, 14, 241–258. [Google Scholar] [CrossRef]
  37. Dietterich, T.G. Ensemble learning. Handb. Brain Theory Neural Netw. 2002, 2, 110–125. [Google Scholar]
  38. Zvarevashe, K.; Olugbara, O. Ensemble learning of hybrid acoustic features for speech emotion recognition. Algorithms 2020, 13, 70. [Google Scholar] [CrossRef]
  39. Kulkarni, A.; Chong, D.; Batarseh, F.A. Foundations of data imbalance and solutions for a data democracy. In Data Democracy; Elsevier: Amsterdam, The Netherlands, 2020; pp. 83–106. [Google Scholar]
  40. Bishop, C.M.; Nasrabadi, N.M. Pattern Recognition and Machine Learning; Springer: Berlin/Heidelberg, Germany, 2006; Volume 4. [Google Scholar]
  41. Seo, H.; Back, S.; Lee, S.; Park, D.; Kim, T.; Lee, K. Intra-and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG. Biomed. Signal Process. Control 2020, 61, 102037. [Google Scholar] [CrossRef]
  42. Murarka, S.; Wadichar, A.; Bhurane, A.; Sharma, M.; Acharya, U.R. Automated classification of cyclic alternating pattern sleep phases in healthy and sleep-disordered subjects using convolutional neural network. Comput. Biol. Med. 2022, 105594. [Google Scholar] [CrossRef]
  43. Loh, H.W.; Ooi, C.P.; Vicnesh, J.; Oh, S.L.; Faust, O.; Gertych, A.; Acharya, U.R. Automated Detection of Sleep Stages Using Deep Learning Techniques: A Systematic Review of the Last Decade (2010–2020). Appl. Sci. 2020, 10, 8963. [Google Scholar] [CrossRef]
Figure 1. Block diagram of the proposed work.
Figure 1. Block diagram of the proposed work.
Ijerph 19 07176 g001
Table 1. Summary of the SHHS database.
Table 1. Summary of the SHHS database.
VariableSHHS-1SHHS-2
Subject Count57932651
Size of Dataset216 GB137 GB
Male Patients30331425
Female Patients27601226
meanstdminmaxmeanstdminmax
Age (year)63.1411.23399067.2310.384490
Body Mass Index (BMI)28.165.09185028.315.051850
Epworth Sleepiness Scale (ESS) score7.774.40247.514.21024
Total Sleep Time (minutes)506.0737.36180599.5602.1568.52261845.5
Wake (%)28.7212.291.5691.4237.4311.627.2988.16
Repid Eye Moment (REM) Sleep (%)13.965.75035.7312.975.15034.31
Non-REM stage 1 (%)3.72.62023.83.512.9076.35
Non-REM stage 2 (%)40.9811.433.6993.6436.189.46083.43
Non-REM stage 3 (%)11.847.97053.849.496.89043.82
Sleep Efficiency (%)71.2812.298.5898.4462.5711.6211.8492.71
Total Epochs5,861,3043,037,838
Table 2. Classification performance using different combinations of channels for classifying three sleep stages using SHHS-1.
Table 2. Classification performance using different combinations of channels for classifying three sleep stages using SHHS-1.
SignalsAccuracy(%)Cohen’s
WNREMREMOverallKappa
EMG83.0672.2887.4671.600.4552
EOG-R86.2681.7887.4477.750.5941
EOG-L86.4181.7587.3677.750.5941
EEG (C4-A1)91.3684.5188.7882.000.8305
EEG (C3-A2)91.2984.3488.4282.350.6839
EEG (C4-A1 + C3-A2)93.2287.6390.9986.000.7489
EMG + EOG-R89.8785.0191.6683.250.6975
EMG + EOG-L89.9385.0191.6283.250.6977
EOG-R + EOG-L88.5284.8588.8281.150.6581
EMG + EOG-R + EOG-L90.4686.2392.1584.400.7188
C3-A2 + C4-A1 + EMG94.0889.7793.4488.650.798
C3-A2 + C4-A1 + EOG-R + EOG-L94.6090.8793.4189.400.8109
C3-A2 + C4-A1 +EMG +EOG-R95.0091.6794.4690.550.8316
C3-A2 + C4-A1 +EMG +EOG-L94.9891.6294.4190.500.8109
C3-A2 + C4-A1 + EMG + EOG-R + EOG-L95.0591.8194.5290.700.8338
Table 3. Classification performance using different combinations of channels for classifying three sleep stages using SHHS-2.
Table 3. Classification performance using different combinations of channels for classifying three sleep stages using SHHS-2.
SignalsAccuracy(%)Cohen’s
WNREMREMOverallKappa
EMG83.0572.9288.0972.000.5073
EOG-R87.4083.9088.3979.800.6533
EOG-L87.3383.8488.4479.800.6526
EEG (C4-A1)91.9086.0189.4983.200.7122
EEG (C3-A2)91.6185.7389.0283.700.7217
EEG (C4-A1 + C3-A2)93.6088.7491.4586.900.7766
EMG + EOG-R90.8786.8292.5285.100.7456
EMG + EOG-L90.8586.8892.5985.100.7461
EOG-R + EOG-L88.7386.2190.0482.500.6994
EMG + EOG-R + EOG-L91.4588.1893.2086.400.7683
C3-A2 + C4-A1 + EMG94.3790.7994.0589.600.8237
C3-A2 + C4-A1 + EOG-R + EOG-L95.1492.1593.9790.600.8406
C3-A2 + C4-A1 + EMG + EOG-R95.4392.7895.0591.600.8578
C3-A2 + C4-A1 + EMG + EOG-L95.3492.6795.0491.500.8561
C3-A2 + C4-A1 + EMG + EOG-R + EOG-L95.4492.9295.1491.800.8600
Table 4. Classification performance using different combinations of channels for classifying five sleep stages using SHHS-1.
Table 4. Classification performance using different combinations of channels for classifying five sleep stages using SHHS-1.
SignalsAccuracy(%)Cohen’s
WN1N2N3REMOverallKappa
EMG83.3996.3665.9088.5286.9359.250.4125
EOG-R87.7596.6080.0592.0588.8867.950.5733
EOG-L85.6795.9576.6290.6386.8067.850.5328
EEG(C4-A1)91.1396.0179.6993.1888.5774.300.6303
EEG(C3-A2)91.0896.0279.9293.3688.2174.300.6301
EEG(C4-A1 + C3-A2)92.8396.1883.4894.6490.8779.100.6970
EMG + EOG-R89.4596.1680.1392.4491.5074.850.6354
EMG + EOG-L89.4796.1880.1592.4791.3574.800.6350
EOG-R + EOG-L86.9995.9478.8691.6288.4770.900.5787
EMG + EOG-R + EOG-L90.0696.2081.6193.0392.1476.500.6600
C3-A2 + C4-A1 + EMG93.8496.2685.8895.3193.3582.300.7462
C3-A2 + C4-A1 + EOG-R + EOG-L94.4596.1986.8195.2093.2883.000.7553
C3-A2 + C4-A1 + EMG + EOG-R94.7396.2587.3795.5394.3784.150.7720
C3-A2 + C4-A1 + EMG + EOG-L94.7696.3187.3095.5194.2884.050.7714
C3-A2 + C4-A1 + EMG + EOG-R + EOG-L94.7996.2587.5595.5794.4584.300.7746
Table 5. Classification performance using different combinations of channels for classifying five sleep stages using SHHS-2.
Table 5. Classification performance using different combinations of channels for classifying five sleep stages using SHHS-2.
SignalsAccuracy(%)Cohen’s
WN1N2N3REMOverallKappa
EMG81.6496.3166.6789.9986.9960.800.4119
EOG-R86.9596.2479.9192.8487.9271.900.5864
EOG-L86.8896.2980.0092.8488.0372.000.5878
EEG(C4-A1)91.7696.2582.4094.7189.2676.700.6605
EEG(C3-A2)91.3196.2582.3395.0988.7077.200.6657
EEG(C4-A1 + C3-A2)93.4396.4185.9296.0591.2981.500.7301
EMG + EOG-R90.4096.4082.9094.1492.3578.100.6788
EMG + EOG-L90.5096.3883.1094.1892.4378.300.6812
EOG-R + EOG-L88.1796.3082.1393.6189.6274.900.6308
EMG + EOG-R + EOG-L91.0296.4084.2694.5493.1179.700.7016
C3-A2 + C4-A1 + EMG94.1496.4587.5896.3293.9784.200.7697
C3-A2 + C4-A1 + EOG-R + EOG-L94.9396.4188.9096.4193.8185.200.7844
C3-A2 + C4-A1 + EMG + EOG-R95.1996.4389.2096.5194.9686.100.7979
C3-A2 + C4-A1 + EMG + EOG-L95.1896.4389.1596.4994.9886.100.7975
C3-A2 + C4-A1 + EMG + EOG-R + EOG-L95.2096.4489.3596.5595.1386.300.8007
Table 6. Confusion matrix relating to three sleep stages’ classification by using combined signals with 10% hold-out validation.
Table 6. Confusion matrix relating to three sleep stages’ classification by using combined signals with 10% hold-out validation.
Predicted class Predicted class
WakeNREM WakeNREM
True classWake 92 % 7 % 1 % True classWake 95 % 5 % 1 %
N 3 % 95 % 2 % N 3 % 95 % 2 %
REM 6 % 23 % 71 % REM 7 % 21 % 72 %
SHHS-1SHHS-2
Table 7. Confusion matrix relating to five sleep stages’ classification by using combined signals with 10% hold-out validation.
Table 7. Confusion matrix relating to five sleep stages’ classification by using combined signals with 10% hold-out validation.
Predicted class Predicted class
WakeN1N2N3REM WakeN1N2N3REM
True classWake 93 % 1 % 4 % 1 % 1 % True classWake 96 % <1% 3 % <1% 1 %
N1 24 % 12 % 47 % <1% 17 % N1 26 % 11 % 50 % 14 %
N2 3 % <1% 90 % 4 % 3 % N2 3 % 1 % 90 % 3 % 2 %
N3 1 % <1% 22 % 77 % <1%N3<1% 22 % 77 % <1%
REM 6 % 1 % 17 % <1% 75 % REM 7 % 1 % 16 % <1% 75 %
SHHS-1SHHS-2
Table 8. Comparison with existing state-of-the-art approaches in terms of accuracy and Cohen’s κ .
Table 8. Comparison with existing state-of-the-art approaches in terms of accuracy and Cohen’s κ .
StudyDatabaseSubjectSignalAccuracyCohen’s κ
C = 3C = 5C = 3C = 5
Sors et al. [6]SHHS-15793C4-A1-87%-0.81
Biswal et al. [24]SHHS-15791C4-A1, C3-A2-77.90%-0.73
Linda zhang et al. [5]SHHS-15793EEG + EMG + EOG-87%-0.82
Fernandez-Varela et al. [26]SHHS-1500EEG + EMG + EOG-78%-0.83
Wongsirichot et al. [27]SHHS-2253514 Biomedical-83.70%-N/A
Seo et al. [41]SHHS-15791C4-A1-86.30%-0.81
Proposed Work SHHS-15791EEG + EMG + EOG90.70%84.30%0.830.77
SHHS-22535EEG + EMG + EOG91.80%86.30%0.860.80
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sharma, M.; Yadav, A.; Tiwari, J.; Karabatak, M.; Yildirim, O.; Acharya, U.R. An Automated Wavelet-Based Sleep Scoring Model Using EEG, EMG, and EOG Signals with More Than 8000 Subjects. Int. J. Environ. Res. Public Health 2022, 19, 7176. https://doi.org/10.3390/ijerph19127176

AMA Style

Sharma M, Yadav A, Tiwari J, Karabatak M, Yildirim O, Acharya UR. An Automated Wavelet-Based Sleep Scoring Model Using EEG, EMG, and EOG Signals with More Than 8000 Subjects. International Journal of Environmental Research and Public Health. 2022; 19(12):7176. https://doi.org/10.3390/ijerph19127176

Chicago/Turabian Style

Sharma, Manish, Anuj Yadav, Jainendra Tiwari, Murat Karabatak, Ozal Yildirim, and U. Rajendra Acharya. 2022. "An Automated Wavelet-Based Sleep Scoring Model Using EEG, EMG, and EOG Signals with More Than 8000 Subjects" International Journal of Environmental Research and Public Health 19, no. 12: 7176. https://doi.org/10.3390/ijerph19127176

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop