1. Introduction
Obstructive Sleep Apnea Syndrome (OSAS) is a prevalent sleep disorder characterized by repeated episodes of upper airway obstruction during sleep, leading to disrupted breathing patterns and decreased oxygen levels in the blood. This condition affects individuals across all age groups, with a higher prevalence observed in males and older adults [
1]. The consequences of untreated OSAS extend beyond mere sleep disturbances, encompassing a myriad of systemic complications such as hypertension, cardiovascular diseases, cognitive impairment, metabolic dysregulation, and increased risk of accidents due to daytime sleepiness [
2]. Despite its serious implications, OSAS often goes undiagnosed or misdiagnosed, primarily due to its symptomatic overlap with common sleep disturbances. Notably, snoring, often dismissed as a benign habit, serves as a hallmark symptom of OSAS, indicating the need for further evaluation [
3]. Early detection and intervention are imperative to mitigate the adverse health outcomes associated with OSAS, underscoring the importance of comprehensive sleep evaluations and polysomnography (PSG) in at-risk populations [
4].
Recently, there has been rapid growth in the mobile applications (apps) business in the medical field. Among these, some aim to diagnose and monitor ear, nose, and throat (ENT) diseases. Subspecialties such as sleep medicine and rhinology have been particularly interested in the development of apps released on the Apple App Store and the Google Play Store. While these apps are available to patients, the quality varies, and only a few clinical trials have tested their accuracy [
5]. An attempt to overcome this limitation and standardize contents has been seen in the development of the Mobile Application Rating Scale (MARS) [
6], a simple tool for assessing the overall quality of health mobile apps together with aesthetics, engagement, function and information (score 1 to 5). MARS can also be used to provide a checklist for the design and development of new high-quality health apps.
With more than 13 million downloads and 10,000 reviews, SnoreLab [Reviva Softworks Ltd., London, UK;
https://www.snorelab.com/ (accessed on 27 April 2024)] is featured as the number one iOS and Android app for recording and tracking snoring. SnoreLab provides measurements of snoring intensity and duration. Users can track their snoring patterns overnight, allowing for better understanding and management of their sleep health. SnoreLab offers a straightforward interface, requiring only the press of a button to initiate recording, with no need for calibration. This simplicity facilitates effortless usage. The app compares individuals’ snoring patterns longitudinally, facilitating the assessment of interventions and lifestyle modifications’ efficacy. Furthermore, it provides comprehensive information on various snoring remedies and factors influencing snoring, thereby empowering users with knowledge crucial for informed decision-making regarding their sleep health. SnoreLab does not serve as a diagnostic tool for OSAS; however, as stated on their website, “
some users have discovered sounds in their recordings that indicate apnea events, and then found them useful in subsequent medical consultations”. Also, the app may be beneficial in capturing evidence of sleep apnea, such as “
to identify risky periods using the tell-tale sign of silence followed by gasping or choking” [
https://www.snorelab.com/sleep-apnea-screening-testing-and-treatment/ (accessed on 27 April 2024)]. These data can prove valuable when shared with an otorhinolaryngologist or trained sleep apnea specialist to optimize treatment strategies.
According to a previous systematic review published by our group [
5], SnoreLab received a MARS score of 3.7, with the highest scores according to aesthetics and function. Despite its remarkable popularity, SnoreLab’s validation has not been extensively reported in the literature, and the published reports are scarce. Only two clinical trials [
7,
8] and one case report [
9] have assessed its accuracy or utilized SnoreLab in a clinical setting.
Klaus et al. [
7] evaluated the accuracy of the SnoreLab smartphone app in monitoring snoring compared to full-night PSG. The results show the app’s acceptable accuracy values in measuring snoring >50% per night: 94.7% accuracy, 100% sensitivity, and 94.1% specificity. However, it fails to detect obstructive events. Best agreement was observed when comparing loud and epic snoring ratios with total snoring ratio. Therefore, the SnoreLab app is deemed suitable for measuring heavy snoring, but not obstructive events. In the randomized trial by Sperger et al. [
8], SnoreLab was used to assess the effect of myofunctional therapy (MT) on snoring in obese patients. The study aimed to assess the effectiveness of MT in treating habitual snoring in obese patients. Despite subjective improvements reported in the experimental group, assessment via the SnoreLab app showed no significant effect of MT on snoring variables compared to the control group. Additionally, neck circumference and sleep quality worsened after treatment, suggesting that MT may not be effective in managing habitual snoring in this population. The case report by Figueras-Alvarez et al. [
9] aimed to assess the consistency of snoring measurements using the SnoreLab app across three different smartphones, intending to validate its use in studies on snoring treatment effectiveness. While overall measurements showed strong correlation, significant differences were noted among smartphones in assessing various snoring parameters. This suggests challenges in utilizing the SnoreLab app across different devices for research purposes, but highlights its potential for individual treatment monitoring.
The primary objective of this study was to conduct a comparative analysis between the results derived from the SnoreLab scoring system, which is predicated on the recording of patients’ snoring, and the parameters obtained from overnight, in-hospital PSG [
10]. By juxtaposing the outcomes of SnoreLab against those of PSG, we sought to provide insights into its utility and efficacy as a diagnostic tool for evaluating sleep-related disorders. Through this comprehensive examination, we aimed to contribute valuable information to the ongoing discourse surrounding the clinical use of SnoreLab, thereby fostering a deeper understanding of its diagnostic capabilities, and facilitating informed decision-making in clinical practice. The overarching aim was to elucidate the potential strengths and limitations of this promising tool within the realm of sleep diagnostics.
2. Materials and Methods
The research was conducted prospectively from September 2020 to December 2021, involving voluntary patients enrolled at the Otorhinolaryngology (ORL) department of Foggia University Hospital. Data collection adhered to the Guideline for Good Clinical Practice and the ethical principles outlined in the Declaration of Helsinki. Institutional review board approval was secured for the completion of this study (Department of ORL—University Hospital of Foggia, n. 0010 of 31 January 2020), and written informed consent was obtained from each participating patient.
2.1. Patients’ Selection and Study Design
Male and female patients between 18 and 75 years of age, seeking medical counseling for suspected OSAS, were considered potentially eligible to participate in this study.
All patients received instructions regarding the study procedures and the functioning of SnoreLab (Premium version). Detailed medical histories, including information on comorbidities such as diabetes mellitus, dyslipidemia, high blood pressure, and obesity, as well as age and timing of OSAS diagnosis, were obtained. Each patient underwent a full-night PSG examination, with simultaneous recordings using SnoreLab. For the recordings, an iPhone SE was used in all patients. To minimize bias, the recording smartphone was positioned within one meter of the patient’s head, connected to a power source, and set to flight mode. To avoid background noise, no other patients were present in the room during completion of the exam. Exclusion criteria encompassed severe psychological or neurological disorders, substance abuse, and an inability to follow instructions or maintain focus and concentration.
2.2. SnoreLab (Reviva Softworks Ltd., London, UK)
SnoreLab, developed by Reviva Softworks Ltd., is a mobile app designed for recording, measuring, and tracking patients’ snoring, utilizing the smartphone’s microphone. While its primary function involves screening for snoring patterns, it also allows the comparison of snoring trends over time, thereby offering potential utility in follow-up assessments and the evaluation of the efficacy of remedies and lifestyle modifications. Notably, the app is classified as a medical device and is ranked among the top 50 in the Apple app store. For this study, the premium version of SnoreLab (EUR 5.99/monthly) allows multiple registrations and was used in this study.
Utilizing an algorithm, a “Snore Score” is generated, reflecting the intensity and frequency of snoring. The median Snore Score among SnoreLab users is 25, with a score ≥ 50 indicative of an advanced snoring category. As per the developer’s recommendations, individuals with scores ≥ 100 should seek medical advice, whereas a score ≤ 10 is considered a favorable target. Moreover, snoring severity is further categorized as “light” when unlikely to disturb a bed partner, “loud” when likely to disturb a bed partner, and “epic” when highly likely to disturb a bed partner.
2.3. Polysomnography
An overnight hospital PSG (Embletta MPR PG
® Natus Medical Incorporated. Pleasanton, CA, USA) confirmed the diagnosis of OSAS. Electrocardiograph, thoracoabdominal movements, respiratory airflow, finger oxygen saturation, and body position, along with other standard indicators, were obtained. Results were classified according to the criteria of the American Academy of Sleep Medicine (AASM) for the Scoring of Sleep and Associated Events [
11]. The severity of OSAS was categorized according to the Apnea Hypopnea Index (AHI) as follows: none/minimal (AHI < 5 per hour); mild (≥5 AHI < 15 per hour); moderate (≥15 AHI < 30 per hour); severe (≥30 per hour).
2.4. Statistical Analysis
Descriptive analysis was employed to define the main clinical and demographic features. Qualitative data were summarized as percentages. The main variable of study was the Snoring Score. Normality was explored by the Shapiro–Wilk test, resulting in a non-normal distribution (p-value = 0.022). Correlation to clinical and PSG parameters was investigated by Spearman’s rank correlation test (ρ). The Kruskal–Wallis test was used to investigate the differences in Snore Score among three groups of OSAS severity, as simple snoring, mild and moderate–severe.
A p-value ≤ 0.05 was considered the cut-off for statistical significance. The IBM® SPSS® Statistics version 25 was used to perform statistical analysis.
3. Results
Thirty-four patients underwent overnight hospital PSG at the ORL department of Foggia University Hospital during the study period. Out of this cohort, 3 patients were excluded due to an inability to operate a smartphone, and 12 were excluded owing to technical artifacts observed during PSG evaluation. Consequently, 55.9% of the initial sample (n = 19; 15 men, 4 women), with an average age of 50.9 ± 10.5 years, was included for analysis. None of the enrolled patients reported difficulties in adhering to the study protocol or utilizing the SnoreLab application.
According to the AHI, patients were classified as affected by simple snoring (31.6%;
n = 6), mild OSAS (36.8%;
n = 7), moderate OSAS (10.5%;
n = 2), and severe OSAS (21.1%;
n = 4). The demographic characteristics of the cohort (
Table 1), stratified based on the severity of OSAS, are consistent with findings in the current literature. They demonstrate a higher prevalence of the condition among male subjects and a corresponding escalation in comorbidities associated with the severity of the disease [
12].
The AHI and the percentage of sleep time with oxygen saturations lower than 90% (Tc90) obtained from PSG were compared with the app-based Snore Score (
Table 2). Spearman correlation analysis revealed a positive correlation in both instances, although statistical significance was not reached (AHI: Spearman’s ρ = 0.145,
p = 0.554; Tc90: Spearman’s ρ = 0.437,
p = 0.07).
The overall cohort exhibited a Snore Score of 24.8 ± 22.2 alongside an AHI of 15.1 ± 17.0, indicating moderate OSAS (
Table 2). Interestingly, elevated Snore Scores were observed in both the simple snoring (30.7 ± 19.2) and severe OSAS group (35.2 ± 21.4) (Kruskal–Wallis
p-value = 0.176).
Although the cohort exhibited an overall AHI of 15.1 ± 17.0, indicative of moderate OSAS, the average Snore Score reported was 24.8 ± 22.2, consistent with the median score observed among SnoreLab users. Consequently, following the instructions provided in the app, this finding does not warrant immediate medical intervention. The Spearman correlation analysis between Snore Score, AHI, and Tc90 did not demonstrate statistical significance.
4. Discussion
“Sleep medicine” is one of the ENT subspecialties with the highest number of medical apps for patients; however, the number of articles that validated these applications is much lower [
5]. Most applications in this category primarily focus on recording and analyzing sleep patterns, and providing graphical representations of various sleep phases and snoring intensity. Previous studies have shown that smartphones can conduct pre-screening examinations with comparable quality to traditional PSG. Conducting PSG via smartphones necessitates additional hardware implementation, such as a pulse oximeter, accelerometer, and external microphone [
13,
14]. However, research assessing whether these applications not only diagnose or characterize but also improve OSA remains limited [
15,
16,
17]. Additionally, the growing prevalence of consumer sleep technology, including snoring monitoring apps, has sparked privacy concerns. The AASM has addressed this issue by issuing a statement and guidelines [
18].
There remain significant doubts about the effectiveness of these apps, which can register only snoring without simultaneously monitoring other vital parameters. The SnoreLab app has been developed to record snoring patterns, measuring both the frequency and intensity of snoring throughout the night. It enables users to document their snoring over time, helping to track the effectiveness of various interventions. According to SnoreLab’s website, these interventions include lifestyle adjustments such as eating earlier, engaging in mouth exercises, adopting side-sleeping positions, taking short walks, or showering before bed. Health interventions such as weight loss and maintaining hydration are also supported. Due to its simplicity and intuitiveness, SnoreLab has become increasingly popular and demonstrated potential utility as a “sleep diary” to enhance patient awareness and compliance with treatments.
Based on the authors’ experiences, it has been observed that some patients use the app to record and bring audio files of their snoring to clinical consultations as evidence. Additionally, an important consideration is the common misconception among many patients who often confound snoring with OSAS. There is a significant clinical difference between the two, and this misunderstanding can lead to misdiagnoses and the inappropriate management of the conditions. Therefore, the app can play a critical role in educating users about these differences, emphasizing the importance of proper diagnosis and treatment.
Currently, computer software programmers are developing smartphone snoring apps, often with minimal involvement of sleep medicine practitioners in the development process. Camacho et al. demonstrated that select smartphone apps are user-friendly for recording and playing back snoring sounds. A preliminary comparison of over 1500 individual snores indicated potential clinical utility; however, further validation testing is recommended [
19]. A systematic review of smartphone applications and devices for OSAS identified 10 relevant smartphone apps that have been utilized in clinical settings for the diagnosis or treatment of sleep-disordered breathing. However, these apps, including SnoreLab, demonstrate lower accuracy compared to traditional options [
20]. Indeed, particularly regarding SnoreLab, in comparison to other snore recording apps such as SnoreMonitorSleepLab, Quit Snoring, and Snore Spectrum, the so-called “Snore Score” is notably non-transparent. The application does not provide information regarding the methodology used for calculating this score. Consequently, for scientific endeavors, it is considered unnecessary [
21].
Although in this study the app was tested in a hospital setting to avoid any recording bias, use at home can be quite different, and many environmental biases can interfere. In fact, other criticisms of SnoreLab and similar apps may arise due to recording interferences caused by the presence of other individuals sleeping nearby the patient [
17]. While the app’s algorithm can effectively filter out ambient noise and speech, it currently lacks the ability to differentiate between the breathing and snoring of others, presenting a confounding factor.
Based on our data, the results do not support the efficacy of SnoreLab in detecting obstructive events. In alignment with the current literature, this suggests the limited reliability of OSAS assessments that lack the integration of snoring recordings with data pertaining to respiratory airflow and thoracoabdominal movements [
13,
14]. In fact, Spearman correlation analysis did not reveal a statistically significant correlation between objective measures of PSG, such as AHI and Tc90 (AHI—Spearman’s ρ = 0.145,
p = 0.554; Tc90—Spearman’s ρ = 0.437,
p = 0.07).
Additionally, reporting the Snore Score as an average of about 25 may be misleading for patients, posing the risk that many individuals in need of immediate treatment may underestimate the severity of the condition. Moreover, the information section does not adequately explain when to seek medical counseling. In fact, according to SnoreLab’s website, “A score above 50 puts you in the ’bad snoring’ category, and if you’re above 100 you definitely need to find some solutions!”
However, as previously mentioned, the cohort exhibited an overall AHI of 15.1 ± 17.0, indicative of moderate OSAS, while the average Snore Score reported was 24.8 ± 22.2. Additionally, the severe OSA group (AHI 44.9 ± 12.0) reached a Snore Score of 35.2 ± 21.4, not indicating an advanced snoring category nor the need for immediate medical counseling, according to the app. Conversely, the simple snoring group with AHI <5 reported a Snore Score of 30.7 ± 19.2. It is important to note that not all snorers have OSAS and require treatment [
22], but there are inadequate explanations about these two conditions in the information provided, and also, how the Snore Score is calculated.
Unfortunately, the number of validation studies addressing SnoreLab and snoring apps, in general, is limited. Klaus et al. (2021) [
7] were pioneers in studying the SnoreLab app beyond a case report level [
9], evaluating a cohort of 19 patients undergoing overnight PSG to assess the accuracy of recorded snoring. Similarly, they found that the Snore Score provided by the app averaged 29.1 ± 35.2, consistent with median user scores and our findings. However, compared to PSG-measured AHI, all snoring indices showed only a low to moderate correlation (r = 0.495–0.645). Thus, we concur with their conclusion that, while SnoreLab may not be suitable for OSA screening in clinical practice, it could serve as a valuable tool for snoring monitoring alongside different treatment evaluations. While the SnoreLab website disclaims any intention to diagnose OSAS, users may still confuse obstructive apnea events with snoring. Integrating clearer explanations within the app and associated scientific material could mitigate this risk and potentially expedite OSAS diagnosis.
Also, it is important to consider that although SnoreLab is a cost-effective solution, additional features such as night recording, trends, and backup require a SnoreLab Premium subscription (EUR 5.99/monthly). A cost analysis is necessary to understand if this small annual expenditure for patients can prevent major costs due to OSAS comorbidities, absence from work, and travel to reach clinics, especially for patients coming from rural or underserved areas [
23].
Limitations
Certainly, the small sample size (
n = 19) limits the generalizability of these findings. In this pilot study, the primary focus remains the potential use of SnoreLab in detecting obstructive events. Despite the limited number of cases, it may be intriguing to conduct a gender analysis in subsequent research with a larger cohort. Furthermore, future investigations could explore using SnoreLab as a sleep diary, as suggested by Klaus et al. [
7], to validate or refute their findings. Also, the proportion of snoring determined by PSG was not compared with other measures like p-flow, warranting further analysis. Correlating snoring patterns with varying degrees of OSA severity in a larger, more diverse sample would provide valuable insights for comparing severity groups effectively.
In addition to the variables already considered, including factors such as the presence of sinus disease, allergies, the use of allergy medications or nasal sprays, and neck circumference would have provided a more comprehensive comparison between the PSG and the application. These additional variables could potentially influence the outcomes, and their absence may limit the scope of our findings. Future studies should consider incorporating these factors to enhance the robustness of the analysis.
Additionally, the use of concomitant environmental noise trackers would be beneficial to further validate this technology. Incorporating such trackers could provide more comprehensive data on external noise influences, thereby enhancing the robustness and accuracy of our findings.