Next Article in Journal
Exploring the Components of Multicultural Competence among Pre-Service Teacher Students in Thailand: An Approach Utilizing Confirmatory Factor Analysis
Previous Article in Journal
The Impact of Using Digital Video Recordings by Prospective Teachers on Their Technological Pedagogical Content Knowledge
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adherence to CPAP Therapy in Obstructive Sleep Apnea: A Prospective Study on Quality of Life and Determinants of Use

1
Department of Family Medicine, Split-Dalmatia Health Center, 21000 Split, Croatia
2
Department for Neuroscience, University of Split School of Medicine, 21000 Split, Croatia
*
Author to whom correspondence should be addressed.
Eur. J. Investig. Health Psychol. Educ. 2024, 14(9), 2463-2475; https://doi.org/10.3390/ejihpe14090163
Submission received: 13 July 2024 / Revised: 22 August 2024 / Accepted: 23 August 2024 / Published: 27 August 2024

Abstract

:
Obstructive sleep apnea (OSA) often goes unrecognized despite common symptoms, such as excessive daytime sleepiness, fatigue, and impaired quality of life (QoL). Continuous positive airway pressure (CPAP) is the gold standard treatment for OSA, but optimal daily usage and time needed for observable effects remain unclear. This study aimed to investigate the short-term effects of CPAP on daytime sleepiness and QoL in patients with severe OSA. Medical records were collected from 87 patients with severe OSA who initiated CPAP therapy. Also, validated questionnaires were used before and after one month of CPAP to analyze QoL—the Calgary Sleep Apnea Quality of Life Index (SAQLI), the Cues to CPAP Use Questionnaire (CCUQ), and daytime sleepiness—the Epworth Sleepiness Scale (ESS). Multiple regression analysis was conducted to identify predictors of CPAP usage. Of the total participants aged 55.6 ± 12.5, 77% were males, and 62% were CPAP adherent. Reductions in daytime sleepiness (ESS) were noted, as well as improvements in both overall QoL (SAQLI) and specifically in the domains of daily functioning, social interactions, emotional well-being, and symptom perception. Important cues for CPAP usage recognized by patients were physicians’ instructions and physicians’ concern regarding their patients’ condition. Furthermore, multiple regression revealed higher SAQLI scores and lower ESS scores as positive predictors of CPAP usage, along with lower AHI after one month of CPAP being associated with sufficient adherence.

1. Introduction

It has been estimated that approximately 4.7% of the worldwide population has obstructive sleep apnea (OSA), with 2% of cases being severe [1,2,3]. Characterized by recurrent collapses of the upper airway during sleep, OSA usually presents with snoring and reduced airflow due to decreased activity of the upper airway dilator muscles and a narrowed airway [4,5,6]. Due to multiple interruptions of sleep by breathing cessations, signs and symptoms of OSA include non-restorative sleep, excessive daytime sleepiness, fatigue, tiredness, lack of energy, abrupt awakenings, and morning headaches [7,8]. Furthermore, OSA occurs significantly more frequently in patients with conditions such as arterial hypertension, hyperlipidemia, type 2 diabetes mellitus, atrial fibrillation, stroke, obesity, posttraumatic stress disorder, and major depressive disorder [9,10,11].
Several studies have confirmed the significant impairment of the quality of life (QoL) in OSA patients [12,13]. Although the concept of QoL is challenging to define, it encompasses overall well-being involving both objective and subjective determinants related to physical, material, social, and emotional aspects [14]. Furthermore, improving QoL might result in superior patient care and rehabilitation, as well as in reduced disease symptoms [15]. Additionally, the concept of health-related QoL is considered to reflect the impact of illness and treatment on patient disability and daily functioning [14,15]. Due to the complex and comprehensive nature of QoL, numerous instruments are employed to assess it, primarily developed based on empirical considerations [15]. The Calgary Sleep Apnea Quality of Life Index (SAQLI) is specifically designed to examine the health-related QoL in OSA patients, and this enables measurement of changes in patients’ conditions following therapeutic interventions [13,16].
In addition to therapeutic recommendations for lifestyle changes and other effective treatments which include oral appliances that cause forward protrusion of the mandible during sleep, surgical modifications of the pharyngeal soft tissue or facial skeleton, and hypoglossal nerve stimulation, continuous positive airway pressure (CPAP) remains the gold standard treatment for moderate to severe OSA patients [8,17]. Furthermore, it has been shown that CPAP reduces daytime sleepiness and improves health-related QoL [18]. However, CPAP adherence in OSA patients often remains unsatisfactory, with some studies revealing that up to 80% of patients use CPAP for less than 4 h per night [8,17,18]. The necessary duration of device usage to achieve optimal therapeutic effects is yet to be determined, and most studies have focused on the therapy’s effectiveness in improving the QoL after several months of usage [17,18] even though symptoms such as daytime sleepiness may reduce as early as following one month of therapy initiation [19].
Therefore, the aim of our study was to assess the effects of one month of CPAP treatment on the QoL (SAQLI) and daytime sleepiness (Epworth sleepiness scale, ESS) in severe OSA patients. Additionally, using the Cues to CPAP Use Questionnaire (CCUQ), we aimed to identify the reasons contributing the most to patients’ initiation of therapy.

2. Materials and Methods

2.1. Ethics

The research followed the principles of the Helsinki Declaration [20] and other relevant guidelines, providing ethical conduct and the participants’ safety. Before study enrollment, all participants signed the informed consent, and confidentiality was maintained throughout the study. The Ethics Committee of the University of Split School of Medicine approved the study (protocol code: 003-08/22-03/0003).

2.2. Patients

A total of 87 consecutive severe OSA patients ranging from 27 to 80 years of age, diagnosed between 1 October 2022 and 31 May 2023 at the Sleep Medicine Center of the University of Split School of Medicine and the University Hospital of Split, were included in the study. Patients were assessed with either whole-night polysomnography (PSG) or polygraphy (PG), and severe OSA was defined as an apnea–hypopnea index (AHI) of ≥30 [8]. All patients underwent an examination by an otolaryngologist before PSG or PG testing at our reference center. The specialist assessed the upper airway, as well as the characteristics of the nose, mouth, and throat, and determined whether patients were suitable as candidates for CPAP therapy. The patients who were not suitable for CPAP therapy due to unfavorable characteristics of the upper airways and had undergone surgery prior to CPAP therapy were not included in the study. Additionally, the inclusion criteria were an age of 18 years or older and the necessary physical and mental capability to adhere to the research protocol, which was assessed by the attending physician.

2.3. Questionnaires

A total of three validated questionnaires were used: the Epworth Sleepiness Scale (ESS) [21,22,23], the Calgary Sleep Apnea Quality of Life Index (SAQLI) [16,24], and the Cues to CPAP Use Questionnaire (CCUQ) [25].
The ESS assesses participants’ possibility of falling asleep in eight common daily situations and is widely used in multiple languages and clinical settings [21,22]. The participants respond on a scale from 0 (never doze) to 3 (high chance of dozing), with a total score ranging from 0 to 24 [23], and a higher score indicating increased daytime sleepiness [23].
The SAQLI evaluates the health-related quality of life in patients with OSA, primarily for research purposes rather than routine clinical practice [16,24]. It consists of 45 questions distributed across distinct domains: daily functioning (A), social interactions (B), emotional functioning (C), patient-selected or nominated symptoms potentially due to OSA (D), and treatment-related symptoms (E). Responses for Domain E are exclusively filled out after therapy implementation. Each question is rated on a scale from 1 (indicating maximum impairment) to 7 (indicating no impairment) [16,24]. The average score is calculated for each specific domain. To determine the overall SAQLI score, the result of Domain E is subtracted from the score of each domain, and the average is subsequently computed. This unique characteristic of the questionnaire incorporates therapy side effects [16,24].
The final questionnaire, CCUQ, aims to identify the primary factors influencing a patient’s decision to commence CPAP therapy. The questionnaire consists of nine items or potential reasons, to which respondents provide answers on a scale from 0 (not at all) to 3 (extremely important) [25].

2.4. Data Collection and Statistical Analysis

Before undergoing PSG or PG procedures, demographic data, medical history, and comorbidity information were collected, alongside the completion of the ESS. Following this, all patients underwent either the whole-night PSG (Alice 6, Philips Respironics, Eindhoven, The Netherlands) or PG recording (Alice NightOne, Philips Respironics, Eindhoven, The Netherlands and SOMNOcheck2, Weinmann, Hamburg, Germany). Obtained data were manually scored and OSA was diagnosed according to AASM diagnostic criteria and ESRS guidelines [26].
Before initiating CPAP therapy, all 87 patients were asked to complete the pen-and-paper SAQLI questionnaire. A total of 55 patients (63.2%) agreed to attend a follow-up check-up after one month of CPAP usage, during which data from the CPAP memory cards showing usage were extracted. Participants also completed the CCUQ as well as the follow-ups of ESS and SAQLI questionnaires. Follow-up data were collected from 47 participants for CCUQ, 53 participants for ESS, and 53 participants for the SAQLI (Figure 1).
Data analysis was performed in Microsoft Excel, version 13.0 (Microsoft Corporation, Redmond, WA, USA), and SPSS Statistics 23.0 (IBM Corporation, Armonk, NY, USA). Continuous data were presented as mean ± standard deviation (SD), while categorical variables were expressed as absolute numbers and percentages. Data distribution normality was tested by the Shapiro–Wilk test. For the comparison of continuous variables, the t-test for independent samples was used, while the χ2-test was used for nominal scale data. To assess the differences in questionnaire results before and after CPAP therapy, repeated measures ANOVA was conducted. The ANOVA analysis on SAQLI was conducted for 53 patients who completed questionnaires before and after CPAP. However, considering that the initial ESS was filled out by 77 patients, the ANOVA analysis was conducted on the 44 who completed the ESS both before and after one month of CPAP usage (Figure 1). Patients were categorized based on CPAP compliance (percentage of days with CPAP usage ≥4 h per day). According to the American Academy of Sleep Medicine (AASM) recommendations, which are consistent with the existing literature, those who used CPAP ≥4 h per day on more than 70% of days over one month were classified as adherent, whereas all other participants were considered non-adherent [27,28]. The odds ratio was calculated for the association between CCUQ and CPAP compliance, with significance assessed using the Fisher exact test. The association of CPAP compliance with the following variables: AHI, ESS score before CPAP initiation, and total SAQLI score before CPAP usage were analyzed by multiple regression. We also analyzed several other regression models that included other available parameters. However, we have chosen to present the current model, as it was the one that reached statistical significance. A p-value of <0.05 was considered statistically significant.
Reliability analysis for the daily functioning domain, the social interactions, and the emotional functioning domain of SAQLI, including the item-total statistics for each of the items included in the domain is reported in Supplementary Tables S1–S3. The same reliability analysis is reported for all of the items in the Cues to CPAP Use Questionnaire (CCUQ) in Supplementary Table S4. Tables including Cronbach’s alpha value of the scales, Cronbach’s alpha based on standardized items, as well as the total numbers of items included are also added to the reliability analysis (Supplementary Tables S1–S4).

3. Results

A total of 87 patients diagnosed with severe OSA were enrolled in this study. The mean age of the study participants was 55.6 ± 12.5 years. The majority were male (77%), and the body mass index was 33.2 ± 7.4 kg/m2 (Table 1). Polysomnography or polygraphy results revealed an AHI of 50.5 ± 19.1 with a mean oxygen saturation of 92.8% ± 3.6%.
After one month of CPAP usage, 55 patients consented to a regular follow-up examination, when data from CPAP memory cards were extracted (Table 2 and Supplementary Figure S1). Based on the percentage of days with CPAP usage ≥ 4 h per day, 21 of them, or 38.2%, were classified as non-compliant, while 61.8% were compliant. In accordance with that, CPAP-non-compliant patients had shorter average usage than compliant patients in hours on both all days (3.3 ± 1.2 vs. 6.3 ± 1.2 h, p-value < 0.001) and on days when CPAP was used (4.3 ± 1.2 vs. 6.6 ± 1.2 h, p-value < 0.001), as assessed by t-test for independent samples. Both non-compliant and compliant patients averagely used CPAP on more than 70% of days. However, the compliant group used it on 94.4% ± 9% of days, while non-compliant OSA patients used it on 78.3% ± 23.1% of days (p-value < 0.001, t-test for independent samples). The mean AHI during CPAP usage was found to be 4.7 ± 4.6. AHI among non-compliant patients was significantly higher than among compliant patients (6.5 ± 6.3 vs. 3.5 ± 2.8, respectively; p-value = 0.018, calculated by independent samples t-test).
At the check-up after one month of CPAP therapy, the scores for all domains of SAQLI were significantly lower, including daily functioning (domain A), social interactions (domain B), emotional functioning (domain C), and patient-selected or nominated symptoms potentially due to OSA (domain D), indicating better quality of life (Table 3 and Supplementary Figure S2). Additionally, the total score after one month of CPAP therapy was significantly lower than the pre-CPAP score (3.4 ± 1.1 vs. 1.7 ± 0.9, respectively, p-value < 0.001 assessed by repeated measures ANOVA). Patients exhibited significantly lower check-up ESS scores, indicating lower daytime sleepiness (7.2 ± 5.1 vs. 4.6 ± 4.2, p-value = 0.004, repeated measures ANOVA).
As shown in Figure 2, non-compliant patients exhibited higher endorsement rates on all items of the CCUQ except for Q3 (“I started using CPAP because my partner could not sleep because of my snoring”) and Q6 (“My partner encouraged me to start using CPAP”).
Responses to the CCUQ were grouped into two categories: “not at all” and “little important” vs. “moderately important” and “extremely important”. The association between CPAP compliance and the relevance of the specific cue is shown in Table 4. It was demonstrated that a statistically significant difference was only observed for Q2 (“I started using CPAP because I was worried about my heart”), where answers “moderately or extremely important” were associated with subsequent CPAP non-compliance (OR: 0.263 (95% CI: 0.028–2.443); p-value = 0.022). Therefore, it appears that patients starting to use CPAP due to heart concerns have a low probability of being in the compliant group. Overall, patients most frequently reported the relevance of Q1, indicating the relevance of physicians’ instructions, and Q4, indicating the physicians’ worry regarding patients’ condition.
Multiple regression analysis confirmed both ESS and SAQLI before CPAP in patients diagnosed with severe OSA were significantly associated with CPAP compliance, explaining 13.7% of the variability, while AHI was not (Table 5). In more detail, lower levels of daytime sleepiness and patients’ subjective perception of worse QoL measured before CPAP initiation were significant predictors of better CPAP adherence. However, OSA severity assessed with AHI before CPAP therapy was not a significant predictor of CPAP compliance.

4. Discussion

The results of this study showed that severe OSA patients had an improvement in OSA-related quality of life and reduced daytime sleepiness following one month of CPAP therapy. This improvement was established in daily functioning, social interactions, emotional well-being, and symptom perception, which emphasizes the benefits of effective OSA treatment on patients’ quality of life.
It has been shown that CPAP is efficient in mitigating respiratory events during sleep in severe OSA patients, and it also has favorable effects on alleviating symptomatic manifestations of OSA and improving daytime functioning [7,12,13]. This was supported by the results of the present study showing a significant reduction in AHI and daytime sleepiness among compliant patients.
Previous studies reported lower QoL with poor sleep quality, excessive daytime sleepiness, dizziness, headaches, decreased concentration, mood changes, impaired hearing, and voice alteration among OSA patients when compared to the general population [7,12,17,29,30,31,32]. In OSA patients, QoL is closely associated with factors such as age, stress, lifestyle, depression, BMI, and overall health status [30]. Numerous studies have investigated the impact of various factors on the broad concept of QoL, yet the distinctive influence of individual factors remains unclear [30]. In recent years, improvement in QoL has become a relevant aim in OSA treatment [17]. CPAP successfully alleviates symptoms and reduces disease severity [17,30,32,33,34], and improves QoL due to improvement in neurocognitive function, sleep quality and restfulness, emotional well-being, symptoms of depression, and social functioning [30,31,32]. This is in accordance with the results of the current study, showing an improvement across all analyzed domains of QoL, including daily functioning, social interactions, emotional functioning, and patient-selected symptoms.
In the present study, where the QoL was assessed with an OSA-specific SAQLI questionnaire, the overall score significantly decreased within only one month, surpassing the clinically meaningful score change. Improvements were observed in daily functioning, social interactions, emotional well-being, and symptom perception. Differences between SAQLI and other QoL questionnaires include its OSA-specificity, and considering treatment-related symptoms [7,13,16]. Furthermore, SAQLI has a high correlation with the widely used, disease-nonspecific 36-Item Short Form Health Survey (SF-36) [13]. A recent meta-analysis found that SAQLI scores remained improved at both 3 and 12 months with CPAP therapy [7], while previous studies also report improvements at 6 months, but not at 2 months of CPAP therapy [13]. Still, the observed 1.7-point improvement in our study has been recognized within one month of CPAP therapy, and such findings may be attributed to the fact that all patients had severe OSA with an average AHI of 50.
This study included severe OSA patients, predominantly middle-aged men with increased BMI, reflecting previously established OSA risk factors [35]. Based on CPAP usage data, 38.2% of enrolled severe OSA patients were non-compliant, reflecting the world trends [18,36] and highlighting the challenges in achieving optimal CPAP adherence [5,18]. OSA is considered a disease with one of the poorest adherence rates to therapy, with non-adherence rates ranging from 29% to 83% [18]. Consequently, recent research has focused on strategies to increase CPAP adherence, including educational materials, regular check-ups, motivational therapy, telephone calls, online consultations, or home visits [5,18,37,38]. The effectiveness of these interventions, however, is questionable [5,18]. Behavioral therapy, such as motivational interviewing, has been proven to be one of the most effective for CPAP compliance [18]. It requires highly educated staff and considerable one-on-one time with patients [18]. Educational materials, whether in written or video format, although incomprehensible to some patients, offer a relatively straightforward approach and, according to some authors, significantly increase adherence [18]. While our patients were not candidates for surgical treatment, some studies suggest that it can improve CPAP adherence in patients for whom it is indicated. Nasal surgery in patients with nasal obstruction, according to some authors, reduces therapeutic CPAP device pressure and increases the use of CPAP in certain patients [39]. Moreover, adherence after just one month serves as a good predictor of future adherence [40], providing an opportunity for targeted interventions in those exhibiting poor adherence in the short term. Nonetheless, additional research is imperative to ascertain the most effective approaches. It is favorable that in our study, even patients classified as non-compliant still attempted to use CPAP, and they might become compliant users in the coming months. One might presume that just one month of usage was not sufficient for them to adapt to the device, hence they had poorer compliance results.
To provide a comprehensive analysis of CPAP compliance, the current study also assessed the patient attitudes and motivations influencing CPAP compliance using the CCUQ questionnaire. A significant predictor of non-compliance in our study was patients’ concern regarding cardiovascular health. Previous research has presented conflicting views regarding hypertension as an indicator of cardiovascular health concerning CPAP compliance [41]. While some authors consider it a predictor of compliance, others suggest it indicates non-compliance, with certain studies showing no correlation at all [41]. Various other predictors of CPAP compliance have also demonstrated variability depending on the setting and study group [3,41]. Nevertheless, established predictors associated with higher adherence include older age, female sex, ESS > 10, severe OSA (AHI > 30), health insurance coverage, lower rates of depression and insomnia, lower SpO2 levels, and the use of hypnotics [3,41]. A recent systematic review emphasizes patient personality and their beliefs and cognitions as significant predictors of adherence [42], as well as the value patients place on their health and their self-efficacy, referring to their confidence and ability to self-manage CPAP treatment [42,43].
Our multiple regression analysis revealed lower ESS scores and higher SAQLI domains measured before CPAP initiation as significant predictors of CPAP compliance. Namely, patients’ subjective perception of worse QoL was a significant predictor of better adherence. Our finding regarding ESS contrasts with the existing literature [19,44], suggesting that in severe OSA patients, domains of QoL would have a stronger impact on better CPAP adherence, rather than daytime sleepiness measured by ESS. Furthermore, AHI levels before CPAP therapy were not significant predictors of CPAP compliance. While it is well-established that CPAP significantly reduces AHI [19], the fact that adherence was not associated with AHI in our patients emphasizes the necessity of considering additional factors that might influence compliance in this population. These factors might be associated with patient-specific characteristics, such as belonging to a certain OSA phenotype cluster [45], which significantly influences the variability in treatment adherence and thus merits further investigation.
Limitations of the study are a relatively small sample size, a single-center setting, and a short follow-up period of only one month, which could limit the generalization of findings and impact the results. Extended follow-up periods might provide comprehensive data, possibly yielding practical guidelines for improvement of the long-term CPAP compliance. Thus, future research should include larger, multicenter studies and focus on additional determinants of CPAP compliance, such as psychosocial factors, socioeconomic status, and healthcare system-related barriers. Moreover, longitudinal studies with extended follow-up periods could evaluate long-term treatment effects on QoL and adherence patterns among patients undergoing CPAP therapy. Finally, it is important to note that patients did not undergo drug-induced sleep endoscopy (DISE), due to the complexity of the procedure in terms of required personnel and time. It is otherwise a highly valuable diagnostic tool for patients with sleep-disordered breathing, as it evaluates the sites of upper airway obstruction and vibrations. Since all participants in our study were candidates for CPAP therapy, performing this procedure was deemed unnecessary. Nevertheless, it should be noted that this diagnostic method could be highly beneficial for patients who do not tolerate CPAP therapy or are not suitable candidates for it [8].

5. Conclusions

In conclusion, this study provides valuable insights into the quality of life, compliance patterns, and reasons relevant for good CPAP adherence among severe OSA patients undergoing CPAP therapy. Furthermore, the study highlights the importance of addressing patient-centered factors in promoting CPAP adherence and the use of disease-specific questionnaires such as SAQLI. Tailored interventions aimed at optimizing CPAP adherence and enhancing treatment outcomes among patients with severe OSA should be used to improve long-term treatment compliance and efficacy.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ejihpe14090163/s1, Figure S1: The data from the continuous positive airway pressure (CPAP) memory cards after one month of usage in compliant and non-compliant patients; Figure S2: Four (A—daily functioning, B—social interactions, C—emotional functioning, and D—symptoms potentially due to obstructive sleep apnea) domains and the total score of the Calgary Sleep Apnea Quality of Life Index (SAQLI), and Epworth Sleepiness Scale (ESS) results before and after one month of continuous positive airway pressure (CPAP) therapy usage (n = 53); Table S1: Reliability analysis and the Cronbach’s alpha for the daily functioning domain of Calgary Sleep Apnea Quality of Life Index; Table S2: Reliability analysis and the Cronbach’s alpha for the social interactions domain of Calgary Sleep Apnea Quality of Life Index; Table S3: Reliability analysis and the Cronbach’s alpha for the emotional functioning domain of Calgary Sleep Apnea Quality of Life Index; Table S4: Reliability analysis and the Cronbach’s alpha for the Cues to CPAP Use Questionnaire (CCUQ).

Author Contributions

Conceptualization, K.M., I.P.D., L.L.K., R.P. and Z.D.; formal analysis, I.P.D., L.L.K. and M.V.; investigation, K.M., R.P., N.I. and Z.D.; methodology, K.M., I.P.D., L.L.K., N.I., M.V. and Z.D.; supervision, R.P. and Z.D.; validation, L.L.K., R.P., N.I. and M.V.; visualization, K.M., I.P.D., L.L.K., R.P., N.I. and Z.D.; Writing—original draft, K.M. and I.P.D.; Writing—review and editing, I.P.D., L.L.K., R.P., N.I., M.V. and Z.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Biomedical Ethics Committee of the University of Split School of Medicine, Split, Croatia (protocol code: 003-08/22-03/0003 and date of approval: 9 December 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study, and confidentiality was maintained throughout the study.

Data Availability Statement

The data are contained within the article and the recordings and raw datasets supporting the conclusions of this study will be made available by the corresponding author on request.

Acknowledgments

The authors wish to thank Aisha Qazzafi (Wirral University Teach Hospital, United Kingdom) for help in language editing, and Dijana Radanovic, Vjera Solic, and Jelena Baricevic for technical assistance in data collection.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Benjafield, A.V.; Ayas, N.T.; Eastwood, P.R.; Heinzer, R.; Ip, M.S.M.; Morrell, M.J.; Nunez, C.M.; Patel, S.R.; Penzel, T.; Pépin, J.L.; et al. Estimation of the global prevalence and burden of obstructive sleep apnoea: A literature-based analysis. Lancet Respir. Med. 2019, 7, 687–698. [Google Scholar] [CrossRef] [PubMed]
  2. Stradling, J. Obstructive sleep apnoea. BMJ 2007, 335, 313–314. [Google Scholar] [CrossRef] [PubMed]
  3. Madbouly, E.M.; Nadeem, R.; Nida, M.; Molnar, J.; Aggarwal, S.; Loomba, R. The role of severity of obstructive sleep apnea measured by apnea-hypopnea index in predicting compliance with pressure therapy, a meta-analysis. Am. J. Ther. 2014, 21, 260–264. [Google Scholar] [CrossRef] [PubMed]
  4. West, S.D.; Turnbull, C. Obstructive sleep apnoea. Eye 2018, 32, 889–903. [Google Scholar] [CrossRef]
  5. Rapelli, G.; Pietrabissa, G.; Manzoni, G.M.; Bastoni, I.; Scarpina, F.; Tovaglieri, I.; Perger, E.; Garbarino, S.; Fanari, P.; Lombardi, C.; et al. Improving CPAP Adherence in Adults With Obstructive Sleep Apnea Syndrome: A Scoping Review of Motivational Interventions. Front. Psychol. 2021, 12, 705364. [Google Scholar] [CrossRef]
  6. Wang, Y.; Shou, X.; Wu, Y.; Fan, Z.; Cui, J.; Zhuang, R.; Luo, R. Relationships Between Obstructive Sleep Apnea and Cardiovascular Disease: A Bibliometric Analysis (2010–2021). Med. Sci. Monit. 2022, 28, e933448. [Google Scholar] [CrossRef]
  7. Labarca, G.; Saavedra, D.; Dreyse, J.; Jorquera, J.; Barbe, F. Efficacy of CPAP for Improvements in Sleepiness, Cognition, Mood, and Quality of Life in Elderly Patients With OSA: Systematic Review and Meta-analysis of Randomized Controlled Trials. Chest 2020, 158, 751–764. [Google Scholar] [CrossRef]
  8. Gottlieb, D.J.; Punjabi, N.M. Diagnosis and Management of Obstructive Sleep Apnea: A Review. JAMA 2020, 323, 1389–1400. [Google Scholar] [CrossRef]
  9. Labarca, G.; Schmidt, A.; Dreyse, J.; Jorquera, J.; Enos, D.; Torres, G.; Barbe, F. Efficacy of continuous positive airway pressure (CPAP) in patients with obstructive sleep apnea (OSA) and resistant hypertension (RH): Systematic review and meta-analysis. Sleep Med. Rev. 2021, 58, 101446. [Google Scholar] [CrossRef]
  10. Zinchuk, A.V.; Gentry, M.J.; Concato, J.; Yaggi, H.K. Phenotypes in obstructive sleep apnea: A definition, examples and evolution of approaches. Sleep Med. Rev. 2017, 35, 113–123. [Google Scholar] [CrossRef]
  11. Gupta, M.A.; Simpson, F.C. Obstructive sleep apnea and psychiatric disorders: A systematic review. J. Clin. Sleep Med. 2015, 11, 165–175. [Google Scholar] [CrossRef]
  12. Pecotic, R.; Dodig, I.P.; Valic, M.; Galic, T.; Kalcina, L.L.; Ivkovic, N.; Dogas, Z. Effects of CPAP therapy on cognitive and psychomotor performances in patients with severe obstructive sleep apnea: A prospective 1-year study. Sleep Breath. 2019, 23, 41–48. [Google Scholar] [CrossRef] [PubMed]
  13. Batool-Anwar, S.; Goodwin, J.L.; Kushida, C.A.; Walsh, J.A.; Simon, R.D.; Nichols, D.A.; Quan, S.F. Impact of continuous positive airway pressure (CPAP) on quality of life in patients with obstructive sleep apnea (OSA). J. Sleep Res. 2016, 25, 731–738. [Google Scholar] [CrossRef] [PubMed]
  14. Karimi, M.; Brazier, J. Health, Health-Related Quality of Life, and Quality of Life: What is the Difference? Pharmacoeconomics 2016, 34, 645–649. [Google Scholar] [CrossRef] [PubMed]
  15. Haraldstad, K.; Wahl, A.; Andenæs, R.; Andersen, J.R.; Andersen, M.H.; Beisland, E.; Borge, C.R.; Engebretsen, E.; Eisemann, M.; Halvorsrud, L.; et al. A systematic review of quality of life research in medicine and health sciences. Qual. Life Res. 2019, 28, 2641–2650. [Google Scholar] [CrossRef]
  16. Flemons, W.W.; Reimer, M.A. Measurement properties of the calgary sleep apnea quality of life index. Am. J. Respir. Crit. Care Med. 2002, 165, 159–164. [Google Scholar] [CrossRef]
  17. Kuhn, E.; Schwarz, E.I.; Bratton, D.J.; Rossi, V.A.; Kohler, M. Effects of CPAP and Mandibular Advancement Devices on Health-Related Quality of Life in OSA: A Systematic Review and Meta-analysis. Chest 2017, 151, 786–794. [Google Scholar] [CrossRef]
  18. Bakker, J.P.; Weaver, T.E.; Parthasarathy, S.; Aloia, M.S. Adherence to CPAP: What Should We Be Aiming For, and How Can We Get There? Chest 2019, 155, 1272–1287. [Google Scholar] [CrossRef]
  19. Battan, G.; Kumar, S.; Panwar, A.; Atam, V.; Kumar, P.; Gangwar, A.; Roy, U. Effect of CPAP Therapy in Improving Daytime Sleepiness in Indian Patients with Moderate and Severe OSA. J. Clin. Diagn. Res. 2016, 10, OC14–OC16. [Google Scholar] [CrossRef]
  20. World Medical Association. World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA 2013, 310, 2191–2194. [Google Scholar] [CrossRef]
  21. Pecotic, R.; Dodig, I.P.; Valic, M.; Ivkovic, N.; Dogas, Z. The evaluation of the Croatian version of the Epworth sleepiness scale and STOP questionnaire as screening tools for obstructive sleep apnea syndrome. Sleep Breath. 2012, 16, 793–802. [Google Scholar] [CrossRef] [PubMed]
  22. Walker, N.A.; Sunderram, J.; Zhang, P.; Lu, S.E.; Scharf, M.T. Clinical utility of the Epworth sleepiness scale. Sleep Breath. 2020, 24, 1759–1765. [Google Scholar] [CrossRef]
  23. Johns, M.W. A new method for measuring daytime sleepiness: The Epworth sleepiness scale. Sleep 1991, 14, 540–545. [Google Scholar] [CrossRef] [PubMed]
  24. Flemons, W.W.; Reimer, M.A. Development of a disease-specific health-related quality of life questionnaire for sleep apnea. Am. J. Respir. Crit. Care Med. 1998, 158, 494–503. [Google Scholar] [CrossRef]
  25. Olsen, S.; Smith, S.; Oei, T.P.; Douglas, J. Cues to starting CPAP in obstructive sleep apnea: Development and validation of the cues to CPAP Use Questionnaire. J. Clin. Sleep Med. 2010, 6, 229–237. [Google Scholar] [CrossRef]
  26. AASM International Classification of Sleep Disorders—Third Edition (ICSD-3). Available online: https://learn.aasm.org/Listing/a1341000002XmRvAAK (accessed on 25 March 2023).
  27. Kribbs, N.B.; Pack, A.I.; Kline, L.R.; Smith, P.L.; Schwartz, A.R.; Schubert, N.M.; Redline, S.; Henry, J.N.; Getsy, J.E.; Dinges, D.F. Objective measurement of patterns of nasal CPAP use by patients with obstructive sleep apnea. Am. Rev. Respir. Dis. 1993, 147, 887–895. [Google Scholar] [CrossRef] [PubMed]
  28. Gay, P.; Weaver, T.; Loube, D.; Iber, C.; Positive Airway Pressure Task Force; Standards of Practice Committee; American Academy of Sleep Medicine. Evaluation of positive airway pressure treatment for sleep related breathing disorders in adults. Sleep 2006, 29, 381–401. [Google Scholar] [CrossRef]
  29. Kim, T. Quality of Life in Metabolic Syndrome Patients Based on the Risk of Obstructive Sleep Apnea. Behav. Sci. 2024, 14, 127. [Google Scholar] [CrossRef]
  30. Lee, W.; Lee, S.A.; Ryu, H.U.; Chung, Y.S.; Kim, W.S. Quality of life in patients with obstructive sleep apnea: Relationship with daytime sleepiness, sleep quality, depression, and apnea severity. Chron. Respir. Dis. 2016, 13, 33–39. [Google Scholar] [CrossRef]
  31. Hamada, S.; Togawa, J.; Sunadome, H.; Nagasaki, T.; Takahashi, N.; Hirai, T.; Sato, S. Sleep Restfulness in Patients with Obstructive Sleep Apnea Undergoing Continuous Positive Airway Pressure Therapy. Sleep Sci. 2024, 17, e37–e44. [Google Scholar] [CrossRef]
  32. Sgaria, V.P.; Cielo, C.A.; Bortagarai, F.M.; Fleig, A.H.D.; Callegaro, C.C. CPAP Treatment Improves Quality of Life and Self-perception of Voice Impairment in Patients with OSA. J. Voice 2024, in press. [Google Scholar] [CrossRef]
  33. Singh, A.; Bhat, A.; Saroya, J.; Chang, J.; Durr, M.L. Sociodemographic and Healthcare System Barriers to PAP Alternatives for Adult OSA: A Scoping Review. Laryngoscope 2024. epub ahead of print. [Google Scholar]
  34. Sun, L.; Chang, Y.F.; Wang, Y.F.; Xie, Q.X.; Ran, X.Z.; Hu, C.Y.; Luo, B.; Ning, B. Effect of Continuous Positive Airway Pressure on Blood Pressure in Patients with Resistant Hypertension and Obstructive Sleep Apnea: An Updated Meta-analysis. Curr. Hypertens. Rep. 2024. epub ahead of print. [Google Scholar]
  35. Yeghiazarians, Y.; Jneid, H.; Tietjens, J.R.; Redline, S.; Brown, D.L.; El-Sherif, N.; Mehra, R.; Bozkurt, B.; Ndumele, C.E.; Somers, V.K. Obstructive Sleep Apnea and Cardiovascular Disease: A Scientific Statement From the American Heart Association. Circulation 2021, 144, e56–e67. [Google Scholar] [CrossRef] [PubMed]
  36. Weaver, T.E.; Grunstein, R.R. Adherence to continuous positive airway pressure therapy: The challenge to effective treatment. Proc. Am. Thorac. Soc. 2008, 5, 173–178. [Google Scholar] [CrossRef]
  37. Franke, C.; Piezonna, F.; Schäfer, R.; Grimm, A.; Loris, L.M.; Schwaibold, M. Effect of a digital patient motivation and support tool on CPAP/APAP adherence and daytime sleepiness: A randomized controlled trial. Sleep Biol. Rhythm. 2023, 22, 49–63. [Google Scholar] [CrossRef] [PubMed]
  38. Schisano, M.; Libra, A.; Rizzo, L.; Morana, G.; Mancuso, S.; Ficili, A.; Campagna, D.; Vancheri, C.; Bonsignore, M.R.; Spicuzza, L. Distance follow-up by a remote medical care centre improves adherence to CPAP in patients with obstructive sleep apnoea over the short and long term. J. Telemed. Telecare 2024, 1357633X241238483. [Google Scholar] [CrossRef]
  39. Fiorita, A.; Scarano, E.; Mastrapasqua, R.; Picciotti, P.M.; Loperfido, A.; Rizzotto, G.; Paludetti, G. Moderate OSAS and turbinate decongestion: Surgical efficacy in improving the quality of life and compliance of CPAP using Epworth score and SNOT-20 score. Acta Otorhinolaryngol. Ital. 2018, 38, 214–221. [Google Scholar] [CrossRef]
  40. Gabryelska, A.; Sochal, M.; Wasik, B.; Szczepanowski, P.; Białasiewicz, P. Factors Affecting Long-Term Compliance of CPAP Treatment-A Single Centre Experience. J. Clin. Med. 2021, 11, 139. [Google Scholar] [CrossRef] [PubMed]
  41. Cho, S.E.; Jung, J.H.; Kang, J.M.; Cho, M.Y.; Lee, Y.S.; Kang, S.G.; Kim, S.T. Predictors of Continuous Positive Airway Pressure Adherence and Comparison of Clinical Factors and Polysomnography Findings Between Compliant and Non-Compliant Korean Adults With Obstructive Sleep Apnea. Psychiatry Investig. 2024, 21, 200–207. [Google Scholar] [CrossRef] [PubMed]
  42. Kasetti, P.; Husain, N.F.; Skinner, T.C.; Asimakopoulou, K.; Steier, J.; Sathyapala, S.A. Personality traits and pre-treatment beliefs and cognitions predicting patient adherence to continuous positive airway pressure: A systematic review. Sleep Med. Rev. 2024, 74, 101910. [Google Scholar] [CrossRef]
  43. Kojima, S.; Saito, A.; Sasaki, F.; Hayashi, M.; Mieno, Y.; Sakakibara, H.; Hashimoto, S. Associations of self-efficacy and outcome expectancy with adherence to continuous positive airway pressure therapy in Japanese patients with obstructive sleep apnea. Fujita Med. J. 2023, 9, 142–146. [Google Scholar]
  44. Laratta, C.R.; Ayas, N.T.; Povitz, M.; Pendharkar, S.R. Diagnosis and treatment of obstructive sleep apnea in adults. Can. Med. Assoc. J. 2017, 189, E1481–E1488. [Google Scholar] [CrossRef] [PubMed]
  45. Bailly, S.; Grote, L.; Hedner, J.; Schiza, S.; McNicholas, W.T.; Basoglu, O.K.; Lombardi, C.; Dogas, Z.; Roisman, G.; Pataka, A.; et al. Clusters of sleep apnoea phenotypes: A large pan-European study from the European Sleep Apnoea Database (ESADA). Respirology 2021, 26, 378–387. [Google Scholar] [CrossRef] [PubMed]
Figure 1. A flowchart diagram of the study. (OSA: obstructive sleep apnea, CPAP: continuous positive airway pressure, ESS: Epworth Sleepiness Scale, SAQLI: Calgary Sleep Apnea Quality of Life Index, CCUQ: Cues to CPAP Use Questionnaire).
Figure 1. A flowchart diagram of the study. (OSA: obstructive sleep apnea, CPAP: continuous positive airway pressure, ESS: Epworth Sleepiness Scale, SAQLI: Calgary Sleep Apnea Quality of Life Index, CCUQ: Cues to CPAP Use Questionnaire).
Ejihpe 14 00163 g001
Figure 2. The frequency of endorsement for each item on the Cues to CPAP Use Questionnaire (CCUQ) concerning CPAP compliance (n = 47). (CPAP compliant: CPAP used ≥4 h per day on more than 70% of days, CPAP not compliant: CPAP was not used ≥4 h per day on more than 70% of days, Q: question).
Figure 2. The frequency of endorsement for each item on the Cues to CPAP Use Questionnaire (CCUQ) concerning CPAP compliance (n = 47). (CPAP compliant: CPAP used ≥4 h per day on more than 70% of days, CPAP not compliant: CPAP was not used ≥4 h per day on more than 70% of days, Q: question).
Ejihpe 14 00163 g002
Table 1. Demographic, anthropometric characteristics, smoking status, and comorbidities of severe obstructive sleep apnea (OSA) patients with polysomnography (PSG) or polygraphy (PG) results.
Table 1. Demographic, anthropometric characteristics, smoking status, and comorbidities of severe obstructive sleep apnea (OSA) patients with polysomnography (PSG) or polygraphy (PG) results.
ParametersTotal Patients (n = 87)
Age (years, mean, and SD)55.6 ± 12.5
Sex
Men (n, %)67 (77%)
Women (n, %)20 (23%)
Height (cm, mean, and SD)179.3 ± 9.2
Weight (kg, mean, and SD)108.9 ± 24.7
Body mass index (kg/m2, mean, and SD) *33.2 ± 7.4
18.5 ≤ 25 (n, %)5 (6.5%)
25 ≤ 30 (n, %)19 (24.7%)
30 ≤ 35 (n, %)24 (31.2%)
35 ≤ 40 (n, %)20 (26%)
≥40 (n, %)9 (11.7%)
Neck circumference (cm, mean, and SD)45.4 ± 5.0
Waist circumference (cm, mean, and SD)118.0 ± 16.0
Hip circumference (cm, mean, and SD)115.6 ± 12.4
Apnea–hypopnea index (/hour, mean, and SD)50.5 ± 19.1
Oxygen desaturation index (/hour, mean, and SD)51.0 ± 22.8
Mean saturation (%, mean, and SD)92.8 ± 3.6
Time below 90% saturation (hours, mean, and SD)1.4 ± 1.8
Lowest saturation (%, mean, and SD)72.3 ± 11.8
Smoker (n, %)25 (28.7%)
Arterial hypertension (n, %)57 (65.5%)
Diabetes mellitus type II (n, %)22 (25.3%)
Depression (n, %)4 (4.6%)
Asthma (n, %)8 (9.2%)
Gastroesophageal reflux disease (n, %)17 (19.5%)
Allergic rhinitis (n, %)10 (11.5%)
Previous rhinoplasty (n, %)9 (10.3%)
ECOG Performance Status Scale
0 (n, %)33 (37.9%)
1 (n, %)54 (62.1%)
2 (n, %)0 (0%)
3 (n, %)0 (0%)
4 (n, %)0 (0%)
5 (n, %)0 (0%)
ECOG: Eastern Cooperative Oncology Group, SD: standard deviation. * n = 77 available data for BMI, none of the participants had BMI ≤ 18.5.
Table 2. The data from the CPAP memory cards after one month of usage in compliant and non-compliant patients.
Table 2. The data from the CPAP memory cards after one month of usage in compliant and non-compliant patients.
ParametersTotal (n = 55)CPAP Non-Compliant (n = 21)CPAP Compliant (n = 34)p-Value
Average usage on all days (hours) *5.1 ± 1.93.3 ± 1.26.3 ± 1.2<0.001
Average usage on days when CPAP was used (hours) *5.7 ± 1.74.3 ± 1.26.6 ± 1.2<0.001
Total days with device usage (n) *26.8 ± 7.423.6 ± 10.328.8 ± 3.50.011
Percentage of days with device usage (%)88% ± 17.8%78.3% ± 23.1%94.4% ± 9%<0.001
Total days with CPAP usage ≥ 4 h (n) 20.5 ± 9.310.7 ± 5.826.5 ± 4.8<0.001
Percentage of days with CPAP usage ≥ 4 h (%)69.8% ± 28.7%37.9% ± 19%89.4% ± 9.5%<0.001
Average apnea–hypopnea index (n)4.7 ± 4.66.5 ± 6.33.5 ± 2.80.018
All data are shown as mean ± standard deviation. CPAP: continuous positive airway pressure, CPAP compliant: CPAP used ≥4 h per day on more than 70% of days, CPAP non-compliant: CPAP was not used ≥4 h per day on more than 70% of days. * n = 53 available data, independent samples t-test (p-value < 0.05 was considered statistically significant).
Table 3. Calgary Sleep Apnea Quality of Life Index (SAQLI) and Epworth Sleepiness Scale (ESS) results before and after one month of CPAP usage (n = 53).
Table 3. Calgary Sleep Apnea Quality of Life Index (SAQLI) and Epworth Sleepiness Scale (ESS) results before and after one month of CPAP usage (n = 53).
ParametersBefore CPAPAfter One Month of CPAPp-Value *
Domain A 2.9 ± 1.22.1 ± 1.2<0.001
Domain B2.9 ± 1.22.1 ± 1.2<0.001
Domain C2.8 ± 1.32.2 ± 1.1<0.001
Domain D 5.2 ± 1.73.3 ± 1.7<0.001
Domain E -2.8 ± 1.5-
Total SAQLI 3.4 ± 1.11.7 ± 0.9<0.001
Domain F I -7.0 ± 2.4-
Domain F II -3.6 ± 3.3-
Epworth Sleepiness Scale 7.2 ± 5.14.6 ± 4.20.004
All data are shown as mean ± standard deviation. CPAP: continuous positive airway pressure. * Repeated measures ANOVA (p-value < 0.05 was considered statistically significant), n = 50 available data, n = 44 available data.
Table 4. The frequency of moderately or extremely important answers for each item on the Cues to CPAP Use Questionnaire (CCUQ) in relation to CPAP compliance; n (%).
Table 4. The frequency of moderately or extremely important answers for each item on the Cues to CPAP Use Questionnaire (CCUQ) in relation to CPAP compliance; n (%).
ParametersTotal (n = 50)CPAP Non-Compliant (n = 20)CPAP Compliant (n = 30)p-Value *OR (95%CI)p-Value
Q1 My sleep physician said that I should 44 (88%)19 (95%)23 (76.7%)0.2140.263 (0.028–2.443)0.381
Q2 I was worried about my heart 30 (60%)16 (80%)14 (46.7%)0.0180.219 (0.059–0.810)0.022
Q3 Partner could not sleep because of my snoring 29 (58%)10 (50%)19 (63.3%)0.3491.727 (0.548–5.448)0.393
Q4 My sleep physician was worried about my OSA 42 (84%)18 (90%)24 (80%)0.3450.444 (0.080–2.465)0.450
Q5 Advice from a friend/acquaintance (who does not have OSA)11 (22%)7 (35%)4 (13.3%)0.0700.286 (0.071–1.155)0.090
Q6 Partner encouraged me to start CPAP 34 (69.4%)14 (70%)20 (69%)0.9380.952 (0.276–3.286)1.000
Q7 I was worried about the health consequences of my sleep problem 39 (78%)17 (85%)22 (73.3%)0.3290.485 (0.112–2.111)0.489
Q8 I was so tired all of the time 36 (72%)16 (80%)20 (66.7%)0.3040.500 (0.132–1.896)0.353
Q9 I was worried that I would have a car accident 10 (20%)5 (25%)5 (16.7%)0.4700.600 (0.149–0.421)0.494
All data are shown as n (%). CPAP: continuous positive airway pressure, CPAP compliant: CPAP used ≥4 h per day on more than 70% of days, CPAP non-compliant: CPAP was not used ≥4 h per day on more than 70% of days, Q: question. * Chi square test (p-value < 0.05 was considered statistically significant), Fisher’s exact test (p-value < 0.05 was considered statistically significant), n = 49 available data.
Table 5. Multiple regression analysis for predictors of CPAP compliance.
Table 5. Multiple regression analysis for predictors of CPAP compliance.
VariableUnstandardized CoefficientsStandard ErrorStandardized CoefficientsTp-Value
Apnea–hypopnea index *−0.3420.990−0.051−0.3450.732
Epworth sleepiness scale *−8.6533.684−0.387−2.3490.024
Total SAQLI score *48.26316.6470.4812.8990.006
CPAP: continuous positive airway pressure, SAQLI: Calgary Sleep Apnea Quality of Life Index. R2 = 0.253, adjusted R2 = 0.198, F = 4.627, p-value = 0.007, p-value < 0.05 was considered statistically significant). * Before CPAP.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Milinovic, K.; Pavlinac Dodig, I.; Lusic Kalcina, L.; Pecotic, R.; Ivkovic, N.; Valic, M.; Dogas, Z. Adherence to CPAP Therapy in Obstructive Sleep Apnea: A Prospective Study on Quality of Life and Determinants of Use. Eur. J. Investig. Health Psychol. Educ. 2024, 14, 2463-2475. https://doi.org/10.3390/ejihpe14090163

AMA Style

Milinovic K, Pavlinac Dodig I, Lusic Kalcina L, Pecotic R, Ivkovic N, Valic M, Dogas Z. Adherence to CPAP Therapy in Obstructive Sleep Apnea: A Prospective Study on Quality of Life and Determinants of Use. European Journal of Investigation in Health, Psychology and Education. 2024; 14(9):2463-2475. https://doi.org/10.3390/ejihpe14090163

Chicago/Turabian Style

Milinovic, Karla, Ivana Pavlinac Dodig, Linda Lusic Kalcina, Renata Pecotic, Natalija Ivkovic, Maja Valic, and Zoran Dogas. 2024. "Adherence to CPAP Therapy in Obstructive Sleep Apnea: A Prospective Study on Quality of Life and Determinants of Use" European Journal of Investigation in Health, Psychology and Education 14, no. 9: 2463-2475. https://doi.org/10.3390/ejihpe14090163

Article Metrics

Back to TopTop