Next Article in Journal
High Serum IL-31 Concentration Is Associated with Itch among Renal Transplant Recipients
Previous Article in Journal
Lymphocyte Population Changes at Two Time Points during the Acute Period of COVID-19 Infection
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Detecting Reasons for Nonadherence to Medication in Adults with Epilepsy: A Review of Self-Report Measures and Key Predictors

1
Department of Neurology, University Hospital Jena, 07747 Jena, Germany
2
Department of Geriatrics, University Hospital Halle, 06120 Halle, Germany
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(15), 4308; https://doi.org/10.3390/jcm11154308
Submission received: 23 June 2022 / Revised: 19 July 2022 / Accepted: 21 July 2022 / Published: 25 July 2022
(This article belongs to the Section Clinical Neurology)

Abstract

:
This review presents individual reasons for self-reported nonadherence in people with epilepsy (PWE). A literature search was performed on the PubMed/Medline and Scopus databases for studies published up to March 2022. Thirty-six studies were included using the following inclusion criteria: original studies on adults with epilepsy, use of subjective self-report adherence measurement methods, and publication in English. Data were extracted using a standardized data extraction table, including the year of publication, authors, cohort size, study design, adherence measurement method, and self-reported reasons for nonadherence. Self-reported reasons for nonadherence were grouped following the WHO model with the five dimensions of nonadherence. In addition, study characteristics and sociodemographic information are reported. Of the 36 included studies, 81% were observational. The average nonadherence rate was nearly 50%. Across all studies, patient-associated, therapy-associated, and circumstance-related factors were the most frequently reported dimensions of nonadherence. These factors include forgetfulness, presence of side-effects, and history of seizures. Regarding healthcare system factors, financial problems were the most reported reason for nonadherence. Stigmatization and quality of life were the most frequently cited factors influencing nonadherence in the disease- and circumstance-related dimensions. The results suggest that interventions for improving adherence should incorporate all dimensions of nonadherence.

1. Introduction

Epilepsy is a common neurological disorder affecting around 50 million patients worldwide [1]. Its management usually requires long-term antiepileptic medical treatment, with antiepileptic drugs (AEDs) offering 70% efficacy in reducing epileptic seizures in adults [2]. However, as in many other chronic disorders, nonadherence to medication is a common and serious issue in people with epilepsy (PWE). Adherence describes the extent to which patients are able or willing to follow recommendations from medical staff. This includes recommendations on medication, diet, and/or lifestyle changes [3]. Nonadherence to medication contributes to adverse drug events, increased length of stay, readmissions to hospitals, lower quality of life (QoL), higher healthcare costs, and overall poorer health outcomes [4,5,6,7].
Estimations regarding the prevalence of medication adherence in PWE vary greatly, with studies reporting values ranging from 21% to 95% [8]. Subjective, objective [9], direct, and indirect methods [10] are used to measure adherence. Objective methods include biochemical assays, prescription records, tablet counts, chemical adherence testing (CAT), and electronic monitoring [9,11]. Although these objective measures tend to be more accurate in their estimation of nonadherence rates, they are often expensive and impractical for everyday use. Moreover, they do not allow inference of the personal reasons for nonadherence. Additionally, several studies have questioned the accuracy of objective measures, indicating that, for example, tablet counting only identifies 50% of patients not taking all their medication [12].
In contrast, subjective methods (e.g., questionnaires and self-reports) are inexpensive to use, feasible in many settings, and allow conclusions about the personal reasons for nonadherence. A disadvantage of these methods is that they can overestimate adherence [12], e.g., because of the fear of disapproval [9]. In questionnaires, this bias manifests itself in lower sensitivity and specificity. However, other studies have reported high face validity and high specificity for self-report measures, although they may be subject to self-presentation and recall bias [13]. Common subjective questionnaires used to assess nonadherence include the Morisky Medication Adherence Score (MMAS) [14], Medication Adherence Rating Scale (MARS-10) [15], and the Morisky–Green Test (MGT) [16].
The World Health Organization (WHO) proposed a five-dimensional system to map the main factors for nonadherence [3] in an attempt to approach the complex construct of nonadherence [17]. These include social and economic factors, e.g., low education level [18], and disease- or circumstance-related factors, such as depression [19,20,21] and stigmatization [20,22,23,24]. Healthcare system factors, e.g., costs and availability of medication, also contribute to nonadherence in some countries [18,25,26,27,28]. Another dimension of nonadherence involves patient-related factors. These include anxiety [29], forgetfulness [8,24,25,26,27,28,30,31,32,33,34,35,36,37,38,39], stress [21], knowledge about the disease and treatment [25,38], and medication beliefs [40].
The factors contributing to nonadherence are especially important because they enable researchers and healthcare providers to understand the mechanisms behind nonadherence and to develop tailored interventions. Thus, this review is not restricted to clinical and demographic factors but focuses especially on the individual causes of nonadherence following the framework introduced by the WHO.
To date, no review exists encompassing all the WHO dimensions of nonadherence in PWE because previous reviews have not been able to address all factors. Malek et al. [41], for example, primarily addressed social and therapy- and disease-related factors, whereas Belayneh and Mekuriaw [42] exclusively thematized therapy- and disease-related factors. Social and economic factors were not discussed at all by O’Rourke and O’Brien [43].
As aforementioned, the reasons for nonadherence are best assessed using self-reported measures. Therefore, the literature for self-reported nonadherence in PWE was systematically reviewed and additionally presented in a standardized data extraction table.

2. Methods

This systematic review was conducted following the Preferred Reporting for Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 statement [44]. This review was not preregistered, and no protocol was prepared.

2.1. Search Strategy and Selection

The literature search took place between May 2021 and March 2022. Data were collected from the PubMed/Medline and Scopus databases using the following MeSH terms: drug, medication, adherence, compliance, self-report, questionnaire, epilepsy, and seizures. Keywords were truncated and combined using the Boolean operators “OR” and “AND”. The exact search criteria are provided in File S1.
All studies yielding original data on adult patients with epilepsy that used a subjective adherence measurement method were included. To collect encompassing information on the reasons for nonadherence, the scope of review following study design or publication year was not limited.
However, conference abstracts, editorials, and opinion pieces, studies exclusively on children and adolescents <18 years old, studies in languages other than English, studies using only objective measures of adherence, and studies that excluded PWE were excluded.

2.2. Data Extraction and Analysis

The initial search of this paper identified 104 studies on the basis of the title and abstract. Thereafter, the full texts of the articles were screened, and several publications were excluded for not meeting the inclusion criteria, including duplicates (n = 3), unavailable full texts (n = 15), exclusive inclusion of children and adolescents <18 years old (n = 12), missing thematization of PWE (n = 1), opinion study (n = 1), and missing analysis of self-reports of nonadherence (n = 26). Finally, 36 publications published between 1997 [22] and 2022 [34] were included for further analysis (see Figure 1 for the selection procedure). Data were extracted using a standardized data extraction table (File S2) listing the year of publication, country, authors, cohort size, study design, adherence measurement method, and (self-reported) reasons for nonadherence. In addition, the following data were documented if available: mean age, sex distribution, marital status, education level, and prevalence of nonadherence.

2.3. Quality and Level of Evidence

Most of the studies in this review were observational studies, which included cross-sectional, retrospective, longitudinal, and community-based studies [45]. For studies without a specified design, their observational nature was assumed on the basis of the information derived from the manuscripts. The National Institutes of Health’s quality assessment tool for cohort and cross-sectional observational studies was then used to assess quality [46]. An overview of the tool is provided in File S3. The criteria evaluated 14 items, which were satisfied by each included study, which included questions on the study population, definition of the study objectives, inclusion and exclusion criteria, sample size calculation, and analyses with the definition of the dependent and independent variables. The quality assessment showed that the selected studies were of good quality, and no further studies were excluded on the basis of these guidelines.

3. Results

The study parameters are listed in Table 1. Most of the 36 studies used a cross-sectional design (n = 24). The others were one each of a longitudinal [47], retrospective [30], and community-based [22] nature. Two studies did not specify the observational design used [33,48], whereas seven provided no information about the study design [8,20,24,28,32,37,49].

3.1. Demographic Data

Detailed data on the patients included in the studies are presented in Table 2. The smallest and largest sample sizes were 55 [21] and 1182 [20], respectively. The mean age of the participants across all studies was 37 ± 10 years (range, 21–74 years) [47] with an average male sex distribution of 51% ± 11%. The lowest and highest proportion of men was 31.5% [20] and 73.9% [40], respectively.
Eighteen studies did not mention the type of epilepsy affecting the included participants. In one study, only patients with temporal lobe epilepsy were included [29]. Moreover, 17 countries are represented in the 36 studies (Table 3). Five studies each involved US and Chinese participants, four each involved Ethiopians and Indian participants, and three each involved Malaysian and British participants. Detailed information can be found in File S2.

3.2. Adherence Measures

Adherence was recorded using the MMAS in 16 of the included studies (see also Table 1). In half of those studies, the MMAS-4 [8,18,27,37,39,48,50,51] was used, whereas the other half used the MMAS-8 [21,23,29,34,52,53,54,55]. MMAS evaluates forgetfulness and modification of medication due to an improvement in wellbeing, as well as therapy-associated factors in terms of side-effects.
Nine studies used a questionnaire specifically designed for each of them [19,20,22,25,26,28,32,36,38]. The MARS-10 [40,56] and MGT [33,57] were applied in two studies each. The MARS-10 and MGT evaluate patient- and therapy-associated factors. The former examines forgetfulness and negative beliefs about medication, whereas the latter assesses forgetfulness and modifications due to an improvement in wellbeing. Both investigate side-effects within the framework of the therapy-associated factors.
The following adherence measurement methods were each used in a single study:
-
Adherence Assessment Questionnaire (AAQ) [31], which assesses patient-related factors (e.g., forgetfulness, intentional modifications, and psychosocial stress) and therapy-associated factors (e.g., side effects);
-
Epilepsy Self-Management Scale (ESMS) [49], which assesses patient-related factors, therapy-associated factors, and healthcare system factors (e.g., financial problems);
-
Knobel Brief Adherence Questionnaire (KBAQ) [24], which assesses patient-related factors (e.g., forgetfulness) and therapy-associated factors (e.g., side effects);
-
Malaysian Medication Adherence Scale (MALMAS) [35], which is derived from the MMAS and assesses patient-associated factors (e.g., forgetting and modifying due to an improvement in wellbeing) and therapy-associated factors (e.g., side-effects);
-
MARS-5 [47], which assesses patient-related factors to investigate intentional nonadherence
-
Medication Compliance Questionnaire (MCQ) [58], which assesses patient-related factors (e.g., forgetfulness and psychosocial stress) and therapy-associated factors (e.g., side-effects);
-
Medication Possession Ratio Self-report Questionnaire (MPR) [30], which provides theming of patient-related factors (e.g., forgetting), beliefs about medication, fear of side-effects, and healthcare-related factors (e.g., costs).
Additionally, eight publications used a second score to assess adherence, among which six chose the Beliefs about Medicines Questionnaire [21,33,37,39,40,52]. In one study each, the Baseline Adherence Questionnaire [31] and pill count [48] were applied.
Notably, all the instruments classify nonadherence differently. MMAS-4 defines nonadherence as a sum score >0 [39]. Alternatively, the MMAS-8 defines a score of 8, 6–7, and <6 as high, medium, and low adherence, respectively [53]. In the MARS-5, high adherence is indicated by a score >20 [59], whereas in the MARS-10, respondents with a score ≥6 are considered adherent [40]. In the MGT, the respondent is considered highly adherent if the answers to all four questions are “no”, moderately adherent if the answers to one to two questions are “yes”, and weakly adherent if the answers to more than two questions are “yes”. Overall, moderate and low adherence are considered nonadherent [33]. The KBAQ contains six questions, for which higher scores indicate better adherence [24]. The same principle is applied in the AAQ, which contains eight questions [31]. For MPR, participants with scores ≥0.8 are considered adherent, whereas those with scores <0.8 are considered nonadherent, with 0.8 being the medication quotient taken to medication prescribed [30]. Chapman et al. [49] classified participants as adherent or nonadherent using a combination of ESMS and MPR. The ESMS contains two questions with five response options each. Higher scores indicate better adherence. The MCQ includes seven questions, with scores of 26 and below considered as nonadherent behavior. Scores of 27 and 28 are defined as adherent behavior [58]. A MALMAS score <6 of a possible eight achievable points is considered clinically significant nonadherence [60].
The level of adherence is measured differently with each score; therefore, prevalence rates, as well as reasons for nonadherence, must be interpreted with caution.
Self-generated questionnaires were structured in various ways in previous studies. Niriayo et al. [36] prepared the questionnaire on the basis of various studies. Banks et al. [32] selected two questions, and a free-text section was included. “How often do you forget to take your medication?” was the first question with a Likert scale as a response option. The second question, “Have you ever intentionally not taken your medication as prescribed?”, was a yes/no question. Hovinga et al. [26] asked whether taking AEDs was forgotten or stopped at three timepoints (i.e., last week, last month, or last 3 months). Nonadherence was defined as forgetting or stopping a dose in the last month or more often [61]. Liu et al. [38] also used a limit of 1 month [61] and inquired into the reasons for nonadherence through the questionnaire. Paschal et al. [25] included questions on causes of nonadherence. Buck et al. [22] included a question about adherence (whether and how regularly medication is forgotten) in their postal questionnaire. Molugulu et al. [19] developed a questionnaire with five sections: adherence, satisfaction with therapy, psychosocial factors, QoL, and mental health. Durón et al. [28] inquired about treatment adherence in addition to general and epilepsy-specific questions. In an online survey by Henning et al. [20], information on intentional and nonintentional adherence was collected using the questions “Does it happen that you accidentally take your AEDs differently than agreed with your doctor?” and “Does it happen that you intentionally (on purpose) take your AEDs differently than agreed with your doctor?” Response options were also Likert-scaled.

3.3. Patient-Related Factors

Regarding patient-related factors, forgetting to take medication was the most frequently mentioned reason for nonadherence, as cited in 20 publications [8,18,24,25,26,27,28,30,31,32,33,34,35,36,37,38,39,57]. The prevalence of forgetfulness ranged from 13.2% [28] to 94.6% [39]. Fear of side-effects is another often-cited cause of nonadherence [8,18,24,25,26,27,28,30,31,37,38,39]. Similarly, concerns regarding medication, especially regarding the effectiveness of AEDs, have been highlighted in several studies [8,18,30]. In addition, concerns about AED safety [31,36], negative attitudes [28,38], negative beliefs [40] about therapy, and a generally negative attitude [19,20,36,50,52] toward the disease were also frequent patient-related reasons for nonadherence. Notably, medication beliefs can involve different aspects of medication-taking, for example, believing in the importance [22,56] or effectiveness [57] of medications, as well as having negative beliefs or concerns [49] about the purpose and harms of AEDs [52]. Regarding beliefs in the importance of medication, nonadherence attributable to better overall wellbeing should also be mentioned [18,28,34,35,37]. Other aspects of patient-related factors include psychosocial stress [31], among other things within the framework of the working life [35,58], fear of dependence on the AED [18], limited health information provided [25,38], anxiety [29], male sex [20], carelessness regarding intake [37], and problems with the intake [35].

3.4. Therapy-Associated Factors

The therapy-associated factor most often mentioned in the 36 studies was the presence side-effects [8,18,20,22,23,24,25,26,27,28,30,31,33,37,38,39,40,53]. Likewise, a higher number of medications was associated with nonadherence in seven studies. Although Buck et al. [22] identified monotherapy as a predictor of nonadherence, the majority of the studies reviewed found that a higher number of medications per day was associated with nonadherence [30,36,48,51,54,57]. Other reasons for nonadherence were the overall complexity of drug therapy [19,27,54,55], longer treatment duration [23,38,50], higher serum AED concentration [47], and concurrent valproate medication [40,48].

3.5. Healthcare System Factors

Five studies found that the inability to procure the medication [27,28,30,36,38] and financial problems [18,25,26,27,28] were associated with nonadherence and were the most frequently cited healthcare system factors. Additionally, a limited patient–prescriber relationship [38], AED cost [19,23,57], and lack of patient involvement [56] were identified with nonadherent behavior.

3.6. Social and Economic Factors

Age was recognized as an influential factor in adherence behavior. Most of the studies demonstrated a younger age as a correlating factor [20,22,35,51], whereas Abd Wahab et al. [18] and Liu et al. [38] reported older age as a predictor of nonadherence. Other social and economic factors associated with nonadherence were lower education level [18], living alone [51] or being single/divorced [40], and limitations in resources [56].

3.7. Disease- and Circumstance-Related Factors

Twelve studies found that a history of seizures was associated with nonadherence [18,19,26,31,36,37,47,51,53,54,55,57]. Furthermore, lower QoL [34,47], hippocampal sclerosis [29], stigmatization of epilepsy [20,22,23,24], (chronic) comorbidities [36,40,52], depression [19,20,21], dementia [20,51], and longer seizure-free time [8] were factors related to nonadherence.

4. Discussion

Overall, the present review summarized the subjective and health-related factors associated with nonadherence in PWE. The WHO created a five-dimensional system for mapping the main factors for nonadherence [3].

4.1. Self-Reported Reasons for Nonadherence

The most frequently mentioned reasons for nonadherence were forgetfulness [8,24,25,26,27,28,30,31,32,33,34,35,36,37,38,39,57], side-effects of the AED [8,18,24,25,26,27,28,30,31,37,38,39], and recent seizures [18,19,26,31,36,37,47,51,53,54,55,57]. Thus, patient-associated, therapy-associated, and circumstance-related factors were the three most frequently mentioned dimensions of PWE nonadherence. This matches previous data, where it has also been shown that forgetfulness and side-effects are common causes of other conditions, including neurological [62] and non-neurological diseases [63]. Likewise, interventions using reminders or electronic medication tracking have proven successful in improving adherence [64], again highlighting the impact forgetting has on adherence but also indicating that this particular reason can be overcome. Regarding the clustering of epileptic seizures as a cause of nonadherence, the selected studies showed a discrepancy. Chapman et al. [49] reported seizure clustering as a protector for nonadherence. The authors explained that, while frequent seizures required more frequent medication, more side-effects, and therefore, more concerns about epilepsy medications, they also reinforced the idea that patients needed their epilepsy medications to a greater extent, thereby promoting adherence.
Other therapy-associated factors included the number of medications [30,36,48,51,54,57] and the complexity of the drug therapy [19,27,54,55]. Buck et al. [22] pointed out that monotherapy increases the risk of nonadherence, whereas other publications found an association of nonadherence with polypharmacy. The latter fits into the current state of knowledge because an increasing number of drugs, as well as a complex medication regimen, has been shown to increase the risk of nonadherence in other chronic illnesses [19,27,54,55]. Furthermore, Buck et al. [22] rationalized that patients on polytherapy have suffered from seizures previously and are, therefore, more sensitized to the relevance of the AED. Thus, they place high importance on adherence to their medication regimen and are, therefore, more adherent despite the higher number of AEDs.
Regarding patient-associated factors, work–life balance should be mentioned, because the inconvenience of taking medications outside the home and stress, in general, were notable reasons for nonadherence in this review [30,34,58]. This finding is also consistent with another previous study reporting that a stressful lifestyle is an important barrier to adherence in people with chronic diseases [62].
Important examples of disease- and circumstance-related factors mentioned in the review were stigmatization [20,22,23,24] and QoL [34,47]. A previous study found that ~30% of patients suffered from stigmatization, which shows a detrimental influence on QoL [65]. The association between nonadherence and QoL has also been observed in other diseases, with QoL and nonadherence mutually influencing each other. That is, while QoL is a predictor of nonadherence, nonadherence also leads to reduced QoL [4,5,6,7]. In this manner, a clinical intervention trial [66] using a multidisciplinary program effectively improved adherence, depression, and QoL, again highlighting the interactive relationship between those factors.
In addition to patient- and disease-related factors, the healthcare system factors play an important role. This was also shown in the present work, in which it was repeatedly demonstrated that financial problems [18,25,26,27,28] connected with the cost of AEDs [19,23,57] and inability to procure the medication [27,28,30,36,38] were reasons for nonadherence. These factors play a particularly relevant role in epilepsy, because most PWE live in low- and middle-income countries [1].
Similar to social and economic factors, the association between a lower education level and nonadherence was pointed out in the review [18]. Das et al. [54] found that two-thirds of patients were illiterate or had no formal schooling, fitting with PWE having an overall lower educational attainment [1]. Lower schooling was also identified as a risk for nonadherence in other diseases [67]. Of note, a differentiation must be made between general school-based education, which is closely linked to socioeconomic status and overall intelligence and hard to modify in advancing age, and health-specific educational approaches, which can be used to buffer nonadherence to a degree [11]. For example, Tang et al. [68] were able to show a positive influence of medical education on both adherence and AED side-effects, indicating that precise information on medication can help reduce nonadherence.
Age, on the other hand, appears to have an inconsistent effect on adherence behavior. While, in the current review, younger age was mentioned more frequently as an influencing factor for nonadherence [20,22,35,51], older age was mentioned only twice [18,38], although this was further confirmed by another study [69]. Whereas older age is often associated with multimorbidity and polypharmacy and, therefore, higher rates of forgetting [7], younger age may be influenced by a busier lifestyle, especially when patients are still working or taking care of children, or reduced beliefs in the necessity of medication, leading to reduced adherence [70]. These differing results again highlight the complexity of adherence and the need to take individual characteristics into account when developing interventions to improve nonadherence.
Overall, it is of note to say that the identification and prevalence of each reason for nonadherence depends strongly on the questionnaires used, as a particular predictor can only be identified if it is included in the adherence assessment tool used.

4.2. Prevalence of Nonadherence

Regarding the prevalence of nonadherence, the reviewed studies showed a wide range of nonadherence rates from 21% [53] to 95% [8] of included patients. Across all studies, an average nonadherence rate of almost 50% was estimated, which confirms the findings of Sabaté [3] and Haynes et al. [71] reporting a 50% prevalence of nonadherence in people with chronic diseases. The wide range of reported nonadherence rates could be due to the different measurement methods used to assess adherence (13 different methods in the current review). The different cutoff values found for adherent behavior were based on different methods used to collect data on adherence as already mentioned in Section 2. In particular, only two cutoff values were defined for the self-administered questionnaires [26,38]. This hinders the comparability of the reported prevalence rates for nonadherence. In addition, prevalence rates based on self-reported measures should be interpreted with caution because they may be biased [12].

4.3. Limitations of the Review

This review had some limitations. Studies that included subjective measurement methods were selected. This hinders the comparability of the reported prevalence rates for nonadherence. In addition, prevalence rates based on self-reported measures should be interpreted with caution because they may be biased [12]. Despite this, the included studies are of good quality. According to the questionnaires used in the studies reviewed, patient- and therapy-associated factors were most frequently asked and, therefore, most frequently represented. Thus, disease- and circumstance-related factors tended to be underrepresented, whereas these factors are often cited as major causes of nonadherence, especially QoL, in other (neurological) disorders [4,5,6,7].
Data on sex distribution in PWE are scarce. The combined sex distribution of all studies reviewed was 50%. Hauser et al. [72] found a clustering of male patients in unprovoked seizures. However, the balanced sex ratio obtained in this review may be because all seizure types were included. Furthermore, sex distribution was not evaluated following epilepsy type in the review, and not all included studies examined epilepsy types. In the present study, focal epilepsy was slightly predominant among the included studies at 56%. This fits the distribution in the normal adult population, where focal epilepsy is more frequent than the generalized ones [73].

5. Conclusions

Nonadherence is common in PWE, with an average prevalence of ~50%. As nonadherence is associated with poorer health outcomes and lower quality of life, it is crucial to understand the reasons for this common but detrimental issue. This review, therefore, emphasized the multidimensionality of nonadherence and showed that patient-associated, therapy-associated, and circumstance-related factors are the most frequently self-reported causes of nonadherence. However, healthcare system problems and social factors should not be underestimated, especially because most PWE come from middle- and low-income countries. Interventions to improve adherence in PWE should, therefore, take into account this complexity and the individual nature of the reasons for nonadherence. Accounting for several different dimensions of nonadherence is essential to assist PWE in taking their medication as prescribed and ultimately promoting better health.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm11154308/s1: File S1. Search criteria; File S2. Study overview; File S3. The National Institutes of Health (NIH) quality assessment tool for observational cohort and cross-sectional studies.

Author Contributions

S.M., literature search, analysis, and writing the paper; T.P., design of the study, data collection, and critical revision of the article; A.S., critical revision of the article. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a Bundesministerium für Bildung und Forschung grant to T.P. (01GY1804).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization (WHO). WHO fact sheet epilepsy. In WHO Fact Sheets; WHO: Geneva, Switzerland, 2022. [Google Scholar]
  2. Kwan, P.; Brodie, M.J. Early identification of refractory epilepsy. N. Engl. J. Med. 2000, 342, 314–319. [Google Scholar] [CrossRef] [PubMed]
  3. Sabaté, E. Adherence to Long-Term Therapies: Evidence for Action; World Health Organization: Geneva, Switzerland, 2003. [Google Scholar]
  4. DiMatteo, M.R.; Giordani, P.J.; Lepper, H.S.; Croghan, T.W. Patient adherence and medical treatment outcomes: A meta-analysis. Med. Care 2002, 40, 794–811. [Google Scholar] [CrossRef] [PubMed]
  5. Haynes, R.B.; Yao, X.; Degani, A.; Kripalani, S.; Garg, A.; McDonald, H.P. Interventions to enhance medication adherence. Cochrane Database Syst. Rev. 2005, 4, 1–97. [Google Scholar] [CrossRef]
  6. Budnitz, D.S.; Lovegrove, M.C.; Shehab, N.; Richards, C.L. Emergency hospitalizations for adverse drug events in older Americans. N. Engl. J. Med. 2011, 365, 2002–2012. [Google Scholar] [CrossRef]
  7. Yap, A.F.; Thirumoorthy, T.; Kwan, Y.H. Systematic review of the barriers affecting medication adherence in older adults. Geriatr. Gerontol. Int. 2016, 16, 1093–1101. [Google Scholar] [CrossRef]
  8. Tang, F.; Zhu, G.; Jiao, Z.; Ma, C.; Wang, B. Self-reported adherence in patients with epilepsy who missed their medications and reasons for nonadherence in China. Epilepsy Behav. 2013, 27, 85–89. [Google Scholar] [CrossRef]
  9. Bainbridge, J.L.; Ruscin, J.M. Challenges of Treatment Adherence in Older Patients with Parkinson’s Disease. Drug Aging 2009, 26, 145–155. [Google Scholar] [CrossRef]
  10. Osterberg, L.; Blaschke, T. Adherence to medication. N. Engl. J. Med. 2005, 353, 487–497. [Google Scholar] [CrossRef] [Green Version]
  11. Lane, D.; Lawson, A.; Burns, A.; Azizi, M.; Burnier, M.; Jones, D.J.L.; Kably, B.; Khunti, K.; Kreutz, R.; Patel, P.; et al. Nonadherence in Hypertension: How to Develop and Implement Chemical Adherence Testing. Hypertension 2022, 79, 12–23. [Google Scholar] [CrossRef]
  12. Grosset, K.A.; Bone, I.; Reid, J.L.; Grosset, D. Measuring therapy adherence in Parkinson’s disease: A comparison of methods. J. Neurol. Neurosurg. Psychiatry 2006, 77, 249–251. [Google Scholar] [CrossRef] [Green Version]
  13. Garfield, S.; Clifford, S.; Eliasson, L.; Barber, N.; Willson, A. Suitability of measures of self-reported medication adherence for routine clinical use: A systematic review. BMC Med. Res. Methodol. 2011, 11, 149. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Morisky, D.E.; Ang, A.; Krousel-Wood, M.; Ward, H.J. Predictive validity of a medication adherence measure in an outpatient setting. J. Clin. Hypertens. 2008, 10, 348–354. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Thompson, K.; Kulkarni, J.; Sergejew, A.A. Reliability and validity of a new Medication Adherence Rating Scale (MARS) for the psychoses. Schizophr. Res. 2000, 42, 241–247. [Google Scholar] [CrossRef]
  16. Morisky, D.E.; Green, L.W.; Levine, D.M. Concurrent and predictive validity of a self-reported measure of medication adherence. Med. Care 1986, 24, 67–74. [Google Scholar] [CrossRef] [PubMed]
  17. Brown, M.T.; Bussell, J.K. Medication adherence: WHO cares? Mayo Clin. Proc. 2011, 86, 304–314. [Google Scholar] [CrossRef] [Green Version]
  18. Abd Wahab, E.S.; Al Omar, M.; Altabakha, M. Adherence to Antiepileptic Drugs among Patients Attending the Neuro Spinal Hospital in the United Arab Emirates. J. Pharm. Bioallied Sci. 2020, 12, 499–507. [Google Scholar] [CrossRef]
  19. Molugulu, N.; Gubbiyappa, K.S.; Vasudeva Murthy, C.R.; Lumae, L.; Mruthyunjaya, A.T. Evaluation of self-reported medication adherence and its associated factors among epilepsy patients in Hospital Kuala Lumpur. J. Basic Clin. Pharm. 2016, 7, 105–109. [Google Scholar] [CrossRef] [Green Version]
  20. Henning, O.; Johannessen Landmark, C.; Nakken, K.O.; Lossius, M.I. Nonadherence to treatment regimens in epilepsy from the patient’s perspective and predisposing factors: Differences between intentional and unintentional lack of adherence. Epilepsia 2019, 60, e58–e62. [Google Scholar] [CrossRef]
  21. Shallcross, A.J.; Becker, D.A.; Singh, A.; Friedman, D.; Jurd, R.; French, J.A.; Devinsky, O.; Spruill, T.M. Psychosocial factors associated with medication adherence in ethnically and socioeconomically diverse patients with epilepsy. Epilepsy Behav. 2015, 46, 242–245. [Google Scholar] [CrossRef] [Green Version]
  22. Buck, D.; Jacoby, A.; Baker, G.A.; Chadwick, D.W. Factors influencing compliance with antiepileptic drug regimes. Seizure 1997, 6, 87–93. [Google Scholar] [CrossRef]
  23. Getnet, A.; Woldeyohannes, S.M.; Bekana, L.; Mekonen, T.; Fekadu, W.; Menberu, M.; Yimer, S.; Assaye, A.; Belete, A.; Belete, H. Antiepileptic Drug Nonadherence and Its Predictors among People with Epilepsy. Behav. Neurol. 2016, 2016, 3189108. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Chesaniuk, M.; Choi, H.; Wicks, P.; Stadler, G. Perceived stigma and adherence in epilepsy: Evidence for a link and mediating processes. Epilepsy Behav. 2014, 41, 227–231. [Google Scholar] [CrossRef] [PubMed]
  25. Paschal, A.M.; Rush, S.E.; Sadler, T. Factors associated with medication adherence in patients with epilepsy and recommendations for improvement. Epilepsy Behav. 2014, 31, 346–350. [Google Scholar] [CrossRef] [PubMed]
  26. Hovinga, C.A.; Asato, M.R.; Manjunath, R.; Wheless, J.W.; Phelps, S.J.; Sheth, R.D.; Pina-Garza, J.E.; Zingaro, W.M.; Haskins, L.S. Association of non-adherence to antiepileptic drugs and seizures, quality of life, and productivity: Survey of patients with epilepsy and physicians. Epilepsy Behav. 2008, 13, 316–322. [Google Scholar] [CrossRef] [PubMed]
  27. Mroueh, L.; Boumediene, F.; Jost, J.; Ratsimbazafy, V.; Preux, P.M.; Salameh, P.; Al-Hajje, A. Self-reported attitudes about medication in Lebanese people with epilepsy. Epilepsy Behav. 2019, 98, 80–87. [Google Scholar] [CrossRef]
  28. Durón, R.M.; Medina, M.T.; Nicolás, O.; Varela, F.E.; Ramírez, F.; Battle, S.J.; Thompson, A.; Rodríguez, L.C.; Oseguera, C.; Aguilar-Estrada, R.L.; et al. Adherence and complementary and alternative medicine use among Honduran people with epilepsy. Epilepsy Behav. 2009, 14, 645–650. [Google Scholar] [CrossRef]
  29. Wang, S.; Chen, C.; Jin, B.; Yang, L.; Ding, Y.; Guo, Y.; Chen, Y.; Wang, S.; Ding, M. The association of psychosocial variables with adherence to antiepileptic drugs in patients with temporal lobe epilepsy. Epilepsy Behav. 2017, 77, 39–43. [Google Scholar] [CrossRef]
  30. Liu, J.; Xu, R.; Liu, Z.; You, Y.; Meng, F. Factors influencing medication adherence after epilepsy surgery. Epileptic Disord. 2015, 17, 47–51. [Google Scholar] [CrossRef]
  31. Chinnaiyan, S.; Narayana, S.; Nanjappa, V.P. Adherence to Antiepileptic Therapy in Adults. J. Neurosci. Rural Pract. 2017, 8, 417–420. [Google Scholar] [CrossRef]
  32. Banks, J.; Varley, J.; Fitzsimons, M.; Doherty, C.P. Self-reported antiepilepsy medication adherence and its connection to perception of medication error. Epilepsy Behav. 2020, 104, 106896. [Google Scholar] [CrossRef]
  33. Siqueira, H.H.; Dalbem, J.S.; Schiavini, M.; Silva, P.E.; Costa, T.B.P.; Leite, P.; Koeche, B.; Diesel, M.; Scolari, L.P.; Wolf, P.; et al. Self-reported adherence among people with epilepsy in Brazil. Epilepsy Behav. 2020, 103, 106498. [Google Scholar] [CrossRef] [PubMed]
  34. Minwuyelet, F.; Mulugeta, H.; Tsegaye, D.; Lake, B.; Getie, A.; Tsegaye, B.; Mullu, G. Quality of life and associated factors among patients with epilepsy at specialized hospitals, Northwest Ethiopia; 2019. PLoS ONE 2022, 17, e0262814. [Google Scholar] [CrossRef] [PubMed]
  35. Junaid Farrukh, M.; Makmor Bakry, M.; Hatah, E.; Hui Jan, T. Medication adherence status among patients with neurological conditions and its association with quality of life. Saudi Pharm. J. 2021, 29, 427–433. [Google Scholar] [CrossRef] [PubMed]
  36. Niriayo, Y.L.; Mamo, A.; Gidey, K.; Demoz, G.T. Medication Belief and Adherence among Patients with Epilepsy. Behav. Neurol. 2019, 2019, 2806341. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Nakhutina, L.; Gonzalez, J.S.; Margolis, S.A.; Spada, A.; Grant, A. Adherence to antiepileptic drugs and beliefs about medication among predominantly ethnic minority patients with epilepsy. Epilepsy Behav. 2011, 22, 584–586. [Google Scholar] [CrossRef] [Green Version]
  38. Liu, J.; Liu, Z.; Ding, H.; Yang, X. Adherence to treatment and influencing factors in a sample of Chinese epilepsy patients. Epileptic Disord. 2013, 15, 289–294. [Google Scholar] [CrossRef]
  39. Elsayed, M.A.; El-Sayed, N.M.; Badi, S.; Ahmed, M.H. Factors affecting adherence to antiepileptic medications among Sudanese individuals with epilepsy: A cross-sectional survey. J. Fam. Med. Prim. Care 2019, 8, 2312–2317. [Google Scholar] [CrossRef]
  40. Bhalla, D.; Lotfalinezhad, E.; Amini, F.; Delbari, A.; Fadaye-Vatan, R.; Saii, V.; Gharagozli, K. Medication Beliefs and Adherence to Antiseizure Medications. Neurol. Res. Int. 2020, 2020, 6718915. [Google Scholar] [CrossRef]
  41. Malek, N.; Heath, C.A.; Greene, J. A review of medication adherence in people with epilepsy. Acta Neurol. Scand. 2017, 135, 507–515. [Google Scholar] [CrossRef]
  42. Belayneh, Z.; Mekuriaw, B. A systematic review and meta-analysis of anti-epileptic medication non-adherence among people with epilepsy in Ethiopia. Arch. Public Health 2020, 78, 23. [Google Scholar] [CrossRef]
  43. O’ Rourke, G.; O’ Brien, J. Identifying the barriers to antiepileptic drug adherence among adults with epilepsy. Seizure 2017, 45, 160–168. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]
  45. Dreyer, N.A.; Schneeweiss, S.; McNeil, B.J.; Berger, M.L.; Walker, A.M.; Ollendorf, D.A.; Gliklich, R.E. GRACE principles: Recognizing high-quality observational studies of comparative effectiveness. Am. J. Manag. Care 2010, 16, 467–471. [Google Scholar]
  46. National Heart, Lung, and Blood Institute (NHLBI). Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies. Available online: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools (accessed on 10 March 2022).
  47. Hamedi-Shahraki, S.; Eshraghian, M.; Yekaninejad, M.; Nikoobakht, M.; Rasekhi, A.; Chen, H.; Pakpour, A. Health-related quality of life and medication adherence in elderly patients with epilepsy. Neurol. Neurochir. Pol. 2019, 53, 123–130. [Google Scholar] [CrossRef]
  48. Singh, P.; Gupta, K.; Singh, G.; Kaushal, S. Simultaneous Use of Two Different Tools to Assess Compliance with Antiepileptic Drugs: Experience in A Community-Based Study. J. Neurosci. Rural Pract. 2020, 11, 636–639. [Google Scholar] [CrossRef] [PubMed]
  49. Chapman, S.C.; Horne, R.; Chater, A.; Hukins, D.; Smithson, W.H. Patients’ perspectives on antiepileptic medication: Relationships between beliefs about medicines and adherence among patients with epilepsy in UK primary care. Epilepsy Behav. 2014, 31, 312–320. [Google Scholar] [CrossRef]
  50. Mbuba, C.K.; Ngugi, A.K.; Fegan, G.; Ibinda, F.; Muchohi, S.N.; Nyundo, C.; Odhiambo, R.; Edwards, T.; Odermatt, P.; Carter, J.A.; et al. Risk factors associated with the epilepsy treatment gap in Kilifi, Kenya: A cross-sectional study. Lancet Neurol. 2012, 11, 688–696. [Google Scholar] [CrossRef] [Green Version]
  51. Suzuki, H.; Mikuni, N.; Ohnishi, H.; Yokoyama, R.; Enatsu, R.; Ochi, S. Forgetting to take antiseizure medications is associated with focal to bilateral tonic-clonic seizures, as revealed by a cross-sectional study. PLoS ONE 2020, 15, e0240082. [Google Scholar] [CrossRef]
  52. Dayapoğlu, N.; Turan, G.B.; Özer, Z. Evaluation of medication adherence and medication beliefs among patients with epilepsy. Epilepsy Behav. 2021, 124, 108366. [Google Scholar] [CrossRef]
  53. Yang, A.; Wang, B.; Zhu, G.; Jiao, Z.; Fang, Y.; Tang, F.; Ma, C.; Zhao, Y.; Cheng, C.; Zhong, M. Validation of Chinese version of the Morisky medication adherence scale in patients with epilepsy. Seizure 2014, 23, 295–299. [Google Scholar] [CrossRef] [Green Version]
  54. Das, A.M.; Ramamoorthy, L.; Narayan, S.K.; Wadwekar, V. Barriers of Drug Adherence among Patients with Epilepsy: In Tertiary Care Hospital, South India. J. Caring Sci. 2018, 7, 177–181. [Google Scholar] [CrossRef] [PubMed]
  55. Das, A.M.; Ramamoorthy, L.; Narayan, S.K.; Wadvekar, V.; Harichandrakumar, K.T. Adherence to Antiepileptic Regime: A Cross-sectional Survey. Neurol. India 2020, 68, 856–860. [Google Scholar] [CrossRef] [PubMed]
  56. Chapman, S.C.; Horne, R.; Eade, R.; Balestrini, S.; Rush, J.; Sisodiya, S.M. Applying a perceptions and practicalities approach to understanding nonadherence to antiepileptic drugs. Epilepsia 2015, 56, 1398–1407. [Google Scholar] [CrossRef]
  57. Nasir, B.B.; Berha, A.B.; Gebrewold, M.A.; Yifru, Y.M.; Engidawork, E.; Woldu, M.A. Drug therapy problems and treatment satisfaction among ambulatory patients with epilepsy in a specialized hospital in Ethiopia. PLoS ONE 2020, 15, e0227359. [Google Scholar] [CrossRef]
  58. Teh, K.X.; Henien, N.P.B.; Wong, L.S.; Wong, Z.K.H.; Raja Ismail, R.Z.; Achok, H.N.; Mariapun, J.; Yunos, N.M. A cross-sectional study on the rate of non-adherence to anti-seizure medications and factors associated with non-adherence among patients with epilepsy. PLoS ONE 2020, 15, e0235674. [Google Scholar] [CrossRef]
  59. van de Steeg, N.; Sielk, M.; Pentzek, M.; Bakx, C.; Altiner, A. Drug-adherence questionnaires not valid for patients taking blood-pressure-lowering drugs in a primary health care setting. J. Eval. Clin. Pract. 2009, 15, 468–472. [Google Scholar] [CrossRef] [PubMed]
  60. Chung, W.W.; Chua, S.S.; Lai, P.S.; Morisky, D.E. The Malaysian Medication Adherence Scale (MALMAS): Concurrent Validity Using a Clinical Measure among People with Type 2 Diabetes in Malaysia. PLoS ONE 2015, 10, e0124275. [Google Scholar] [CrossRef] [PubMed]
  61. Doughty, J.; Baker, G.A.; Jacoby, A.; Lavaud, V. Compliance and satisfaction with switching from an immediate-release to sustained-release formulation of valproate in people with epilepsy. Epilepsy Behav. 2003, 4, 710–716. [Google Scholar] [CrossRef]
  62. Khan, M.U.; Shah, S.; Hameed, T. Barriers to and determinants of medication adherence among hypertensive patients attended National Health Service Hospital, Sunderland. J. Pharm. Bioallied Sci. 2014, 6, 104–108. [Google Scholar] [CrossRef]
  63. Prell, T.; Grosskreutz, J.; Mendorf, S.; Franke, G.H.; Witte, O.W.; Kunze, A. Clusters of non-adherence to medication in neurological patients. Res. Soc. Adm. Pharm. 2019, 15, 1419–1424. [Google Scholar] [CrossRef]
  64. Li, J.; Si, Y.; Hu, J.; Liu, L.; Deng, Y.; He, J.; Zhang, N.M.; Zhou, D. Enhancing medical compliance of patients with convulsive epilepsy in rural community: A randomized intervention trial. Epilepsia 2013, 54, 1988–1996. [Google Scholar] [CrossRef] [PubMed]
  65. Lee, S.-A.; Yoo, H.-J.; Lee, B.-I. Factors contributing to the stigma of epilepsy. Seizure Eur. J. Epilepsy 2005, 14, 157–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Zheng, Y.; Ding, X.; Guo, Y.; Chen, Q.; Wang, W.; Zheng, Y.; Wang, S.; Ding, Y.; Ding, M. Multidisciplinary management improves anxiety, depression, medication adherence, and quality of life among patients with epilepsy in eastern China: A prospective study. Epilepsy Behav. 2019, 100, 106400. [Google Scholar] [CrossRef]
  67. Pandey, A.; Suskin, N.; Patel, T.; Choudhry, N. Lower Educational Levels Maybe an Important Determinant of Adherence to Evidenced-Based Therapies in Post-MI Patients. J. Am. Coll. Cardiol. 2017, 69, 1847. [Google Scholar] [CrossRef]
  68. Tang, F.; Zhu, G.; Jiao, Z.; Ma, C.; Chen, N.; Wang, B. The effects of medication education and behavioral intervention on Chinese patients with epilepsy. Epilepsy Behav. 2014, 37, 157–164. [Google Scholar] [CrossRef]
  69. Davis, K.L.; Candrilli, S.D.; Edin, H.M. Prevalence and cost of nonadherence with antiepileptic drugs in an adult managed care population. Epilepsia 2008, 49, 446–454. [Google Scholar] [CrossRef]
  70. Schüz, B.; Wurm, S.; Ziegelmann, J.P.; Warner, L.M.; Tesch-Römer, C.; Schwarzer, R. Changes in functional health, changes in medication beliefs, and medication adherence. Health Psychol. 2011, 30, 31–39. [Google Scholar] [CrossRef]
  71. Haynes, R.; McDonald, H.; Garg, A.; Montague, P. Interventions for helping patients to follow prescriptions for medications. Cochrane Database Syst. Rev. 2002, 2, 1–50. [Google Scholar]
  72. Hauser, W.A.; Annegers, J.F.; Kurland, L.T. Incidence of epilepsy and unprovoked seizures in Rochester, Minnesota: 1935–1984. Epilepsia 1993, 34, 453–468. [Google Scholar] [CrossRef]
  73. Keränen, T.; Sillanpää, M.; Riekkinen, P.J. Distribution of seizure types in an epileptic population. Epilepsia 1988, 29, 1–7. [Google Scholar] [CrossRef]
Figure 1. Flow diagram of selection.
Figure 1. Flow diagram of selection.
Jcm 11 04308 g001
Table 1. Overview of selected study designs and methods of measuring adherence.
Table 1. Overview of selected study designs and methods of measuring adherence.
n%
Study designObservational studyNot specified25.6
Cross-sectional2466.7
Longitudinal12.8
Retrospective12.8
Community-based12.8
Not specified719.4
n%
Adherence measurement methodMMAS-4822.2
MMAS-8822.2
MARS-1025.6
Morisky–Green Test25.6
Self-designed questionnaires925.0
Others719.6
Additional adherence assessmentBMQ616.7
BAQ12.8
Pill count12.8
No secondary assessment2877.8
n%
Statistical methodMultivariate2364.3
Group1027.8
Correlation25.6
Not specified12.8
MMAS, Morisky Medication Adherence Score; MARS, Medication Adherence Rating Scale; BMQ, Beliefs about Medicines Questionnaire; BAQ, Baseline Adherence Questionnaire.
Table 2. Overview of general and demographic data.
Table 2. Overview of general and demographic data.
StudiesMinMaxMeanSD
Year of publication3619972022
Number of participants36551182310.6282.2
Proportion of male participants3231.573.951.110.0
Age2920.973.937.311.3
Epilepsy typeTemporal lobe11001001000
Focal1512.088.951.924.1
Generalized1711.191.446.021.2
Distribution of nonadherence
(as % of participants)
2820.795.448.020.7
SD, standard deviation.
Table 3. Overview of the distribution of epilepsy by country.
Table 3. Overview of the distribution of epilepsy by country.
n%
China513.9
USA513.9
Ethiopia411.1
India411.1
Malaysia38.3
UK38.3
Iran25.6
Brazil12.8
Honduras12.8
Ireland12.8
Japan12.8
Kenya12.8
Lebanon12.8
Norway12.8
Sudan12.8
Turkey12.8
United Arab Emirates12.8
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mendorf, S.; Prell, T.; Schönenberg, A. Detecting Reasons for Nonadherence to Medication in Adults with Epilepsy: A Review of Self-Report Measures and Key Predictors. J. Clin. Med. 2022, 11, 4308. https://doi.org/10.3390/jcm11154308

AMA Style

Mendorf S, Prell T, Schönenberg A. Detecting Reasons for Nonadherence to Medication in Adults with Epilepsy: A Review of Self-Report Measures and Key Predictors. Journal of Clinical Medicine. 2022; 11(15):4308. https://doi.org/10.3390/jcm11154308

Chicago/Turabian Style

Mendorf, Sarah, Tino Prell, and Aline Schönenberg. 2022. "Detecting Reasons for Nonadherence to Medication in Adults with Epilepsy: A Review of Self-Report Measures and Key Predictors" Journal of Clinical Medicine 11, no. 15: 4308. https://doi.org/10.3390/jcm11154308

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop