Next Article in Journal
Negative Pressure Wound Therapy with Instillation: Analysis of the Rinsing Fluid as a Monitoring Tool and Approach to the Inflammatory Process: A Pilot Study
Previous Article in Journal
Risk Factors for Early Mortality in Older Patients with Traumatic Cervical Spine Injuries—A Multicenter Retrospective Study of 1512 Cases
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) International Validations

Department of Psychology, Royal Holloway, University of London, Egham, Surrey TW20 0EX, UK
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(2), 703; https://doi.org/10.3390/jcm12020703
Submission received: 18 December 2022 / Revised: 3 January 2023 / Accepted: 9 January 2023 / Published: 16 January 2023
(This article belongs to the Section Clinical Neurology)

Abstract

:
Cognitive impairment is a prevalent and debilitating symptom of multiple sclerosis (MS) but is not routinely addressed in clinical care. The Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) was developed in 2012 to screen and monitor MS patients’ cognition. This systematic review and meta-analysis aimed to identify, synthesise, and critically appraise current BICAMS’ international validations. The literature search was conducted using PubMed, PsycINFO and Web of Science electronic databases in August 2022. Quantitative, peer-reviewed adult studies, which followed the BICAMS international validation protocol and were published in English, were included. The search identified a total of 203 studies, of which 26 were eligible for inclusion. These reported a total of 2833 adults with MS and 2382 healthy controls (HC). The meta-analysis showed that BICAMS identified impaired cognitive functioning in adults with MS compared to HC for all three subtests: information processing speed (g = 0.854, 95% CI = 0.765, 0.944, p < 0.001), immediate verbal recall (g = 0.566, 95% CI = 0.459, 0.673, p < 0.001) and immediate visual recall (g = 0.566, 95% CI = 0.487, 0.645, p < 0.001). Recruitment sites and strategies limit the generalisability of results. BICAMS is a valid and feasible international MS cognitive assessment.

1. Introduction

Cognition is a significant component of most neurodegenerative conditions and yet systematic, internationally valid measurement remains elusive for most. Early recognition of cognitive impairment allows for diagnosis and appropriate treatment, education, psychosocial support and engagement in shared decision-making regarding life planning, health care, involvement in research and financial matters [1]. It has been hard to meet the challenge of psychometrically sound, clinically feasible assessments, with some exceptions [2]. There is increasing recognition that the stimuli should not disadvantage any particular cultures [3]. Harmonisation of data across different national and ethnic communities needs careful consideration of cultural and linguistic variables [4]. The increasingly diverse populations within individual countries require health services to be agile and inclusive [5]. Important steps to advance cognitive measurement technology are global collaboration and a consensus, credible international validation protocol.
Multiple sclerosis (MS) is a chronic autoimmune-mediated disease of the central nervous system, involving inflammatory and degenerative processes [6]. This can produce a constellation of symptoms in the physical, psychiatric and cognitive domains. MS affects over 2.8 million people worldwide [7] and is typically diagnosed in adults aged 20 to 30 years [8]. Cognitive impairment is a prevalent and debilitating symptom of MS, affecting between 40–65% of patients [9]. It can be observed in all subtypes (Relapsing Remitting Multiple Sclerosis, RRMS; Secondary Progressive Multiple Sclerosis, SPMS; Primary Progressive Multiple Sclerosis, PPMS [10]), but severe cognitive impairment predominates in the progressive forms of the disease [11]. There are often marked deficits in information processing speed, attention, working memory and executive functioning [9]. It has a negative impact on quality of life [9], including activities of daily living [12], employment [13], disease management [14,15], personality [16] and driving safety [17]. Given the significant adverse consequences of cognitive difficulties, early identification of cognitive status is needed to facilitate optimal management and preserve quality of life in people with MS (PwMS [18]).
Cognitive impairment remains a neglected and under-diagnosed symptom of MS. The “invisibility” of cognitive difficulties has meant they are often overlooked by family members, colleagues and healthcare professionals since there is no obvious external disability [19]. At routine consultation, neurologists are poor at identifying MS-related cognitive impairment [20]. There is a growing consensus, across MS patients and professionals, that routine cognitive testing should form part of clinical practice to inform management [21]. Despite this, objective cognitive testing is rarely delivered [22,23]. Both the National Institute for Health and Care Excellence (NICE [24]) and the American Academy of Neurology (AAN [25]) recommend an annual cognitive assessment for MS. Regularly monitoring cognition in MS patients can facilitate appropriate management as well as targeted specialist referrals for follow-up expert cognitive assessment and management [26,27]. Once cognitive impairment is identified, healthcare professionals can modify their interaction style with patients and monitor increased risks associated with cognitive impairment such as driving accidents, risk of falls, unemployment and poor disease management [18].
In 2012, an international consensus committee of 12 European and American MS experts convened to develop a review process to select scales that could be combined to produce a feasible, valid and international MS cognitive assessment. The committee examined the available cognition scales from the literature, as well as their psychometric qualities and clinical applicability. This approach took account of both the psychometric standards (reliability, validity and sensitivity) and the pragmatic standards (international applicability, ease of administration, patient acceptability and contextual feasibility). The committee agreed that the assessment tool should assess information processing speed, verbal memory and visual memory (immediate recall) and prompted the selection of the following subtests: the Symbol Digit Modalities Test (SDMT; spoken response), the first five learning trials of the California Verbal Learning Test (CVLT-II) and the first three learning trials of the Brief Visuospatial Memory Test-Revised (BVMT-R [28]). These three subtests are reliable and sensitive to MS cognitive impairment.
The SDMT [29] is a measure of information processing speed comprising a key of single numbers, each paired with an abstract symbol. The patient is presented with rows of symbols that are arranged pseudo-randomly. They are required to say the correct number for each of the symbols as fast and as accurately as they can in 90 s, using the key provided. The SDMT shows high sensitivity for MS-related cognitive dysfunction and is now widely acknowledged as the gold standard for a quick cognitive screening [30].
In the CVLT-II [31], a measure of verbal memory, only the first five learning trials are administered. The patient is read a 16-item word list at a slightly slower rate than one item per second. The list is read aloud five times, and the patient is instructed to recall as many of the items as possible, in any order, across the five learning trials.
In the BVMT-R [32], a measure of visual memory, only the first three learning trials are administered. This test involves presenting to patients a 2 × 3 stimulus array of abstract geometric figures across three learning trials, each 10 s in length. The array is then removed from the patient’s view, and they are instructed to draw the geometric figures in the correct position from memory.
The Brief Cognitive Assessment for Multiple Sclerosis (BICAMS [28]) has been recommended as a 15 min international measure to routinely screen and monitor cognition in MS patients. It was designed for healthcare professionals who may not have specific training in cognitive assessments, allowing more clinics to address cognition. This brief assessment tool does not require any special equipment beyond a pen, paper and stopwatch and therefore allows cognition to be tested inexpensively. BICAMS can be easily implemented into routine clinical practice across centres and countries internationally [28]. The committee have also published an international validation protocol to guide national validation studies [33].
BICAMS has been validated in 26 countries to date, including Argentina, Belgium, Turkey and Japan (e.g., [34]). These national studies have investigated the validity and reliability of BICAMS in different cultures and language groups and its sensitivity to cognitive impairment in comparison with the “gold-standard” batteries. The AAN has recommended BICAMS in their quality measurement sets for MS in 2014 and 2020. The Canadian Guidelines for MS Treatment endorsed BICAMS in 2020 [35], and over 20 peer review papers in international clinical neurology journals have also recommended BICAMS for routine cognitive assessment in MS clinics (e.g., [36]).
BICAMS has been adopted by the international MS community. For example, the Arabic version of BICAMS represents the most used cognitive battery for assessing MS cognition in the Arab world [37]. It has an international reach, with 11,000 patients routinely assessed every year. There has been a systematic review of the first 16 national validation studies on BICAMS [34]. However, there have since been additional national validation studies, warranting an updated systematic review of the validation literature and international findings. The aim of the present systematic review and meta-analysis was to identify, synthesise and critically evaluate current literature on the progress of BICAMS in meeting the objectives of global collaboration and a credible international validation protocol.

2. Methods

2.1. Search Strategy

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement was followed as a guide for the standardised conduct and reporting of the current systematic review and meta-analysis [38]. Studies were identified using 3 databases—PubMed, PsycINFO and Web of Science. Boolean search terms were developed and used to identify studies examining the validity of BICAMS in August 2022 (Table 1). Search terms were informed by initial searches and developed further during the process of the review to ensure all relevant articles were identified.

2.2. Selection Criteria

The inclusion criteria were: (a) studies that followed the international validation BICAMS protocol, (b) quantitative studies, (c) peer-reviewed studies with no date restriction that are written in the English language and (d) samples including adults with any clinical subtypes of MS and Clinically Isolated Syndrome (CIS), the MS precursor stage.
The additional criteria for inclusion in the meta-analysis were as follows: (a) studies including an HC comparison group and (b) studies reporting standard quantitative information based on the SDMT, CVLT-II and BVMT-R subscales (mean, standard deviation and sample size) or appropriate substitute scales of the MS and/or CIS and HC comparison groups.

2.3. Quality Assessment

One reviewer (HP) extracted data from the studies directly into tables made specifically for the current review, and this was examined and verified by a second reviewer (DL). Two reviewers independently assessed the quality of the retrieved articles using the Effective Public Health Practice Project (EPHPP), and any disagreements were discussed and resolved. A final quality rating was derived from the individual ratings of the categories.

2.4. Statistical Analysis

The meta-analysis was conducted using the Comprehensive Meta-Analysis (CMA; Version 3) software [39]. Three individual analyses were performed based on the average scores of the SDMT, CVLT-II and BVMT-R subtests for both groups (MS and HC). Effect sizes were calculated as standardised mean differences with Hedges g using the following interpretation: 0.2 = small; 0.5 = medium; 0.8 = large [40].
The meta-analysis employed a random-effects model because it estimates the mean of a distribution of effects as opposed to one true effect [41,42], and the number of studies are large enough i.e., more than 5 studies. Heterogeneity was assessed using the Cochran’s Q test, and the magnitude of heterogeneity was evaluated using the I2 statistic. The I2 statistic assesses the percentage of variation across studies that are due to heterogeneity rather than chance and can be interpreted as a small (25%), moderate (50%) or high (75%) level of heterogeneity [43].
Forest plots were created for each subtest to visually summarise the amount of heterogeneity as well as the estimated effect sizes (Hedges g) and 95% CIs. Funnel plots were also generated as a graphical tool for investigating publication bias and other bias (assessed by the Egger’s test), which, if found, may lead to funnel plot asymmetry [44]. If asymmetry was shown, the Duval and Tweedie trim and fill analysis would model the data as if it were symmetrically distributed by adjusting for missing studies [45].

3. Results

3.1. Search Results

Using the pre-specified eligibility criteria, 55 results were generated from PubMed, 24 from PsycINFO and 124 from Web of Science. First, 132 duplicate studies across databases were removed (Figure 1). To assess for eligibility, all titles and abstracts were initially screened independently by two reviewers (HP and DL). The 30 full-text articles were re-evaluated to determine their final inclusion or exclusion. Following this, four studies were removed from the final review according to the inclusion criteria. A total of 26 studies met the criteria for final inclusion in the systematic review.
All 26 studies met the criteria for the meta-analysis from those included in the systematic review. All relevant data for the current review and meta-analysis were obtained from numerical information in texts, tables, figures and statistical analysis.

3.2. Study Characteristics and Sample Demographics

Data on study characteristics, sample demographics and patient disease information are shown in Table 2. The 26 validation studies were published between the years 2012 and 2022.
Adults with MS were recruited from a variety of settings including medical centres, university hospitals, specialist clinics and tertiary referral centres. HC were either recruited from the community, an established normative sample or among relatives, friends or carers of PwMS. The studies included a total of 2833 adults with MS and 2382 healthy controls. Sample size of both groups differed greatly between studies; in PwMS, the samples ranged from 40 to 500 participants, whilst for HC, this ranged from 20 to 276. Age of PwMS ranged from 20–61 years with an average age of 39.9, whilst the age of HC ranged from 22–51 years, with a similar average age of 38.9. The percentage of females in the MS and HC sample disproportionately favoured females and ranged from 47–82% in the MS sample and 33–86% in the HC. Eight studies used the same number of males and females. Years of education averaged 14.13 years in the MS sample and 14.58 years in HC. Higher rates of employment were seen in the HC in comparison to the MS samples (39–98% compared to 20–89%, respectively).

3.3. Patient Disease Information

Six studies recruited an exclusively RRMS sample, whilst the remaining studies also included a mixture of other phenotypes (e.g., SPMS or PPMS). RRMS was the most represented phenotype (33–100%), followed by SPMS (0–38%). Three studies included participants with CIS in their sample. The revised McDonald criteria for MS was the most used diagnostic criterion [72]. The average disease duration was 9.16 years and ranged from 1.08 to 14.67 years. The average Expanded Disability Status Scale (EDSS [73]) score was 2.75, indicating that, on average, the participants were in the mild disability range and could walk unaided.
Few studies calculated sensitivity and specificity data (Table 3), and it is noteworthy that, in the large Czech Republic sample, BICAMS demonstrated the same sensitivity to cognitive impairment as the “gold-standard” Minimal Assessment of Cognitive Function in MS (MACFIMS [52]).

3.4. Correlations between BICAMS and Sample Variables

Correlations between BICAMS subtest scores and sample variables (age, disease duration, EDSS score, education, and employment) were extracted (Table 4). Correlations between age and BICAMS scores were the most frequently reported and usually significant; correlations between EDSS scores and BICAMS were occasionally reported and inconsistently significant.

3.5. Quality Ratings

The overall quality of the studies ranged from ‘moderate’ to ‘weak’ on the EPHPP template, reflecting the cross-sectional design typical of validation studies. No studies were removed from this review following the quality assessment.

3.6. Meta-Analysis of BICAMS Validation Studies

Data on the standard quantitative information based on the subtests of the SDMT, CVLT-II and BVMT-R of the MS and HC groups were extracted for baseline assessments of BICAMS (Table 3). The percentage of people in both groups identified with likely cognitive impairment on at least one subtest was also extracted, along with the sensitivity and specificity of BICAMS. The results from all three subtests showed that adults with MS performed significantly worse than HC. BICAMS identified likely impaired cognition, on at least one subtest, in 25–73% in the MS sample, which was significantly higher than in HC (1–20%).
The forest plot (Figure 2) shows the effect size for each study using the SDMT. Overall, information processing speed was significantly lower in the MS sample compared to HC with a large effect size (g = 0.854, 95% CI = 0.765, 0.944, p < 0.001). There was no evidence of outliers; however, moderate heterogeneity (Q = 51.9, p = 0.001) was indicated (I2 = 51.8). There was no evidence of publication bias (Egger’s test: p > 0.05, two-tailed). The funnel plot (Figure 3) indicates that the effect sizes were symmetrical. Duval and Tweedie’s trim and fill analysis estimated that no studies were missing from the analysis.
A translated version of the CVLT-II was used in 18 validation studies. For two studies, the CVLT-II was not translated as the validation studies were conducted in English-speaking countries with existing validations [62,71]. Importantly, six of the studies used an alternative verbal memory test to substitute the conventional CVLT-II (Table 3). The average mean and standard deviation scores of these alternative tests were included in the meta-analysis. Notably, the study with the smallest effect size, with a Hedge’s g value of 0.017, used a substituted verbal memory test ([56]; Figure 4). The study with the highest effect size, with a Hedge’s g value of 1.072, used a translated version of the CVLT-II ([57]; Figure 4).
The forest plot (Figure 4) shows the effect size for each study using the CVLT-II. Overall, immediate verbal recall memory was significantly lower in the MS sample compared to HC with a medium effect size (g = 0.566, 95% CI = 0.459, 0.673, p < 0.001). There was no evidence of outliers; however, a high level of heterogeneity (Q = 77.9, p < 0.001) was indicated (I2 = 67.9). Duval and Tweedie’s trim and fill analysis estimated that three studies would need to fall to the left of the mean effect size to make the plot symmetrical (Figure 5). Assuming a random-effects model, the adjusted mean effect size remained medium (p = 0.528, 95% CI = 0.420, 0.635). There was no evidence of publication bias, as the Egger’s test remained non-significant (Egger’s test: p > 0.05, two-tailed).
The forest plot (Figure 6) shows the effect size for each study using the BVMT-R. Overall, immediate visual recall memory was significantly lower in the MS sample compared to HC with a medium effect size (g = 0.566, 95% CI = 0.487, 0.645, p < 0.001). There was no evidence of outliers; however, moderate heterogeneity (Q = 42.6, p < 0.05) was indicated (I2 = 41.4). There was no evidence of publication bias (Egger’s test: p > 0.05, two-tailed). The funnel plot (Figure 7) indicates that the effect sizes were symmetrical. Duval and Tweedie’s trim and fill analysis estimated that no studies were missing from the analysis.
Only four studies reported the sensitivity and specificity of BICAMS. Of these four studies, one reported on the sensitivity and specificity of BICAMS overall (94% and 86%, respectively), whilst the remaining three reported on the sensitivity and specificity of the individual subtests (see Table 3).

4. Discussion

4.1. Summary of Findings

The current review identified, synthesised and appraised the current literature on the international validation of BICAMS to date. A total of 26 studies were included in both the systematic review and meta-analysis. The results from the systematic review showed that BICAMS has been embraced in many countries worldwide and with a range of clinical samples, including different MS phenotypes and consequently, disease durations and severity. Most studies included a HC sample with a similar age and educational background. Although BICAMS was designed to be administered by a range of health professionals, in these validation studies, BICAMS was apparently typically completed by a neuropsychologist or psychology graduate; however, this information was not routinely reported. Finally, in most studies, the gender ratio in both samples disproportionately favoured females. It is important to consider that this female recruitment bias reflects the increased prevalence of MS in females, the female-to-male sex ratio being approximately 3:1 [8].
The meta-analysis showed that adults with MS performed significantly worse than HC on the three BICAMS subtests—information processing speed and immediate verbal and visual recall. Cognitive functioning was most impaired on the SDMT (a measure of information processing speed). These findings are in line with existing literature proposing that information processing speed is markedly reduced in MS [74] and constitutes the most common cognitive limitation in PwMS [75]. It is important to stress that BICAMS should be administered in its entirety, given that multiple aspects of daily life can be affected by cognitive impairment in addition to processing speed, e.g., visuospatial learning as assessed by the BVMT-R [76].
It is important to note that the BICAMS committee included experts from Europe and America and may lack diversity and inclusivity in development and cross-cultural appropriateness [77,78]. The CVLT-II scores were more heterogeneous compared to the other subtests, possibly reflecting the additional linguistic and cultural demands of translating the verbal recall list. Prior to BICAMS, the CVLT-II had separate word lists and validations for the UK and USA. Six BICAMS validation studies used alternative verbal memory tests available in the required language. Several validation studies [49,51] reported difficulties with translating the CVLT-II and described similar scores on the CVLT-II between the MS sample and HC. The CVLT-II is also probably the most culturally sensitive of the three subtests and required more extensive work to accomplish a valid translation of the stimuli [69]. Semantic categories for the word list were sometimes adapted to be more applicable for the population e.g., by swapping different types of sports for cooking utensils in Egypt [55].

4.2. Strengths

There are several strengths to this review. First, the search strategy was designed and validated using a combination of three databases—PubMed, PsycINFO and Web of Science—to cover a breadth of the available and relevant literature. Secondly, strict inclusion criteria were employed to ensure appropriate studies were generated. Furthermore, this review identified and synthesised international validation studies reporting objective scores of cognitive abilities in PwMS compared to matched HC in a standardised manner. This review captures the advances in validating BICAMS internationally since the previous review [34], with further validations in 12 more countries. Across the validation studies, there was a varied spread of cultures, languages and countries involved in the initiative. The countries that participated in the international validation protocol reported that BICAMS could be feasibly administered in approximately 15 min, with minimal materials, and was recommended for routine clinical cognitive assessment as a standard of MS care.

4.3. Limitations

There are also some notable limitations to the review methodology. First, English-language publication was a requirement for inclusion in the review, so it is important to recognise that this may have limited the inclusion of validation studies published in other languages. Secondly, only the terms “Multiple Sclerosis”, “MS”. “Clinically Isolated Syndrome” or “CIS” were used in the database search. This may have restricted the number of studies identified through the database search, as there are additional ways to describe MS (e.g., as an autoimmune disease). Thirdly, as part of the pre-defined criteria, only peer-reviewed studies were considered eligible for inclusion in this review, which meant that possible grey literature (e.g., thesis publications) that were not commercially published would not have been included. Fourthly, there are likely to be international disparities across studies in relation to healthcare systems, accessibility, economic status, and access to general MS support facilities [79,80]. MS healthcare in countries with developing economies may be constrained by limited access to high-efficacy disease-modifying therapies (DMTs) or diagnostic technology such as magnetic resonance imaging (MRI [81]). Developed countries have significantly higher prevalence and incidence rates of MS compared to developing countries, which may reflect better access to diagnostic facilities and subsequent earlier diagnosis and treatment [82]. These variations in access and quality of MS healthcare may have made comparisons of disease profiles, such as years since diagnosis and physical disability, less valid. Most of the studies included in this review were conducted in leading centres and university hospitals, which attract a certain sociodemographic population and, therefore, may not be entirely representative of all MS populations. Fifthly, there was a great deal of heterogeneity between studies—namely in terms of sample size, age, MS phenotypes and disease duration. RRMS was overrepresented compared to other MS phenotypes. It is possible that this may have reduced the effect size since cognitive impairment is more common and severe in the progressive forms of the disease [10,11]. With progressive forms of MS being underrepresented in this review, cognitive impairment may also have been underrepresented in the identified studies compared to the general MS population. Finally, the quality assessment tool (EPHPP) used to analyse the methodological quality of the included studies may not have been considered appropriate in this systematic review, since it is not a scale designed for cross-sectional studies. This may explain why the overall quality of the studies ranged from ‘moderate’ to ‘weak’ on the EPHPP template. In addition, the possible risk of bias was not studied.

4.4. Future Directions

The adoption of an international validation protocol and a global collaboration have served to promote BICAMS to international currency for MS cognition. This is reflected in the number of international validations published, the report of BICAMS data in 150 published studies of MS cognition and its use in many large national and international trials. This initiative could serve as a model for other conditions, improving the awareness, understanding, assessment and management of cognitive impairment. It is hoped that further research investigating the feasibility of BICAMS in clinical practice will maximise its use in routine consultation to evaluate cognitive status in MS. This systematic review also prompts future studies to investigate the sensitivity and specificity of the scale in different forms of multiple sclerosis or in groups with different degrees of disability.

5. Conclusions

BICAMS has been translated and culturally adapted in 26 countries to date. It has been shown to be a valid measure of cognitive functioning in MS at a global level. It can detect cognitive impairment in individuals with MS compared to healthy controls across a range of cultures, languages, and countries. This review sheds light on the work of the international MS community at validating BICAMS utilising an international validation protocol. This represents progress in the increasing awareness of MS cognition as well as maximising the implementation of BICAMS into routine clinical practice, to assess and instigate the appropriate management of MS cognition across different countries.

Author Contributions

All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, take responsibility for the integrity of the work and have given their approval for this version to be published. Conceptualization, H.P. and D.L.; methodology, H.P. and D.L.; software, H.P. validation, H.P. and D.L.; formal analysis, H.P.; investigation, H.P. and D.L.; resources, H.P. and D.L.; data curation, H.P. and D.L.; writing—original draft preparation, H.P.; writing—review and editing, H.P. and D.L.; visualization, H.P. and D.L.; supervision, D.L.; project administration, H.P. and D.L. All authors have read and agreed to the published version of the manuscript.

Funding

This review article received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

This article is based on previously conducted and published studies. It does not contain any studies with human participants or animals performed by any of the authors.

Data Availability Statement

All data analysed and reported in this review are included in this published article.

Conflicts of Interest

H.P. declares no conflict of interest. D.L. has received speaker bureau fees/consultancy/research grants from Merck, Novartis, BMS, Bayer, Sanofi, Roche, Biogen.

References

  1. Morley, J.E.; Morris, J.C.; Berg-Weger, M.; Borson, S.; Carpenter, B.D.; del Campo, N.; Dubois, B.; Fargo, K.; Fitten, L.J.; Flaherty, J.H.; et al. Brain health: The importance of recognizing cognitive impairment: An IAGG consensus conference. J. Am. Med. Dir. Assoc. 2015, 16, 731–739. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Nyenhuis, D.L.; Reckow, J. Office- and bedside-based screening for cognitive impairment and the Dementias. Clin. Geriatr. Med. 2023, 39, 15–25. [Google Scholar] [CrossRef] [PubMed]
  3. Franzen, S.; Watermeyer, T.J.; Pomati, S.; Papma, J.M.; Nielsen, T.R.; Narme, P.; Mukadam, N.; Lozano-Ruiz, Á.; Ibanez-Casas, I.; Goudsmit, M.; et al. Cross-cultural neuropsychological assessment in Europe: Position statement of the European consortium on Cross-Cultural Neuropsychology (eccron). Clin. Neuropsychol. 2022, 36, 546–557. [Google Scholar] [CrossRef]
  4. Merkley, T.L.; Esopenko, C.; Zizak, V.S.; Bilder, R.M.; Strutt, A.M.; Tate, D.F.; Irimia, A. Challenges and opportunities for harmonization of cross-cultural neuropsychological data. Neuropsychology 2022. [Google Scholar] [CrossRef]
  5. Nielsen, T.R. Cognitive assessment in culturally, linguistically, and educationally diverse older populations in Europe. Am. J. Alzheimer’s Dis. Other Dement. 2022, 37, 153331752211170. [Google Scholar] [CrossRef] [PubMed]
  6. Dobson, R.; Giovannoni, G. Multiple sclerosis—A review. Eur. J. Neurol. 2018, 26, 27–40. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Walton, C.; King, R.; Rechtman, L.; Kaye, W.; Leray, E.; Marrie, R.; Robertson, N.; La Rocca, N.; Uitdehaag, B.; van der Mei, I.; et al. Rising prevalence of multiple sclerosis worldwide: Insights from the Atlas of MS, third edition. Mult. Scler. J. 2020, 26, 1816–1821. [Google Scholar] [CrossRef]
  8. McGinley, M.; Goldschmidt, C.; Rae-Grant, A. Diagnosis and Treatment of Multiple Sclerosis. JAMA 2021, 325, 765. [Google Scholar] [CrossRef]
  9. Benedict, R.; Amato, M.; DeLuca, J.; Geurts, J. Cognitive impairment in multiple sclerosis: Clinical management, MRI, and therapeutic avenues. Lancet Neurol. 2020, 19, 860–871. [Google Scholar] [CrossRef]
  10. Brochet, B.; Ruet, A. Cognitive Impairment in Multiple Sclerosis With Regards to Disease Duration and Clinical Phenotypes. Front. Neurol. 2019, 10, 261. [Google Scholar] [CrossRef]
  11. Ruano, L.; Portaccio, E.; Goretti, B.; Niccolai, C.; Severo, M.; Patti, F.; Cilia, S.; Gallo, P.; Grossi, P.; Ghezzi, A.; et al. Age and disability drive cognitive impairment in multiple sclerosis across disease subtypes. Mult. Scler. J. 2016, 23, 1258–1267. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Gil-González, I.; Martín-Rodríguez, A.; Conrad, R.; Pérez-San-Gregorio, M. Quality of life in adults with multiple sclerosis: A systematic review. BMJ Open 2020, 10, e041249. [Google Scholar] [CrossRef] [PubMed]
  13. Kavaliunas, A.; Danylaitė Karrenbauer, V.; Binzer, S.; Hillert, J. Systematic review of the socioeconomic consequences in patients with multiple sclerosis with different levels of disability and cognitive function. Front. Neurol. 2022, 12, 2341. [Google Scholar] [CrossRef] [PubMed]
  14. Bruce, J.; Bruce, A.; Lynch, S.; Thelen, J.; Lim, S.; Smith, J.; Catley, D.; Reed, D.D.; Jarmolowicz, D.P. Probability discounting of treatment decisions in multiple sclerosis: Associations with disease knowledge, neuropsychiatric status, and adherence. Psychopharmacology 2018, 235, 3303–3313. [Google Scholar] [CrossRef]
  15. Gomes, K.; Ruiz, J.; Raskin, S.; Turner, A.; DelMastro, H.; Neto, L.; Gromisch, E. The Role of Cognitive Impairment on Physical Therapy Attendance and Outcomes in Multiple Sclerosis. J. Neurol. Phys. Ther. 2022, 46, 34–40. [Google Scholar] [CrossRef] [PubMed]
  16. Roy, S.; Drake, A.; Fuchs, T.; Dwyer, M.; Zivadinov, R.; Chapman, B.P.; Weinstock-Guttman, B.; Benedict, R.H.B. Longitudinal personality change associated with cognitive decline in multiple sclerosis. Mult. Scler. J. 2018, 24, 1909–1912. [Google Scholar] [CrossRef]
  17. Krasniuk, S.; Classen, S.; Morrow, S.; Alvarez, L.; He, W.; Srinivasan, S.; Monahan, M. Clinical predictors of driving simulator performance in drivers with multiple sclerosis. Mult. Scler. J. 2021, 27, 2085–2092. [Google Scholar] [CrossRef]
  18. Langdon, D.; Young, C. Fast Facts: Cognition in Multiple Sclerosis; S. Karger Publishers Ltd.: Oxford, UK, 2023. [Google Scholar]
  19. Walker, L.; Gardner, C.; Freedman, M.; MacLean, H.; Rush, C.; Bowman, M. Research-to-Practice Gaps in Multiple Sclerosis Care for Patients with Subjective Cognitive, Mental Health, and Psychosocial Concerns in a Canadian Center. Int. J. MS Care 2019, 21, 243–248. [Google Scholar] [CrossRef] [Green Version]
  20. Romero, K.; Shammi, P.; Feinstein, A. Neurologists’ accuracy in predicting cognitive impairment in multiple sclerosis. Mult. Scler. Relat. Disord. 2015, 4, 291–295. [Google Scholar] [CrossRef]
  21. Elwick, H.; Smith, L.; Mhizha-Murira, J.; Topcu, G.; Leighton, P.; Drummond, A.; Evangelou, N.; das Nair, R. Cognitive assessment in multiple sclerosis clinical care: A qualitative evaluation of stakeholder perceptions and preferences. Neuropsychol. Rehabil. 2021, 32, 1456–1474. [Google Scholar] [CrossRef]
  22. Kalb, R.; Beier, M.; Benedict, R.; Charvet, L.; Costello, K.; Feinstein, A.; Gingold, J.; Goverover, Y.; Halper, J.; Harris, C.; et al. Recommendations for cognitive screening and management in multiple sclerosis care. Mult. Scler. J. 2018, 24, 1665–1680. [Google Scholar] [CrossRef] [Green Version]
  23. Klein, O.; das Nair, R.; Ablewhite, J.; Drummond, A. Assessment and management of cognitive problems in people with multiple sclerosis: A National Survey of Clinical Practice. Int. J. Clin. Pract. 2018, 73, e13300. [Google Scholar] [CrossRef] [PubMed]
  24. National Institute for Health and Care Excellence (NICE). Multiple Sclerosis in Adults: Management (NG220); NICE: London, UK, 2022. [Google Scholar]
  25. Aan.com. 2014. Available online: https://www.aan.com/siteassets/home-page/policy-and-guidelines/quality/quality-measures/14msmeasureset_pg.pdf (accessed on 15 March 2022).
  26. Meca-Lallana, V.; Gascón-Giménez, F.; Ginestal-López, R.; Higueras, Y.; Téllez-Lara, N.; Carreres-Polo, J.; Eichau-Madueño, S.; Romero-Imbroda, J.; Vidal-Jordana, Á.; Pérez-Miralles, F. Cognitive impairment in multiple sclerosis: Diagnosis and monitoring. Neurol. Sci. 2021, 42, 5183–5193. [Google Scholar] [CrossRef]
  27. Thrue, C.; Riemenschneider, M.; Hvid, L.; Stenager, E.; Dalgas, U. Time matters: Early-phase multiple sclerosis is accompanied by considerable impairments across multiple domains. Mult. Scler. J. 2021, 27, 1477–1485. [Google Scholar] [CrossRef]
  28. Langdon, D.; Amato, M.; Boringa, J.; Brochet, B.; Foley, F.; Fredrikson, S.; Hämäläinen, P.; Hartung, H.-P.; Penner, I.K.; Reder, A.T.; et al. Recommendations for a Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS). Mult. Scler. J. 2012, 18, 891–898. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Smith, A. Symbol Digit Modalities Test (SDMT) Manual (revised); Western Psychological Services: Los Angeles, CA, USA, 1982. [Google Scholar]
  30. Portaccio, E.; Amato, M.P. Cognitive impairment in multiple sclerosis: An update on assessment and Management. NeuroSci 2022, 3, 667–676. [Google Scholar] [CrossRef]
  31. Delis, D.C.; Kramer, J.H.; Kaplan, E.; Ober, B.A. California Verbal Learning Test, 2nd ed.; Psychological Corporation: San Antonio, TX, USA, 2000. [Google Scholar]
  32. Benedict, R. The Brief Visuospatial Memory Test Revised (BVMT-R); Psychosocial Assessment Resources Inc.: Lutz, FL, USA, 1997. [Google Scholar]
  33. Benedict, R.; Amato, M.; Boringa, J.; Brochet, B.; Foley, F.; Fredrikson, S.; Hamalainen, P.; Hartung, H.; Krupp, L.; Penner, I.; et al. Brief International Cognitive Assessment for MS (BICAMS): International standards for validation. BMC Neurol. 2012, 12, 55. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Corfield, F.; Langdon, D. A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS). Neurol. Ther. 2018, 7, 287–306. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Freedman, M.; Devonshire, V.; Duquette, P.; Giacomini, P.; Giuliani, F.; Levin, M.; Montalban, X.; Morrow, S.A.; Oh, J.; Rotstein, D.; et al. Treatment Optimization in Multiple Sclerosis: Canadian MS Working Group Recommendations. Can. J. Neurol. Sci. J. Can. Des Sci. Neurol. 2020, 47, 437–455. [Google Scholar] [CrossRef]
  36. Artemiadis, A.; Bakirtzis, C.; Chatzittofis, A.; Christodoulides, C.; Nikolaou, G.; Boziki, M.; Grigoriadis, N. Brief international cognitive assessment for multiple sclerosis (BICAMS) cut-off scores for detecting cognitive impairment in multiple sclerosis. Mult. Scler. Relat. Disord. 2021, 49, 102751. [Google Scholar] [CrossRef]
  37. Paul, S.; Brown, A.; Hughes, A. Cognitive Assessment of Individuals with Multiple Sclerosis in the Arab World: A Systematic Review. Neuropsychol. Rev. 2019, 29, 259–269. [Google Scholar] [CrossRef] [PubMed]
  38. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; Group, T.P. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009, 6, 264–269. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Borenstein, M.; Hedges, L.; Higgins, J.; Rothstein, H. Comprehensive Meta-Analysis Version 3; Biostat: Englewood, NJ, USA, 2005. [Google Scholar]
  40. Cohen, J. Statistical Power Analysis for the Behavioural Sciences, 2nd ed.; Lawrence Erlbaum Associates: Hillside, NJ, USA, 1988. [Google Scholar]
  41. Borenstein, M.; Hedges, L.V.; Higgins, J.P.; Rothstein, H.R. Fixed-effect versus random-effects models. Introduction to meta-analysis. Introd. Meta-Anal. 2009, 77, 86. [Google Scholar] [CrossRef]
  42. Riley, R.D.; Higgins, J.P.T.; Deeks, J.J. Interpretation of random effects meta-analyses. BMJ 2011, 342, d549. [Google Scholar] [CrossRef] [Green Version]
  43. Higgins, J. Measuring inconsistency in meta-analyses. BMJ 2003, 327, 557–560. [Google Scholar] [CrossRef] [Green Version]
  44. Sterne, J.; Harbord, R. Funnel Plots in Meta-analysis. Stata J. Promot. Commun. Stat. Stata 2004, 4, 127–141. [Google Scholar] [CrossRef] [Green Version]
  45. Duval, S.; Tweedie, R. Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis. Biometrics 2000, 56, 455–463. [Google Scholar] [CrossRef]
  46. Alarcón, A.N.; Ayala, O.D.; García, J.R.; Montañés, P. Validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) in a Colombian population. Mult. Scler. Relat. Disord. 2020, 42, 102072. [Google Scholar] [CrossRef]
  47. Betscher, E.; Guenter, W.; Langdon, D.W.; Bonek, R. Polish validation of the Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS Battery): Correlation of cognitive impairment with mood disorders and fatigue. Neurol. Neurochir. Pol. 2021, 55, 59–66. [Google Scholar] [CrossRef]
  48. Botchorishvili, N.; Shiukashvili, N.; Mikeladze, N.; Dzagnidze, A.; Miqava, N.; Tighashvili, M.; Janelidze, M. Validity and reliability of the Georgian-language brief international cognitive assessment for multiple sclerosis (BICAMS)&NBSP. BMC Neurol. 2021, 21, 218. [Google Scholar] [CrossRef]
  49. Costers, L.; Gielen, J.; Eelen, P.L.; Schependom, J.V.; Laton, J.; Remoortel, A.V.; Vanzeir, E.; Wijmeersch, B.V.; Seeldrayers, P.; Haelewyck, M.-C.; et al. Does including the full CVLT-II and BVMT-R improve BICAMS? evidence from a Belgian (dutch) validation study. Mult. Scler. Relat. Disord. 2017, 18, 33–40. [Google Scholar] [CrossRef] [Green Version]
  50. Darwish, H.; Zeinoun, P.; Farran, N.; Ghusn, H.; Yamout, B.; Khoury, S.J. The Brief International Cognitive Assessment in multiple sclerosis (BICAMS): Validation in Arabic and Lebanese normative values. J. Int. Neuropsychol. Soc. 2022, 28, 94–103. [Google Scholar] [CrossRef] [PubMed]
  51. Drulović, J.; Tončev, G.; Nadj, Č.; Obradović, D.; Eraković, J.; Mesaroš, Š.; Čukić, M.; Aleksić, D.; Andabaka, M.; Ivanović, J.; et al. Validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) in a large cohort of relapsing-remitting MS patients. Acta Clin. Croat. 2022, 61, 62–68. [Google Scholar] [CrossRef] [PubMed]
  52. Dusankova, J.B.; Kalincik, T.; Havrdova, E.; Benedict, R.H. Cross cultural validation of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS) and the Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS). Clin. Neuropsychol. 2012, 26, 1186–1200. [Google Scholar] [CrossRef] [PubMed]
  53. Estiasari, R.; Fajrina, Y.; Lastri, D.N.; Melani, S.; Maharani, K.; Imran, D.; Pangeran, D.; Sitorus, F. Validity and reliability of Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS) in Indonesia and the correlation with quality of life. Neurol. Res. Int. 2019, 2019, 1–7. [Google Scholar] [CrossRef] [Green Version]
  54. Evdoshenko, E.; Laskova, K.; Shumilina, M.; Nekrashevich, E.; Andreeva, M.; Neofidov, N.; Kalinin, I.; Nikitchenko, D.; Rogozina, A.; Kupaeva, A.; et al. Validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) in the Russian population. J. Int. Neuropsychol. Soc. 2021, 28, 503–510. [Google Scholar] [CrossRef]
  55. Farghaly, M.; Langdon, D.W.; Shalaby, N.M.; Shehata, H.S.; Abokrysha, N.T.; Hassan, A.; Hegazy, M.I.; Elmazny, A.; Ahmed, S.; Shaheen, S.; et al. Reliability and validity of Arabic version of the Brief International Cognitive Assessment For Multiple Sclerosis: Egyptian dialect. Egypt. J. Neurol. Psychiatry Neurosurg. 2021, 57, 51. [Google Scholar] [CrossRef]
  56. Filser, M.; Schreiber, H.; Pöttgen, J.; Ullrich, S.; Lang, M.; Penner, I.K. The Brief International Cognitive Assessment in multiple sclerosis (BICAMS): Results from the German Validation Study. J. Neurol. 2018, 265, 2587–2593. [Google Scholar] [CrossRef]
  57. Giedraitienė, N.; Kizlaitienė, R.; Kaubrys, G. The bicams battery for assessment of Lithuanian-speaking multiple sclerosis patients: Relationship with age, Education, disease disability, and duration. Med. Sci. Monit. 2015, 21, 3853–3859. [Google Scholar] [CrossRef]
  58. Hämäläinen, P.; Leo, V.; Therman, S.; Ruutiainen, J. Validation of the Finnish version of the Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS) and evaluation of the applicability of the Multiple Sclerosis Neuropsychological Questionnaire (MSNQ) and the fatigue scale for motor and cognitive functions (FSMC). Brain Behav. 2021, 11, e02087. [Google Scholar] [CrossRef]
  59. Marstrand, L.; Østerberg, O.; Walsted, T.; Skov, A.C.; Schreiber, K.I.; Sellebjerg, F. Brief international cognitive assessment for multiple sclerosis (BICAMS): A Danish validation study of sensitivity in early stages of ms. Mult. Scler. Relat. Disord. 2020, 37, 101458. [Google Scholar] [CrossRef]
  60. Maubeuge, N.; Deloire MS, A.; Brochet, B.; Ehrlé, N.; Charré-Morin, J.; Saubusse, A.; Ruet, A. French validation of the Brief International Cognitive Assessment For Multiple Sclerosis. Rev. Neurol. 2021, 177, 73–79. [Google Scholar] [CrossRef] [PubMed]
  61. Niino, M.; Fukazawa, T.; Kira, J.-I.; Okuno, T.; Mori, M.; Sanjo, N.; Ohashi, T.; Fukaura, H.; Fujimori, J.; Shimizu, Y.; et al. Validation of the brief international cognitive assessment for multiple sclerosis in Japan. Mult. Scler. J.-Exp. Transl. Clin. 2017, 3, 205521731774897. [Google Scholar] [CrossRef]
  62. Ozakbas, S.; Yigit, P.; Cinar, B.P.; Limoncu, H.; Kahraman, T.; Kösehasanoğulları, G. The Turkish validation of the Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS) battery. BMC Neurol. 2017, 17, 208. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. O’Connell, K.; Langdon, D.; Tubridy, N.; Hutchinson, M.; McGuigan, C. A preliminary validation of the Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS) tool in an Irish population with multiple sclerosis (MS). Mult. Scler. Relat. Disord. 2015, 4, 521–525. [Google Scholar] [CrossRef] [PubMed]
  64. Polychroniadou, E.; Bakirtzis, C.; Langdon, D.; Lagoudaki, R.; Kesidou, E.; Theotokis, P.; Tsalikakis, D.; Poulatsidou, K.; Kyriazis, O.; Boziki, M.; et al. Validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) in Greek population with multiple sclerosis. Mult. Scler. Relat. Disord. 2016, 9, 68–72. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Sandi, D.; Rudisch, T.; Füvesi, J.; Fricska-Nagy, Z.; Huszka, H.; Biernacki, T.; Langdon, D.W.; Langane, É.; Vécsei, L.; Bencsik, K. The Hungarian validation of the Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS) Battery and the correlation of cognitive impairment with fatigue and quality of life. Mult. Scler. Relat. Disord. 2015, 4, 499–504. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Skorve, E.; Lundervold, A.J.; Torkildsen, Ø.; Myhr, K.-M. The Norwegian translation of the Brief International Cognitive Assessment For Multiple Sclerosis (BICAMS). Mult. Scler. Relat. Disord. 2019, 36, 101408. [Google Scholar] [CrossRef] [PubMed]
  67. Souissi, A.; Mrabet, S.; Ferchichi, W.; Gharbi, A.; Nasri, A.; Djebara, M.B.; Kacem, I.; Gouider, R. Tunisian version of the Brief International Cognitive Assessment For Multiple Sclerosis: Validation and normative values. Mult. Scler. Relat. Disord. 2022, 58, 103444. [Google Scholar] [CrossRef]
  68. Sousa, C.; Rigueiro-Neves, M.; Miranda, T.; Alegria, P.; Vale, J.; Passos, A.M.; Langdon, D.; Sá, M. Validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) in the Portuguese population with multiple sclerosis. BMC Neurol. 2018, 18, 172. [Google Scholar] [CrossRef]
  69. Spedo, C.T.; Frndak, S.E.; Marques, V.D.; Foss, M.P.; Pereira, D.A.; Carvalho L de Guerreiro, C.T.; Conde, R.M.; Fusco, T.; Pereira, A.J.; Gaino, S.B.; et al. Cross-cultural adaptation, reliability, and validity of the BICAMS in Brazil. Clin. Neuropsychol. 2015, 29, 836–846. [Google Scholar] [CrossRef]
  70. Vanotti, S.; Smerbeck, A.; Benedict, R.H.; Caceres, F. A new assessment tool for patients with multiple sclerosis from Spanish-speaking countries: Validation of the brief international cognitive assessment for MS (BICAMS) in Argentina. Clin. Neuropsychol. 2016, 30, 1023–1031. [Google Scholar] [CrossRef] [PubMed]
  71. Walker LA, S.; Osman, L.; Berard, J.A.; Rees, L.M.; Freedman, M.S.; MacLean, H.; Cousineau, D. Brief international cognitive assessment for multiple sclerosis (BICAMS): Canadian contribution to the International Validation Project. J. Neurol. Sci. 2016, 362, 147–152. [Google Scholar] [CrossRef] [PubMed]
  72. Thompson, A.J.; Banwell, B.L.; Barkhof, F.; Carroll, W.M.; Coetzee, T.; Comi, G.; Correale, J.; Fazekas, F.; Filippi, M.; Freedman, M.S.; et al. Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. Lancet. Neurol. 2018, 17, 162–173. [Google Scholar] [CrossRef]
  73. Kurtzke, J. Rating neurologic impairment in multiple sclerosis: An expanded disability status scale (EDSS). Neurology 1983, 33, 1444. [Google Scholar] [CrossRef] [Green Version]
  74. Costa, S.; Genova, H.; DeLuca, J.; Chiaravalloti, N. Information processing speed in multiple sclerosis: Past, present, and future. Mult. Scler. J. 2017, 23, 772–789. [Google Scholar] [CrossRef] [PubMed]
  75. Chiaravalloti, N.; DeLuca, J. Cognitive impairment in multiple sclerosis. Lancet Neurol. 2008, 7, 1139–1151. [Google Scholar] [CrossRef]
  76. Chiaravalloti, N.D.; DeLuca, J.; Salter, A.; Amato, M.P.; Brichetto, G.; Chataway, J.; Dalgas, U.; Farrell, R.; Feys, P.; Filippi, M.; et al. The relationship between processing speed and verbal and non-verbal new learning and memory in Progressive Multiple Sclerosis. Mult. Scler. J. 2022, 28, 1783–1792. [Google Scholar] [CrossRef]
  77. Sousa, V.D.; Rojjanasrirat, W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. J. Eval. Clin. Pract. 2011, 17, 268–274. [Google Scholar] [CrossRef]
  78. Al-Jawahiri, F.; Nielsen, T.R. Effects of acculturation on the Cross-Cultural Neuropsychological Test Battery (CNTB) in a culturally and linguistically diverse population in Denmark. Arch. Clin. Neuropsychol. 2020, 36, 381–393. [Google Scholar] [CrossRef]
  79. Reilly, G.; Mahkawnghta, A.; Jelinek, P.; De Livera, A.; Weiland, T.; Brown, C.; Taylor, K.L.; Neate, S.L.; Jelinek, G.A.; Marck, C.H. International Differences in Multiple Sclerosis Health Outcomes and Associated Factors in a Cross-sectional Survey. Front. Neurol. 2017, 8, 229. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  80. Dobson, R.; Rice, D.R.; D’hooghe, M.; Horne, R.; Learmonth, Y.; Mateen, F.J.; Marck, C.H.; Reyes, S.; Williams, M.J.; Giovannoni, G.; et al. Social Determinants of Health in multiple sclerosis. Nat. Rev. Neurol. 2022, 18, 723–734. [Google Scholar] [CrossRef] [PubMed]
  81. Rivera, V. Multiple Sclerosis: A Global Concern with Multiple Challenges in an Era of Advanced Therapeutic Complex Molecules and Biological Medicines. Biomedicines 2018, 6, 112. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  82. Moghaddam, V.; Dickerson, A.; Bazrafshan, E.; Seyedhasani, S.; Najafi, F.; Hadei, M.; Momeni, J.; Moradi, G.; Sarmadi, M. Socioeconomic determinants of global distribution of multiple sclerosis: An ecological investigation based on Global Burden of Disease data. BMC Neurol. 2021, 21, 145. [Google Scholar] [CrossRef]
Figure 1. PRISMA flowchart for selection process of studies in systematic review and meta-analysis.
Figure 1. PRISMA flowchart for selection process of studies in systematic review and meta-analysis.
Jcm 12 00703 g001
Figure 2. Forest plot for SDMT. Alarcón et al. [46]; Betscher et al. [47]; Botchorishvili et al. [48]; Costers et al. [49]; Darwish et al. [50]; Drulović et al. [51]; Dusankova et al. [52]; Estiasari et al. [53]; Evdoshenko et al. [54]; Farghaly et al. [55]; Filser et al. [56]; Giedraitienė et al. [57]; Hämäläinen et al. [58]; Marstrand et al. [59]; Maubeuge et al. [60]; Niino et al. [61]; O’Connell et al. [62]; Ozakbas et al. [63]; Polychroniadou et al. [64]; Sandi et al. [65]; Skorve et al. [66]; Souissi et al. [67]; Sousa et al. [68]; Spedo et al. [69]; Vanotti et al. [70]; Walker et al. [71].
Figure 2. Forest plot for SDMT. Alarcón et al. [46]; Betscher et al. [47]; Botchorishvili et al. [48]; Costers et al. [49]; Darwish et al. [50]; Drulović et al. [51]; Dusankova et al. [52]; Estiasari et al. [53]; Evdoshenko et al. [54]; Farghaly et al. [55]; Filser et al. [56]; Giedraitienė et al. [57]; Hämäläinen et al. [58]; Marstrand et al. [59]; Maubeuge et al. [60]; Niino et al. [61]; O’Connell et al. [62]; Ozakbas et al. [63]; Polychroniadou et al. [64]; Sandi et al. [65]; Skorve et al. [66]; Souissi et al. [67]; Sousa et al. [68]; Spedo et al. [69]; Vanotti et al. [70]; Walker et al. [71].
Jcm 12 00703 g002
Figure 3. Funnel plot for SDMT.
Figure 3. Funnel plot for SDMT.
Jcm 12 00703 g003
Figure 4. Forest Plot for CVLT-II. Alarcón et al. [46]; Betscher et al. [47]; Botchorishvili et al. [48]; Costers et al. [49]; Darwish et al. [50]; Drulović et al. [51]; Dusankova et al. [52]; Estiasari et al. [53]; Evdoshenko et al. [54]; Farghaly et al. [55]; Filser et al. [56]; Giedraitienė et al. [57]; Hämäläinen et al. [58]; Marstrand et al. [59]; Maubeuge et al. [60]; Niino et al. [61]; O’Connell et al. [62]; Ozakbas et al. [63]; Polychroniadou et al. [64]; Sandi et al. [65]; Skorve et al. [66]; Souissi et al. [67]; Sousa et al. [68]; Spedo et al. [69]; Vanotti et al. [70]; Walker et al. [71].
Figure 4. Forest Plot for CVLT-II. Alarcón et al. [46]; Betscher et al. [47]; Botchorishvili et al. [48]; Costers et al. [49]; Darwish et al. [50]; Drulović et al. [51]; Dusankova et al. [52]; Estiasari et al. [53]; Evdoshenko et al. [54]; Farghaly et al. [55]; Filser et al. [56]; Giedraitienė et al. [57]; Hämäläinen et al. [58]; Marstrand et al. [59]; Maubeuge et al. [60]; Niino et al. [61]; O’Connell et al. [62]; Ozakbas et al. [63]; Polychroniadou et al. [64]; Sandi et al. [65]; Skorve et al. [66]; Souissi et al. [67]; Sousa et al. [68]; Spedo et al. [69]; Vanotti et al. [70]; Walker et al. [71].
Jcm 12 00703 g004
Figure 5. Funnel plot for CVLT-II.
Figure 5. Funnel plot for CVLT-II.
Jcm 12 00703 g005
Figure 6. Forest plot for BVMT-R. Alarcón et al. [46]; Betscher et al. [47]; Botchorishvili et al. [48]; Costers et al. [49]; Darwish et al. [50]; Drulović et al. [51]; Dusankova et al. [52]; Estiasari et al. [53]; Evdoshenko et al. [54]; Farghaly et al. [55]; Filser et al. [56]; Giedraitienė et al. [57]; Hämäläinen et al. [58]; Marstrand et al. [59]; Maubeuge et al. [60]; Niino et al. [61]; O’Connell et al. [62]; Ozakbas et al. [63]; Polychroniadou et al. [64]; Sandi et al. [65]; Skorve et al. [66]; Souissi et al. [67]; Sousa et al. [68]; Spedo et al. [69]; Vanotti et al. [70]; Walker et al. [71].
Figure 6. Forest plot for BVMT-R. Alarcón et al. [46]; Betscher et al. [47]; Botchorishvili et al. [48]; Costers et al. [49]; Darwish et al. [50]; Drulović et al. [51]; Dusankova et al. [52]; Estiasari et al. [53]; Evdoshenko et al. [54]; Farghaly et al. [55]; Filser et al. [56]; Giedraitienė et al. [57]; Hämäläinen et al. [58]; Marstrand et al. [59]; Maubeuge et al. [60]; Niino et al. [61]; O’Connell et al. [62]; Ozakbas et al. [63]; Polychroniadou et al. [64]; Sandi et al. [65]; Skorve et al. [66]; Souissi et al. [67]; Sousa et al. [68]; Spedo et al. [69]; Vanotti et al. [70]; Walker et al. [71].
Jcm 12 00703 g006
Figure 7. Funnel plot for BVMT-R.
Figure 7. Funnel plot for BVMT-R.
Jcm 12 00703 g007
Table 1. Search terms for systematic review.
Table 1. Search terms for systematic review.
Search Terms
“Multiple Sclerosis” OR “MS” OR “Clinically Isolated Syndrome” OR “CIS”
AND
“Brief International Cognitive Assessment for Multiple Sclerosis” OR “BICAMS”
AND
“Validation” OR “International Validation” OR “Validity” OR “Sensitivity”
Table 2. Study characteristics and sample demographic and patient disease information.
Table 2. Study characteristics and sample demographic and patient disease information.
Study Country Number of Participants Age in Years
Mean (SD), {Median}, [Range]
Gender
(Female %)
Education in Years
Mean (SD), {Median}, [Range]
Employment (Employed %) MS Phenotype %(CIS/RR/SP/PP/PR) Disease Duration in Years
Mean (SD), {Median}, [Range]
EDSS
Mean (SD), {Median}, [Range]
Alarcón et al. [46]
 MSColumbia5041.44 (10.99)64%14.76 (2.61)Nr0/100/0/0/07.66 (5.61)1.33 (1.54)
 HC10037.75 (12.63)48%14.73 (3.57)Nr---
Betscher et al. [47]
 MSPoland61{39}74%{13}84%0/74/20/6/0RR = {5}
SP = {19.5}
PP = {7.5}
RR = {3}
SP = {4.75}
PP = {4.5}
 HC61{37}75%{13}98%---
Botchorishvili et al. [48]
 MSGeorgia6839.2 (9.9)71%14.3 (2.1)57%0/76/18/6/07.0 (5.7)3.3 (1.6)
 HC6838.5 (9.9)68%14.5 (1.9)84%---
Costers et al. [49]
 MSBelgium9745.42 (9.24)68%14.28 (1.86)Nr0/84/12/4/012.97 (7.16)3.50 (2.50)
 HC9743.52 (12.69)75%14.69 (1.61)Nr---
Darwish et al. [50]
 MSLebanon4336.06 (12.37)81.4%14.63 (3.17)48.84%0/81/14/5/08.61 (7.36)1.89 (1.7)
 HC18045.01 (19.36)60%15.13 (3)56.11%---
Drulović et al. [51]
 MSSerbia50039.9 (9.4)70.2%14.0 (2.9)Nr0/100/0/0/09.2 (6.7){2.0}
 HC6940.3 (11.5)63.77%14.1 (3.4)Nr---
Dusankova et al. [52]
 MSCzech Republic36734 (10)68%14 (3)40%0/68/26/3/38 (7)3 (1.5)
 HC13434 (9)71%14 (2.5)73%---
Estiasari et al. [53]
 MSIndonesia40{31}, [20–61]82.5%>12 yrs = 75%Nr0/78/22/0/0{4}, [0.1–15]{3}, [1–7.5]
 HC66{29}, [22–51]72.7%>12 yrs = 89.4%Nr---
Evdoshenko et al. [54]
 MSRussia9838.44 (11.47)70.4%15.12 (2.79)Nr0/86/14/0/09.5 (7.44){3.0}
 HC8638.17 (13.29)63.95%16.26 (3.02)Nr---
Farghaly et al. [55]
 MSEgypt9030.8 (6.7)77.78%14.5 (2.6)Nr0/86/12/2/06.2 (5.8)2.8 (1.8)
 HC8530.5 (7.9)70.59%14.3 (3.3)Nr---
Filser et al. [56]
 MSGermany17243.33 (11.64)68%10.74 (1.56)76.4%0/87/9/4/0NrNr
 HC10043.04 (15.59)71%10.77 (1.58)92%---
Giedraitienė et al. [57]
 MSLithuania 5038.8 (10.2)47%15.9 (2.8)54%4/88/6/2/011.7 (9.2)3.3 (1.3)
 HC2036.7 (16.4)33%17.5 (3.5)75%---
Hämäläinen et al. [58]
 MSFinland6550.9 (8.8)71%13.8 (9.8)20%0/62/38/0/015.9 (9.8)4.8 (2.0)
 HC4549.4 (12.6)71%14.0 (2.1)86.7%---
Marstrand et al. [59]
 MSDenmark6537.2 (8.8)63%15.2 (2.4)Nr0/100/0/0/03.9 (2.7)1.8 (1.2)
 HC6536.8 (9.6)63%15.9 (2.1)Nr---
Maubeuge et al. [60]
 MSFrance12349.69 (9.41)63.4%14–16 yrs = 30.1%44.7%0/33/33/34/014.67 (9.09){4.0}, [0–8]
 HC27643.84 (12.42) 57.3% 14–16 yrs = 38%Nr---
Niino et al. [61]
 MSJapan15641.4 (9.3)69%14.1 (1.9)Nr0/88/11/1/010.3 (7.2)2.4 (2.0)
 HC12639.3 (11.9)72%14.3 (1.6)Nr---
O’Connell et al. [62]
 MSIreland6742.7 (12.8)68%14.1 (3.1)41.8%0/70/28/2/010.2 (8.4)1.8 (0.9)
 HC6643.9 (12.1)73%13.6 (2.7)80.3%---
Ozakbas et al. [63]
 MSTurkey 17337.5 (10.7)71%13.9 (7.3)23.7%0/87/10/3/09.2 (6.1)2.4 (1.7)
 HC15336.9 (8.9)71%15.4 (8.8)39.1%---
Polychroniadou et al. [64]
 MSGreece4440.2 (9.9)61%13.9 (4.2)Nr7/77/9/7/09.1 (4.1){3.5}, [1.0–6.0]
 HC7936.2 (10.6)60%15.6 (5.5)Nr---
Sandi et al. [65]
 MSHungary6541.9 (8.9)75%>12 yrs = 52.3%Nr0/100/0/0/011.1 (7.6)2.5 (1.8)
 HC6540.9 (11.8)75%>12 yrs = 52.3%Nr---
Skorve et al. [66]
 MSNorway6537.02 (0.40)64.6%14–16 yrs = 37%89.2%0/100/0/0/01.08 (0.74)1.28 (0.88)
 HC6838.13 (11.40)66.2%14–16 yrs = 46%97.0%---
Souissi et al. [67]
 MSTunisia10433.3 (9.8)75%14–16 yrs = 14.42%Nr0/88/8/4/07 (6.4)2.65 (2.06)
 HC10433.3 (9.4)75%14–16 yrs = 14.42%Nr---
Sousa et al. [68]
 MSPortugal10538.26 (11.03)66.7%13.55 (3.71)58.1%4/92/4/0/06.52 (5.95){1.5}, [0–6]
 HC6036.17 (12.01)58.3%14.62 (3.47)94.9%---
Spedo et al. [69]
 MSBrazil5841.2 (12.2)69%12.7 (5.2)Nr0/100/0/0/08.3 (6.6)4.2 (2)
 HC5840.3 (11.9)55%12.5 (3.6)Nr---
Vanotti et al. [70]
 MSArgentina5043.4 (10.2)74%14.9 (2.8)Nr0/78/18/4/013.1 (9.1)3.29 (2.55)
 HC10042.4 (10.1)75%14.9 (2.5)Nr---
Walker et al. [71]
 MSCanada5745.4 (9.9)80%15.44 (2.7)Nr0/77/16/7/010.11 (7.72)2.7 (1.85)
 HC5141.9 (10.8)86%16.31 (2.1)Nr---
MS = multiple sclerosis; HC = healthy control; CIS = clinically isolated syndrome; RR = relapsing–remitting MS; SP = secondary progressive MS; PP = primary progressive MS; PR = progressive–relapsing MS; EDSS = expanded disability status scale; Nr = not reported; SD = standard deviation.
Table 3. BICAMS psychometrics.
Table 3. BICAMS psychometrics.
Study SDMT Score
Mean (SD)
CVLT-II Score
Mean (SD)
BVMT-R SCORE
Mean (SD)
Impaired Cognition on at Least One Subtest (%) Sensitivity (%) Specificity (%)
Alarcón et al. [46]
 MS46.47 (14.24)45.34 (10.14) a21.64 (6.91)50%NrNr
 HC54.11 (12.19)48.78 (8.45) a25.67 (6.81)---
Betscher et al. [47]
 MS48.8 (12.1)51.7 (10.9)24 (7.7)34%NrNr
 HC57.2 (9.7)56.1 (9.2)27.1 (5.7)Nr--
Botchorishvili et al. [48]
 MS35.5 (12.7)51.0 (11.8)22.0 (8.0)43%NrNr
 HC46.0 (11.8)58.5 (8.2)25.6 (6.8)14%--
Costers et al. [49]
 MS52.1 (13.1)60.1 (12.9)25.4 (29)NrNrNr
 HC61 (10.2)61.3 (9.7)28.2 (5.1)Nr--
Darwish et al. [50]
 MS47.2 (17.98)56.9 (10.04) b22 (9.79)61%NrNr
 HC59.22 (12.27) 54.10 (8.71) b24.23 (6.66)Nr--
Drulović et al. [51]
 MS45.9 (16.7)50.0 (11.7)18.8 (7.4)62.9% NrNr
 HC56.3 (12.9)52.7 (9.6)22.6 (5.8)18.6%--
Dusankova et al. [52]
 MS50 (13)52 (11) 23 (7) 58%94% 86%
 HC65 (9) 60 (8) 29 (4) 0.7%--
Estiasari et al. [53]
 MS40.9 (14.8) 52.0 (12.8) 22.2 (7.7) 40%NrNr
 HC64.8 (16.2) 61.5 (9.7) 29.3 (5.6) Nr- -
Evdoshenko et al. [54]
 MS49.16 (13.42) {61.5} {26.5} 34.69%NrNr
 HC 58.34 (11.52) {65.5} {28}16.28%--
Farghaly et al. [55]
 MS39.2 (13.3) 53.7 (10.5) 19.7 (9.2) SDMT = 31.1%
CVLT-II = 19.5%
BVMT-R = 23.9%
NrNr
 HC50.9 (10.8)59.6 (8.5) 25.4 (8.7) SDMT = 5.8%
CVLT-II = 7%
BVMT-R = 8.1%
--
Filser et al. [56]
 MS47.43 (11.67)55.35 (11.43) c 24.44 (7.59)32.6% NrNr
 HC56.07 (11.64) 55.16 (10.27) c27.37 (5.96) Nr--
Giedraitienė et al. [57]
 MS42.7 (13.9) 55.9 (10)23.1 (7)NrNrNr
 HC57 (11.5) 65.7 (5.9) 29.6 (4.1) Nr --
Hämäläinen et al. [58]
 MS41.9 (11.8) 43.0 (11.5)19.2 (8.0) 60%NrNr
 HC54.6 (8.3) 51.3 (10.7)24.7 (6.8) Nr --
Marstrand et al. [59]
 MS61.0 (10.0) 65.4 (9.9) 27.4 (5.8) 32.3% SDMT = 20.0%
CVLT-II = 10.8%
BVMT-R = 16.9%
SDMT = 95.4%
CVLT-II = 89.2%
BVMT-R = 93.8%
 HC66.0 (9.6) 68.6 (6.4) 29.6 (3.7) 20% --
Maubeuge et al. [60]
 MS50.31 (11.12) 49.72 (12.77) d22.89 (7.26) 50.4% NrNr
 HC58.55 (8.44) 57.78 (8.67) d26.73 (5.67) 19.6% --
Niino et al. [61]
 MS47.9 (14)48.6 (12.6)23.5 (8.4)NrNrNr
 HC61 (9.5)55.7 (10.5)28.3 (5.4)Nr --
O’Connell et al. [62]
 MS46.0 (12.9)45.3 (10.2) 17.9 (7.1) 57%NrNr
 HC56.1 (10.6)53.6 (9.1) 20.9 (6.5) 17%--
Ozakbas et al. [63]
 MS43.2 (12.5)45.7 (11.3)16.9 (8.5)45.1%NrNr
 HC53.5 (9.5)53.9 (7.7)22.5 (9.2) Nr--
Polychroniadou et al. [64]
 MS45.0 (17.2)55.5 (12.3) e18.5 (8.3)47%NrNr
 HC61.4 (13.1) 60.5 (10.7) e22.1 (6.5) Nr--
Sandi et al. [65]
 MS55.6 (15.5)55.4 (10.7)22.5 (8.5)52.3%NrNr
 HC 66.2 (12.4)59.0 (8.3)26.7 (5.6) Nr--
Skorve et al. [66]
 MS54.65 (10.79) 54.55 (10.86) 26.55 (5.76)46.2% NrNr
 HC58.52 (10.53)60.32 (7.75) 29.03 (4.01)Nr--
Souissi et al. [67]
 MS36 (13)42 (7) f23 (9)73.1%SDMT = 74%
TVLT = 76% f
BVMT-R = 75%
SDMT = 56%
TVLT = 55% f
BVMT-R = 53.5%
 HC47 (15) 46 (6) f27 (7) Nr --
Sousa et al. [68]
 MS51.77 (11.20) 55.05 (11.84) 21.72 (7.27) 24.8% NrNr
 HC58.68 (10.02) 60.47 (10.12) 24.68 (5.52) Nr--
Spedo et al. [69]
 MS35.9 (16.1) 42.1 (12.4)19.9 (8.6)NrNrNr
 HC47.5 (13) 53.4 (10.8) 23.8 (7.7) Nr--
Vanotti et al. [70]
 MS45.1 (16.1)50.9 (12.4)20.7 (7.74)NrNrNr
 HC56.7 (10.9) 60.9 (10.5)23.4 (5.8) Nr--
Walker et al. [71]
 MS49.7 (10.8)51.6 (10.1)24.6 (6.5)57.9%SDMT = 97.5%
CVLT-II = 82.5%
BVMT-R = 77.5%
SDMT = 88.2%
CVLT-II = 70.6%
BVMT-R = 82.4%
 HC59.1 (8.5) 57.7 (7.9)29.8 (3.6) Nr--
MS = multiple sclerosis; HC = healthy control; SDMT = symbol digit modalities test; CVLT-II = California verbal learning test; BVMT-R = brief visuospatial memory test-revised; Nr = not reported; SD = standard deviation. a Alternative verbal memory test used = The Prueba de Aprendizaje y Memoria con Codificación Libre (PAMCL). b Alternative verbal memory test used = The Verbal Memory Arabic Test (VMAT). c Alternative verbal memory test used = The Rey Auditory Verbal Learning Test (RAVLT). d Alternative verbal memory test used = The French Verbal Learning Test (FVLT). e Alternative verbal memory test used = The Greek Verbal Learning Test (GVLT). f Alternative verbal memory test used = The Tunisian Verbal Learning Test (TVLT).
Table 4. Correlations between BICAMS scores and MS sample variables.
Table 4. Correlations between BICAMS scores and MS sample variables.
Study BICAMS Scores and Sample Variables
Age (r)Disease Duration (r)EDSS (r)Education Years (r)
SDMTCVLT-IIBVMT-RSDMTCVLT-IIBVMT-RSDMTCVLT-IIBVMT-RSDMTCVLT-IIBVMT-R
Alarcón et al. [46]
 MSNr-NrNr-NrNr-NrNr-Nr
 HCNr-Nr------Nr-Nr
Betscher et al. [47]
 MS−0.28 *Nr−0.26 *NrNrNr−0.58 ***−0.31 *−0.27 *0.36 *0.42 ***0.5 ***
 HC−0.35 *NrNr------0.44 ***0.47 ***0.27 *
Botchorishvili et al. [48]
 MS−0.400*−0.112−0.192−0.177−0.1060.125−0.582 ***−0.403 ***−0.342 ***0.243 *0.2070.297 *
 HC−0.457 ***−0.368 ***−0.506 ***------0.523 ***0.439 *0.348 *
Costers et al. [49]
 MS−0.34 ***−0.10−0.29 **NrNrNr−0.44 ***−0.35 ***−0.43 ***NrNrNr
 HCNrNrNr------NrNrNr
Darwish et al. [50]
 MSNr-NrNr-NrNr-NrNr-Nr
 HCNr-Nr------Nr-Nr
Drulović et al. [51]
 MS−0.225 *−0.232 *−0.271 *−0.109 *−0.880−0.207 *−0.466 *−0.320 *−0.360 *0.339 *0.298 *0.190 *
 HC−0.605 *−0.430 *−0.374 *------0.521 *0.552 *0.394 *
Dusankova et al. [52]
 MSNrNrNr0.44 *0.39 *0.41 *NrNrNrNrNrNr
 HCNrNrNr------NrNrNr
Estiasari et al. [53]
 MS−0.004−0.110.02−0.23−0.19−0.18−0.5 ***−0.46 *−0.49 *{47}, [15–69]{54}, [23–72]{24.5}, [4–32]
 HC−0.27 *−0.11−0.28 *------{63}, [42–110] *{63}, [36–77]{31}, [14–36]
Evdoshenko et al. [54]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HC NrNrNr------NrNrNr
Farghaly et al. [55]
 MS−0.26 a,*−0.17 a−0.26 a,*−0.41 a,***−0.18 a−0.27 a,*−0.37 a,***−0.31 a,*−0.19 a0.36 a,***0.27 a,*0.25 a,*
 HCNrNrNr------NrNrNr
Filser et al. [56]
 MSNr-NrNr-NrNr-NrNr-Nr
 HCNr-Nr------Nr-Nr
Giedraitienė et al. [57]
 MSNrNrNr−0.3 a−0.2 a−0.2 a−5.9 a,***−3.7 a,***−2.3 a,***2.4 a,*2.4 a,*1.0 a,*
 HCNrNrNr------2.0 a,*1.2 a,*0.9 a,*
Hämäläinen et al. [58]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HCNrNrNr------NrNrNr
Marstrand et al. [59]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HCNrNrNr------NrNrNr
Maubeuge et al. [60]
 MSNr-NrNr-NrNr-NrNr-Nr
 HCNr-Nr------Nr-Nr
Niino et al. [61]
 MS–0.37 ***–0.25 *–0.30 ***–0.30 ***–0.12–0.27 ***–0.56 ***–0.29 ***−0.46 ***0.070.130.001
 HC–0.44 ***–0.23 *–0.25 *------0.24 *0.25 *0.05
O’Connell et al. [62]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HCNrNrNr------NrNrNr
Ozakbas et al. [63]
 MSNrNrNrNrNrNr−0.46 *−0.40 *−0.24NrNrNr
 HCNrNrNr------NrNrNr
Polychroniadou et al. [64]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HCNrNrNr------NrNrNr
Sandi et al. [65]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HCNrNrNr-----NrNrNrNr
Skorve et al. [66]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HCNrNrNr------NrNrNr
Souissi et al. [67]
 MSNr-NrNr-NrNr-NrNr-Nr
 HCNr-Nr------Nr-Nr
Sousa et al. [68]
 MSNrNrNrNrNrNr−0.497 ***−0.334 ***−0.275 *NrNrNr
 HCNrNrNr------NrNrNr
Spedo et al. [69]
 MS−0.30 *−0.30 *−0.29 *NrNrNrNrNrNr0.29 *0.18 *0.27 *
 HC−0.49 *-−0.34 *------0.49 *0.37 *-
Vanotti et al. [70]
 MSNrNrNrNrNrNrNrNrNrNrNrNr
 HCNrNrNr------NrNrNr
Walker et al. [71]
 MSNrNrNrNrNrNrNrNrNr-0.20 *-
 HCNrNrNr------NrNrNr
MS = multiple sclerosis; HC = healthy control; SDMT = symbol digit modalities test; CVLT-I I= California verbal learning test; BVMT-R = brief visuospatial memory test-revised; EDSS = expanded disability status scale; Nr = not reported. a Regression coefficient reported; correlation coefficients (r) are presented with significance marks: * p < 0.05, ** p < 0.01, *** p < 0.001.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Potticary, H.; Langdon, D. A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) International Validations. J. Clin. Med. 2023, 12, 703. https://doi.org/10.3390/jcm12020703

AMA Style

Potticary H, Langdon D. A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) International Validations. Journal of Clinical Medicine. 2023; 12(2):703. https://doi.org/10.3390/jcm12020703

Chicago/Turabian Style

Potticary, Hannah, and Dawn Langdon. 2023. "A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) International Validations" Journal of Clinical Medicine 12, no. 2: 703. https://doi.org/10.3390/jcm12020703

APA Style

Potticary, H., & Langdon, D. (2023). A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) International Validations. Journal of Clinical Medicine, 12(2), 703. https://doi.org/10.3390/jcm12020703

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop