Next Article in Journal
Return on Investment (ROI) and Development of a Workplace Disability Management Program in a Hospital—A Pilot Evaluation Study
Next Article in Special Issue
Common Running Musculoskeletal Injuries and Associated Factors among Recreational Gorge Marathon Runners: An Investigation from 2013 to 2018 Taroko Gorge Marathons
Previous Article in Journal
Analysis of the Risk Factors Associated with Hearing Loss of Infants Admitted to a Neonatal Intensive Care Unit: A 13-Year Experience in a University Hospital in Korea
Previous Article in Special Issue
Medial Tibial Stress Syndrome in Novice and Recreational Runners: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reference Values for Isometric, Dynamic, and Asymmetry Leg Extension Strength in Patients with Multiple Sclerosis

by
Kora Portilla-Cueto
1,
Carlos Medina-Pérez
2,*,
Ena Monserrat Romero-Pérez
3,*,
José Aldo Hernández-Murúa
4,
Claudia Eliza Patrocinio de Oliveira
5,
Fernanda de Souza-Teixeira
6,
Jerónimo J González-Bernal
7,
Carolina Vila-Chã
8,9 and
José Antonio de Paz
1
1
Institute of Biomedicine (IBIOMED), University of León, 24071 León, Spain
2
Sciences Health School, University Isabel I, 09003 Burgos, Spain
3
Division of Biological Sciences and Health, University of Sonora, Hermosillo 83000, Mexico
4
Escuela Superior de Educación Física, Universidad Autónoma de Sinaloa, Culiacán 80040, Mexico
5
Department of Physical Education, Federal University of Viçosa, 36570-000 Viçosa, Brazil
6
Exercise and Neuromuscular System Research Group, Superior School of Physical Education, Federal University of Pelotas, 96010-610 Pelotas, Brazil
7
Department of Health Sciences, University of Burgos, 09001 Burgos, Spain
8
Polytechnic Institute of Guarda, 6300-559 Guarda, Portugal
9
Research Center in Sports Sciences, Health and Human Development (CIDESD), 5001-801 Vila Real, Portugal
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(21), 8083; https://doi.org/10.3390/ijerph17218083
Submission received: 24 September 2020 / Revised: 29 October 2020 / Accepted: 1 November 2020 / Published: 2 November 2020
(This article belongs to the Special Issue Physical Rehabilitation and Sports Medicine of Human Movement)

Abstract

:
Having recognized the value of resistance training in patients with multiple sclerosis (PwMS), there are a lack of lower limb normative reference values for one repetition maximum (1RM) and maximal voluntary isometric contraction (MVIC) in this population. Hence, the purposes of this study were to provide reference values for 1RM and MVIC of knee extensors in PwMS across the disability spectrum and to examine knee extension strength asymmetry. Three hundred and ninety PwMS participated in the study, performing MVIC and 1RM tests of bilateral (both legs together at once) and unilateral (each leg singly) knee extensors. There was no difference in 1RM according to the disease course of MS, but there was according to the degree of neurological disability, being more preserved in those with a lower degree of disability. MVIC tends to be higher in patients with relapsing–remitting MS respect those with progressive MS, and in patients with lower levels of neurological disability. Asymmetry above the values considered normal in 1RM was present in 20–60% of patients and 56–79% in the MVIC test, depending on the type of MS and tended to be lower in those with less disability. Reference values are given by quartiles for 1RM, MVIC, and asymmetry.

1. Introduction

Multiple sclerosis (MS) is a demyelinating disease of the central nervous system that most often debuts in young adults [1]. The clinical evolution is usually accompanied by neurological deficits with cognitive, sensory, and physical manifestations, such as muscle weakness [2]. Impairment of mechanical muscle function can have important consequences in persons with multiple sclerosis (PwMS), with more functional impact in the lower extremities [1,3]. Moreover, balance and gait may be affected [4].
In the last two decades, physical exercise has generated a lot of interest as a coadjuvant therapy to improve or maintain functional capacity, cognitive functions, and social activities and, hence, the quality of life [5].
The World Health Organization published in 2010 the “Global recommendations on physical activity for health” address for general and healthy populations [6], which is similar to the recommendations for PwMS: do at least 150 min per week of moderate-intensity aerobic exercise or 75 min of vigorous exercise, and perform at least two weekly sessions of musculoskeletal strengthening exercise that involves resistance training [6,7].
In recent years, many studies have included resistance training in their physical exercise programs for PwMS [4,8,9,10], and have shown promising results for improving quality of life and functional capacity after 8 to 12 weeks of training [11]. To increase efficiency as well as to increase exercise safety, training loads should be individualized to each person [12].
There are different types of muscular actions: concentric (muscle length is shortened), eccentric (muscle length is extended), isometric (muscle length is fixed), isotonic (muscle tension is fixed), isokinetic (muscle shortening or lengthening velocity is fixed), and isoinertial (muscle contraction encounters a fixed external resistance), and in all of them muscular tension is generated, which we call force [13]. In daily activities, the most common type of muscle action used is isoinertial, and there are different ways of showing isoinertial muscle strength (e.g., maximum force, muscle power, and force resistance) [13]. Traditionally, resistance training is targeted to improve maximum dynamic strength, and the main consensus established on strength training for health, recommends programming the training load based on each person’s one repetition maximum (1RM) [4,14].
The evaluation of muscle strength assessment in addition to being useful to individually prescribe training loads, as well as to categorize individual scores based on the reference values of the population segment to which that person belongs (age, sex, MS type, degree of affectation). However, health and exercise professionals find difficulties in his work for the lack reference data on muscle strength for PwMS with different evolutionary types of the disease or for different degrees of disability [15]. This disability in PwMS is usually assessed through the Kurtzke Expanded Disability Status Scale (EDSS) [16]. On this scale, the ambulatory capacity of the patient has a great weight in the resulting score, but the level of muscular strength is not considered, which is also an important factor for the level of functional independence. Characteristically, MS often affects both sides of the body unevenly, either in sensory or motor functions [17,18].
The aims of this study were to develop reference values of the maximum dynamic (1RM) and isometric (MCVI) forces of the knee extensors for PwMS with different degrees of disability and types of MS, and examine the degree of inter-lower limb asymmetries in force generation.

2. Experimental Section

2.1. Participants

This observational cross-sectional study was part of a strength training service for PwMS, which was performed by the University of León with the support of the Regional Ministry of Health of the of the Government of Castilla y León (Spain). The research protocol was approved by the Research Ethics Committee at the University of León and data were collected from the first evaluation of muscle strength on the leg extensors carried out in 390 PwMS (149 men and 241 women) of different ages when they joined to the training program. The patient inclusion criteria were confirmed diagnosis of MS based on the McDonald criteria (2001) [19], ability to ambulate with or without help, ability to perform the tests, and that this was the first time they were evaluated in the resistance training program.
Patients made two visits to the laboratory: in the first visit, a medical history was taken, was evaluated the degree of disability based on the EDSS, and a familiarization session was conducted on the weights machine with strength assessment exercises. In the second visit, strength evaluations were performed.
For the analysis of the results the clinical course of MS (relapsing–remitting (RR); primary progressive (PP); secondary progressive (SP)) was taken into account, and the disability status according to the score of the Kurtzke Expanded Disability Status Scale (EDSS), determined by a specialist doctor, (mild = EDSS ≤ 2.5; moderate = EDSS ≤ 5; severe = EDSS ≤ 7.5; and very severe = EDSS > 7.5).
The methods, procedures and data treatments employed in the study were in accordance with ethical standards and the Declaration of Helsinki (revised October 2013). Before the start of the study and after being informed, each patient signed consent to voluntary participation. The research protocol was approved by the Research Ethics Committee at the University of León (30 January 2017, study number 1835).

2.2. Measurement of Outcomes

Maximal voluntary isometric contraction (MVIC) and the one repetition maximum (1RM) test of knee extensors were measured on a multi-station machine (BH® Fitness Nevada Pro-T, Madrid, Spain), both bilaterally (both legs together at once), and unilaterally (each leg singly). Following the protocol used in other studies [20], the length of the lever arm of the machine was adjusted to the length of the leg lower limb, so the patient could push with the front part of the lower leg at the height of the tibial malleolus.

2.2.1. MVIC

The MVIC test was performed with a similar device described in previous reports [20,21,22], and was measured by a load cell (Globus; Codogné, Italy; sample rate 1000 Hz) for 5 s. Data were collected and analyzed with associated software (Globus Ergo Tester v1.5, Codognè, Italy). Participants were seated in an upright position, with a hip joint angle of 110° and a knee joint angle of 90° of flexion. This was measured by the goniometer TEC (Sport-Tec Physio & Fitness, Pirmasens, Germany). During the test, patients were instructed to push as hard as possible from the beginning of the test and then maintain maximal strength against the fixed lever arm of the device for five seconds. Patients were constantly encouraged to perform the exercises during the measurements. Two attempts, separated by one minute around, were carried out by each participant. Only the higher value of both was considered for further analysis.

2.2.2. RM

For maximum dynamic strength evaluation, we follow the protocol of Oliveira et al. (2017) [22]. First, four warm-up repetitions were performed at 50% of the MVIC under the supervision of the trained evaluator and after indicating the patient’s subjective perception of the effort through the OMNI-Resistance Exercise Scale [23].
Two repetitions were performed with each load, which progressively increased between 5 and 14 kg, as a function of the reported subjective perception and the quality of technical execution of repeats, with an interval of 3 min between each of the loads. An attempt was made to obtain the 1RM after four or five attempts to avoid excessive fatigue in the subjects, in the few cases where 1RM was not attained in a maximum of 5 attempts, the evaluation was repeated 48 h later. When the patient was able to perform a single repetition, this mobilized load was considered the 1RM.

2.2.3. Asymmetry

Asymmetry scores were calculated for each strength measure (1RM and MCVI) using the following equation:
Asymmetry   %   = 1 l i m b   s t r e n g t h   w e a k e r l i m b   s t r e n g t h   s t o n g e r   ×   100 .
Therefore, the higher the score, the greater the degree of asymmetry between the extremities [17,24].

2.3. Statistical Analysis

For statistical analysis, the software SPSS 23.0 for Windows (IBM-Inc, Chicago, IL, USA) was used. For the descriptive statistics, we used the frequency for the categorical variables and quantitative variables were expressed as mean ± SD. Normality was tested by using the Shapiro–Wilk test. Sex comparisons were performed with unpaired t-tests or the non-parametric equivalent, the Mann–Whitney U test, depending on whether the distribution of the variable was normal or not. ANOVA was used to compare the quantitative outcomes among MS type or level of neurological disability with post hoc de Bonferroni, when it was appropriate. Moreover, p-value < 0.05 was considered to be statistically significant. The reference values we provide are expressed as cutoff values between quartiles (Q1_Q2; Q2_Q3; Q3_Q4).

3. Results

Firstly, Table 1 shows the mean and SD of the main characteristics of the sample; age, body mass index (BMI), years of evolution, and grade of EDSS, differentiated by gender.
Table 2 shows the sample by gender, type of MS, and degree of neurological disability.
Table 3 shows the values of the force outcomes measured by gender.
Table 4 shows values of the assessed variables of the patients in the sample, grouped by type of multiple sclerosis.
In Supplementary Materials Table S1 are shown Force variables by type of multiple sclerosis by gender.
Table 5 shows the data of the variables studied in the patients grouped by the level of neurological disability. This table does not show the values of the 8 patients (2 males, 6 females) who presented a very severe disability (EDSS > 7.5), since the small number of these patients made it difficult to compare with the other more numerous disability groups.
In Supplementary Materials Table S2 are shown Force variables by neurological disability level and gender.
The quartile cutoff scores for the parameters analyzed and grouped according to the evolutionary type of the disease are shown in Table 6.
In Supplementary Materials Table S3 are shown Quartiles of force variables of sample by type of multiple sclerosis and gender.
Table 7 shows quartile cutoff scores for measured and grouped variables according to the degree of neurological disability.
In Supplementary Materials Table S4 are shown Quartiles of force variables of sample by EDSS degree and gender.
Table 8, Table 9 and Table 10 show 1RM and MVIC asymmetry in patients with a value of asymmetry equal or higher to 10%. If asymmetry value was less than 10%, it was considered normal.
Moreover, Table 8 shows the percentage of patients who present asymmetry above 10% and the average, maximum and minimum values of asymmetry in these patients by gender.
Table 9 shows the percentage of patients who present asymmetry above 10% and the average, maximum and minimum values of asymmetry in these patients by type of multiple sclerosis.
Table 10 shows the percentage of patients who present asymmetry above 10% and the average, maximum and minimum values of asymmetry in these patients by neurological disability level.

4. Discussion

This study assessed 390 people with confirmed MS, of which 61.8% were women, as expected since the incidence of this disease is lower in men [25]. MS typically debuts in young adults [26], which explains that although the sample was young (44.5 years in men and 46.3 years in women), the years of disease progression were 9.7 ± 8.2 in men and 9.9 ± 7.5 in women.
Most patients in the sample had RR (60.4% of men and 71% of women); the second most frequent was SP (22.1% of men and 15.7% of women); and the least frequent was PP (17.5% of men versus 13.3% of women). The change in disease course of MS patients is well known, and it is estimated that 80% of patients debut usually with an acute episode with sensory or motor manifestations that in a short period of time disappear without leaving important functional sequelae [27]. However, the repetition of these episodes tends to produce an incomplete recovery, leaving the patient with a certain level of sequelae, is the RRMS form. Over time, about 65% of patients, without presenting flare-ups, evolve more or less rapidly towards a motor or sensory worsening, this evolutionary phase, is the SPMS form. Only a minority of patients (20%) present from the beginning of the disease, without outbreaks, a progressive evolutionary type from the beginning of the disease, is the PPMS form [27]. The pharmacological treatment of the disease is mainly determined by the evolutionary type of the disease; however physical conditioning and rehabilitative treatment are not only determined by the type of disease but by the degree of neurological disability [28,29]. There are different scales to evaluate disability in patients with MS, and the EDSS is the most commonly used in the clinic and in studies with intervention in patients with MS [30], despite its limitations, which include that it gives a very important weight in the final score to the ability to walk, and therefore it prioritizes the evaluation of the lower limbs over the upper ones. The degree of neurological disability (EDSS) does not seem to depend on the sex of the patient, and in our sample men and women have similar EDSS scores. The EDSS is a scale with a result between 0 (minimum disability) and 10 (death from MS), with minimum increments of 0.5 points. There is no consistently accepted categorical grouping of the degree of neurological disability on this scale [31]. For this reason, in order to rationalize the analysis and expression of our results, as well as to increase the practical application of these results by professionals, we have categorized them into four levels by disability status according to the EDSS score: mild = EDSS ≤ 2.5; moderate = EDSS ≤ 5; severe = EDSS ≤ 7.5; and very severe = EDSS > 7.5.
In all people, but more obviously in PwMS, having adequate levels of strength in the lower limbs is fundamental for walking, balance, and the autonomy of the patient [32]. This is one of the reasons why rehabilitation and physical conditioning of these patients is currently focused on strength training of the lower extremities [4,32,33,34,35].
In the evaluation of the performance of a particular muscle group, it is fundamental, especially in the measurement of isometric strength, to standardize the joint angle on which this group acts, as well as that of the joints on which the agonist groups in that exercise are operating [36,37,38]. In general it is considered that the angle of knee flexion which produces the greatest isometric torque is between 80 and 90° [36,39]; however, the angle of the patient’s hip in the evaluation position also modifies the result of the force expressed. Therefore, the standardization of angles is necessary to be able to establish valid comparisons of results obtained in evaluations sequenced over time and for comparison with data from other studies. However, research publications measuring dynamic force or isometric force of knee extensors usually do not indicate hip angles.
This lack of information in manuscripts and sample characteristics of each study make it very difficult to compare our data with those of other published research. Isometric strength assessment is easy and quick to carry out, produces low fatigue in PwMS, shows good repeatability [40], and shows a good correlation with dynamic muscle performance [41], so it is not unusual to find studies in which it has been measured for programming or to see the outcome of a physical training program in patients with MS [20,42].
Women with MS have lower isometric strength values than men, both bilaterally and unilaterally, as would be expected, since also in healthy populations, at any age, men show higher isometric strength values [1,43]. Often studies with PwMS have used isometric strength to prescribe training loads and even as a form of training [33,44], and it has been described that improvement in this outcome after a training programmed is linked with improvements in walking and in the quality of life of those affected by the disease [20,33]. Patients with RRMS show a little more isometric strength than other evolutionary forms of disease, but the difference is small and is influenced not only by the disease, but probably also by age as patients in the RRMS group are younger. Patients with SPMS have more years of disease evolution. To the best of our knowledge no studies compare functional ability according to the type of MS.
The maximum dynamic force, 1RM, both bilaterally and unilaterally manifested, is also higher in males, but in contrast to the isometric force, it shows no difference between the different evolutionary types of MS.
An interesting aspect is the study of the degree of symmetry in the lower limbs, as often the disease does not affect both sides of the body equally [45], and PwMS most often present asymmetry in force between limb [17,18,46,47,48,49], and some studies have found that the degree of asymmetry is inversely related to walking ability [24,32,47]. The lower-limb explained a 20–30% of the variance functional capacity tests between PwMS, which is the reason why muscle training is recommended to minimize strength asymmetry between limbs [46], although other studies have not corroborated this association [50]. A certain degree of asymmetry in the strength of the knee extensors can be observed in healthy populations, with up to 10% difference between the extremities considered as normal [51,52]. However, the PwSM in the sample present a level of asymmetry higher than the 10% considered normal, as 70.4% of the men and 60% of the women show asymmetry for MVIC, and for the 1RM 39.5% of the men and 31.2% of the women. Most of the studies that have analyzed force asymmetry in PwMS have done so with isokinetic dynamometry, so the data are not very comparable. Asymmetry in force generation has been more studied in sports populations, probably because of the relationship between asymmetry and sports performance and injury risk [53]. In the physically active or athletic population the degree of isokinetic asymmetry of knee extensors was 3.7%, according to a meta-analysis of seven studies with a total sample of 173 participants [54], and in 259 athletes the average asymmetry in MVIC was 9% [55]. Asymmetry increases significantly after an injury or surgery on the locomotive system and afterwards tends to decrease with physical reconditioning [51].
We do not know of any studies that have compared affective asymmetry between patients with different forms of MS; in our study there were no differences between the MS groups for either MRI or MVIC. Accordingly with the studies that have found an association between the degree of disability and the degree of asymmetry [24,32,47], we observed that patients with mild neurological disability have a significantly lower 1RM asymmetry score with respect to patients with moderate disability and in the MVIC with respect to those with severe disability. About 30% of PwSM show an abnormal degree of 1RM asymmetry, and MVIC asymmetry in 34% of patients with mild and 60% of moderate and severe disability.
The studies that have been carried out on symmetry in PwMS have been of a transverse type, so we can only analyze the association of asymmetry with other disease parameters, physiological or functional; longitudinal studies are needed to explain the causal factors of asymmetry, including studies with more standardized methodologies and protocols [18]. For potential use by health or physical activity professionals caring for PwMS, for the variables analyzed in this study we showed reference values with points of separation between quartiles, grouped by type of MS and degree of neurological disability.
Limitations of the study include that the lack of sufficiently standardized protocols in the evaluation of muscle performance in PwMS has made it difficult to compare our data with that of other studies. Nor have we been able to compare the data of our patients with healthy people, since we have not found reference values for these variables in healthy populations of different ages and gender. Due to the inclusion criteria used in this study, there have been few patients with a very severe degree of disability (EDSS > 7.5), so we have not been able to establish comparisons or obtain reference values for them.

5. Conclusions

There is no difference in 1RM according to the disease course of MS, but there is according to the degree of neurological disability, with 1RM more preserved in those with a lower degree of disability. MVIC tends to be higher in patients with relapsing–remitting MS, and in patients with lower levels of neurological disability. Asymmetry above the values considered normal in 1RM is present in between 20 and 60% and MVIC asymmetry in between 56 and 79% of patients, depending on the type of MS, and tends to be lower in those with less disability. Reference values are given by quartiles for 1RM, MVIC, and asymmetry.

Supplementary Materials

The following are available online at https://www.mdpi.com/1660-4601/17/21/8083/s1, Table S1: Force variables by type of multiple sclerosis by gender; Table S2: Force variables by neurological disability level and gender. Table S3: Quartiles of force variables of sample by type of multiple sclerosis and gender; Table S4: Quartiles of force variables of sample by EDSS degree and gender.

Author Contributions

Conceptualization, K.P.-C., C.M.-P., and J.A.d.P.; methodology, C.M.-P., J.J.G.-B., and E.M.R.-P.; data curation and formal analysis, C.V.-C., E.M.R.-P., and C.M.-P.; investigation, K.P.-C., J.A.H.-M., F.d.S.-T., C.E.P.d.O., C.M.-P., and J.A.d.P.; writing—original draft preparation, K.P.-C., and E.M.R.-P.; writing—review and editing, K.P.-C., C.M.-P., and J.A.d.P.; supervision, C.M.-P., J.A.d.P. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by a grant from the Regional Ministry of Health of the Government of the Autonomous Community of Castilla y León, Spain.

Acknowledgments

We are most grateful for the collaboration of the patients associations of Burgos, Miranda de Ebro, Valladolid, Palencia, Segovia, Zamora, León, and Ponferrada.

Conflicts of Interest

The authors do not have any potential conflict of interest.

References

  1. Alroughani, R.; Akhtar, S.; Ahmed, S.; Behbehani, R.; Al-Hashel, J. Is time to reach EDSS 6.0 faster in patients with late-onset versus young-onset multiple sclerosis? PLoS ONE 2016, 11, e0165846. [Google Scholar] [CrossRef]
  2. Motl, R.W.; Pilutti, L.A. The benefits of exercise training in multiple sclerosis. Nat. Rev. Neurol. 2012, 8, 487–497. [Google Scholar] [PubMed]
  3. Lambert, C.P.; Archer, R.L.; Evans, W.J. Muscle strength and fatigue during isokinetic exercise in individuals with multiple sclerosis. Med. Sci. Sports Exerc. 2001, 33, 1613–1619. [Google Scholar] [CrossRef] [PubMed]
  4. Jørgensen, M.L.K.; Dalgas, U.; Wens, I.; Hvid, L.G. Muscle strength and power in persons with multiple sclerosis–A systematic review and meta-analysis. J. Neurol. Sci. 2017, 376, 225–241. [Google Scholar] [PubMed]
  5. Li, H.; Hu, F.; Zhang, Y.; Li, K. Comparative efficacy and acceptability of disease-modifying therapies in patients with relapsing–remitting multiple sclerosis: A systematic review and network meta-analysis. J. Neurol. 2019, 1–10. [Google Scholar] [CrossRef]
  6. Kim, Y.; Lai, B.; Mehta, T.; Thirumalai, M.; Padalabalanarayanan, S.; Rimmer, J.H.; Motl, R.W. Exercise Training Guidelines for Multiple Sclerosis, Stroke, and Parkinson Disease: Rapid Review and Synthesis. Am. J. Phys. Med. Rehabil. 2019, 98, 613–621. [Google Scholar]
  7. Ronai, P.; LaFontaine, T.; Bollinger, L. Exercise Guidelines for Persons With Multiple Sclerosis. Strength Cond. J. 2011, 33, 30–33. [Google Scholar] [CrossRef]
  8. Sandoval, A.E.G. Exercise in multiple sclerosis. Phys. Med. Rehabil. Clin. N. Am. 2013, 24, 605–618. [Google Scholar]
  9. Halabchi, F.; Alizadeh, Z.; Sahraian, M.A.; Abolhasani, M. Exercise prescription for patients with multiple sclerosis; potential benefits and practical recommendations. BMC Neurol. 2017, 17, 185. [Google Scholar] [CrossRef]
  10. Manca, A.; Dvir, Z.; Deriu, F. Meta-analytic and scoping study on strength training in people with multiple sclerosis. J. Strength Cond. Res. 2019, 33, 874–889. [Google Scholar] [CrossRef]
  11. Reynolds, E.R.; Ashbaugh, A.D.; Hockenberry, B.J.; McGrew, C.A. Multiple Sclerosis and Exercise. Curr. Sports Med. Rep. 2018, 17, 31–35. [Google Scholar] [CrossRef] [PubMed]
  12. Kraemer, W.J.; Adams, K.; Cafarelli, E.; Dudley, G.A.; Dooly, C.; Feigenbaum, M.S.; Fleck, S.J.; Franklin, B.; Fry, A.C.; Hoffman, J.R.; et al. Progression models in resistance training for healthy adults. Med. Sci. Sports Exerc. 2002, 34, 364–380. [Google Scholar] [CrossRef] [PubMed]
  13. Zdero, R.; Borkowski, M.M.; Coirault, C. Measuring the Contraction Force, Velocity, and Length of Skeletal Muscle. In Experimental Methods in Orthopaedic Biomechanics; Elsevier: Amsterdam, The Netherlands, 2017; pp. 363–378. [Google Scholar]
  14. Ratamees, N.A.; Alvar, B.A.; Evetoch, T.K.; Housh, T.J.; Kibler, B.; Kraemer, W.J.; Triplett, N.T. Progression models in resistance training for healthy adults. Med. Sci. Sport. Exerc. 2009, 41, 687–708. [Google Scholar]
  15. Milo, R.; Miller, A. Revised diagnostic criteria of multiple sclerosis. Autoimmun. Rev. 2014, 13, 518–524. [Google Scholar] [CrossRef] [PubMed]
  16. Kurtzke, J.F. Rating neurologic impairment in multiple sclerosis: An expanded disability status scale (EDSS). Neurology 1983, 33, 1444–1452. [Google Scholar] [CrossRef] [Green Version]
  17. Chung, L.H.; Remelius, J.G.; Van Emmerik, R.E.A.; Kent-Braun, J.A. Leg power asymmetry and postural control in women with multiple sclerosis. Med. Sci. Sports Exerc. 2008, 40, 1717–1724. [Google Scholar] [CrossRef]
  18. Rudroff, T.; Proessl, F. Effects of muscle function and limb loading asymmetries on gait and balance in people with multiple sclerosis. Front. Physiol. 2018, 9, 531. [Google Scholar] [CrossRef]
  19. McDonald, W.I.; Compston, A.; Edan, G.; Goodkin, D.; Hartung, H.P.; Lublin, F.D.; McFarland, H.F.; Paty, D.W.; Polman, C.H.; Reingold, S.C.; et al. Recommended diagnostic criteria for multiple sclerosis: Guidelines from the International Panel on the Diagnosis of Multiple Sclerosis. Ann. Neurol. 2001, 50, 121–127. [Google Scholar] [CrossRef]
  20. De Souza-Teixeira, F.; Costilla, S.; Ayán, C.; García-López, D.; González-Gallego, J.; de Paz, J.A. Effects of resistance training in multiple sclerosis. Int. J. Sports Med. 2009, 30, 245–250. [Google Scholar] [CrossRef]
  21. Medina-Perez, C.; de Souza-Teixeira, F.; Fernandez-Gonzalo, R.; Hernandez-Murua, J.A.; de Paz-Fernandez, J.A. Effects of high-speed power training on muscle strength and power in patients with multiple sclerosis. J. Rehabil. Res. Dev. 2016, 53, 359–368. [Google Scholar] [CrossRef]
  22. Patrocinio de Oliveira, C.E.; Moreira, O.C.; Carrión-Yagual, Z.M.; Medina-Pérez, C.; de Paz, J.A. Effects of Classic Progressive Resistance Training Versus Eccentric-Enhanced Resistance Training in People With Multiple Sclerosis. Arch. Phys. Med. Rehabil. 2018, 99, 819–825. [Google Scholar] [CrossRef]
  23. Gearhart, R.F.; Lagally, K.M.; Riechman, S.E.; Andrews, R.D.; Robertson, R.J. Safety of using the adult OMNI Resistance Exercise Scale to determine 1-RM in older men and women. Percept. Mot. Skills 2011, 113, 671–676. [Google Scholar] [CrossRef]
  24. Farrell, J.W.; Motl, R.W.; Learmonth, Y.C.; Pilutti, L.A. Persons with Multiple Sclerosis Exhibit Strength Asymmetries in both Upper and Lower Extremities. Physiotherapy 2020. [Google Scholar] [CrossRef]
  25. Willumsen, J.S.; Aarseth, J.H.; Myhr, K.M.; Midgard, R. High incidence and prevalence of MS in Møre and Romsdal County, Norway, 1950–2018. Neurol. Neuroimmunol. Neuroinflammation 2020, 7. [Google Scholar] [CrossRef] [Green Version]
  26. Kister, I.; Bacon, T.E.; Chamot, E.; Salter, A.R.; Cutter, G.R.; Kalina, J.T.; Herbert, J. Natural history of multiple sclerosis symptoms. Int. J. MS Care 2013, 15, 146–158. [Google Scholar] [CrossRef] [Green Version]
  27. Svestkova, O.; Angerova, Y.; Sladkova, P.; Bickenbach, J.E.; Raggi, A. Functioning and disability in traumatic brain injury. Disabil. Rehabil. 2010, 32, S68–S77. [Google Scholar] [CrossRef]
  28. Wang, L.; Qi, C.H.; Zhong, R.; Yuan, C.; Zhong, Q.Y. Efficacy of alemtuzumab and natalizumab in the treatment of different stages of multiple sclerosis patients. Medicine (USA) 2018, 97. [Google Scholar] [CrossRef]
  29. Haselkorn, J.K.; Hughes, C.; Rae-Grant, A.; Henson, L.J.; Bever, C.T.; Lo, A.C.; Brown, T.R.; Kraft, G.H.; Getchius, T.; Gronseth, G.; et al. Summary of comprehensive systematic review: Rehabilitation in multiple sclerosis. Neurology 2015, 85, 1896–1903. [Google Scholar]
  30. Meyer-Moock, S.; Feng, Y.S.; Maeurer, M.; Dippel, F.W.; Kohlmann, T. Systematic literature review and validity evaluation of the Expanded Disability Status Scale (EDSS) and the Multiple Sclerosis Functional Composite (MSFC) in patients with multiple sclerosis. BMC Neurol. 2014, 14, 58. [Google Scholar] [CrossRef] [Green Version]
  31. Naci, H.; Fleurence, R.; Birt, J.; Duhig, A. The impact of increasing neurological disability of multiple sclerosis on health utilities: A systematic review of the literature. J. Med. Econ. 2010, 13, 78–89. [Google Scholar]
  32. Kjølhede, T.; Vissing, K.; Langeskov-Christensen, D.; Stenager, E.; Petersen, T.; Dalgas, U. Relationship between muscle strength parameters and functional capacity in persons with mild to moderate degree multiple sclerosis. Mult. Scler. Relat. Disord. 2015, 4, 151–158. [Google Scholar] [CrossRef]
  33. Gutierrez, G.M.; Chow, J.W.; Tillman, M.D.; McCoy, S.C.; Castellano, V.; White, L.J. Resistance training improves gait kinematics in persons with multiple sclerosis. Arch. Phys. Med. Rehabil. 2005, 86, 1824–1829. [Google Scholar] [CrossRef] [PubMed]
  34. Dalgas, U.; Stenager, E.; Jakobsen, J.; Petersen, T.; Hansen, H.J.; Knudsen, C.; Overgaard, K.; Ingemann-Hansen, T. Resistance training improves muscle strength and functional capacity in multiple sclerosis. Neurology 2009, 73, 1478–1484. [Google Scholar] [CrossRef]
  35. Ayán Pérez, C.; Martín Sánchez, V.; De Souza Teixeira, F.; De Paz Fernández, J.A. Effects of a resistance training program in multiple sclerosis Spanish patients: A pilot study. J. Sport Rehabil. 2007, 16, 143–153. [Google Scholar] [CrossRef] [PubMed]
  36. Lanza, M.B.; Balshaw, T.G.; Folland, J.P. Do changes in neuromuscular activation contribute to the knee extensor angle–torque relationship? Exp. Physiol. 2017, 102, 962–973. [Google Scholar] [CrossRef]
  37. Rochette, L.; Hunter, S.K.; Place, N.; Lepers, R. Activation varies among the knee extensor muscles during a submaximal fatiguing contraction in the seated and supine postures. J. Appl. Physiol. 2003, 95, 1515–1522. [Google Scholar] [CrossRef] [Green Version]
  38. Ema, R.; Wakahara, T.; Kawakami, Y. Effect of hip joint angle on concentric knee extension torque. J. Electromyogr. Kinesiol. 2017, 37, 141–146. [Google Scholar] [CrossRef]
  39. McHugh, M.P.; Tetro, D.T. Changes in the relationship between joint angle and torque production associated with the repeated bout effect. J. Sports Sci. 2003, 21, 927–932. [Google Scholar] [CrossRef]
  40. Surakka, J.; Romberg, A.; Ruutiainen, J.; Virtanen, A.; Aunola, S.; Mäentaka, K. Assessment of muscle strength and motor fatigue with a knee dynamometer in subjects with multiple sclerosis: A new fatigue index. Clin. Rehabil. 2004, 18, 652–659. [Google Scholar] [CrossRef]
  41. Lum, D.; Haff, G.G.; Barbosa, T.M. The Relationship between Isometric Force-Time Characteristics and Dynamic Performance: A Systematic Review. Sports 2020, 8, 63. [Google Scholar] [CrossRef]
  42. Brauers, L.; Rameckers, E.; Severijns, D.; Feys, P.; Smeets, R.; Klingels, K. Measuring Motor Fatigability in the Upper Limbs in Individuals With Neurologic Disorders: A Systematic Review. Arch. Phys. Med. Rehabil. 2020, 101, 907–916. [Google Scholar] [CrossRef] [PubMed]
  43. Dodds, R.M.; Syddall, H.E.; Cooper, R.; Kuh, D.; Cooper, C. Avan Aihie Sayer Global variation in grip strength: A systematic review and meta-analysis of normative data. Age Ageing 2016, 45, 209–216. [Google Scholar] [CrossRef] [Green Version]
  44. White, L.J.; McCoy, S.C.; Castellano, V.; Gutierrez, G.; Stevens, J.E.; Walter, G.A.; Vandenborne, K. Resistance training improves strength and functional capacity in persons with multiple sclerosis. Mult. Scler. 2004, 10, 668–674. [Google Scholar] [CrossRef]
  45. Goldenberg, M.M. Multiple sclerosis review. Pharm. Ther. 2012, 37, 175–184. [Google Scholar]
  46. Ramari, C.; Hvid, L.G.; de David, A.C.; Dalgas, U. The importance of lower-extremity muscle strength for lower-limb functional capacity in multiple sclerosis: Systematic review. Ann. Phys. Rehabil. Med. 2020, 63, 123–137. [Google Scholar] [CrossRef]
  47. Sandroff, B.M.; Sosnoff, J.J.; Motl, R.W. Physical fitness, walking performance, and gait in multiple sclerosis. J. Neurol. Sci. 2013, 328, 70–76. [Google Scholar] [CrossRef] [PubMed]
  48. Van Emmerik, R.E.A.; Remelius, J.G.; Johnson, M.B.; Chung, L.H.; Kent-Braun, J.A. Postural control in women with multiple sclerosis: Effects of task, vision and symptomatic fatigue. Gait Posture 2010, 32, 608–614. [Google Scholar] [CrossRef]
  49. Larson, R.D.; McCully, K.K.; Larson, D.J.; Pryor, W.M.; White, L.J. Bilateral differences in lower-limb performance in individuals with multiple sclerosis. J. Rehabil. Res. Dev. 2013, 50, 215–222. [Google Scholar] [CrossRef]
  50. Proessl, F.; Ketelhut, N.B.; Rudroff, T. No association of leg strength asymmetry with walking ability, fatigability, and fatigue in multiple sclerosis. Int. J. Rehabil. Res. 2018, 41, 267–269. [Google Scholar] [CrossRef] [PubMed]
  51. Dai, B.; Layer, J.; Vertz, C.; Hinshaw, T.; Cook, R.; Li, Y.; Sha, Z. Baseline Assessments of Strength and Balance Performance and Bilateral Asymmetries in Collegiate Athletes. J. Strength Cond. Res. 2019, 33, 3015–3029. [Google Scholar] [CrossRef]
  52. Ithurburn, M.P.; Paterno, M.V.; Ford, K.R.; Hewett, T.E.; Schmitt, L.C. Young athletes with quadriceps femoris strength asymmetry at return to sport after anterior cruciate ligament reconstruction demonstrate asymmetric single-leg drop-landing mechanics. Am. J. Sports Med. 2015, 43, 2727–2737. [Google Scholar] [CrossRef] [PubMed]
  53. Bishop, C.; Turner, A.; Read, P. Effects of inter-limb asymmetries on physical and sports performance: A systematic review. J. Sports Sci. 2018, 36, 1135–1144. [Google Scholar] [CrossRef]
  54. McGrath, T.M.; Waddington, G.; Scarvell, J.M.; Ball, N.B.; Creer, R.; Woods, K.; Smith, D. The effect of limb dominance on lower limb functional performance—A systematic review. J. Sports Sci. 2016, 34, 289–302. [Google Scholar] [CrossRef] [PubMed]
  55. Sarabon, N.; Kozinc, Z.; Bishop, C.; Maffiuletti, N.A. Factors influencing bilateral deficit and inter-limb asymmetry of maximal and explosive strength: Motor task, outcome measure and muscle group. Eur. J. Appl. Physiol. 2020, 120, 1681–1688. [Google Scholar] [CrossRef]
Table 1. Characteristics of the sample according to gender.
Table 1. Characteristics of the sample according to gender.
VariablesMaleFemale
Mean SDMaxMinMean SDMaxMinp
Age (years) 44.5±1.675546.3±10.869200.288
BMI/ kg (m2)25±3.636.89.824.5±436.416.70.188
Years of evolution9.7±8.24109.9±7.53400.338
EDSS3.7±2.1803.5±28.500.854
BMI = body mass index; EDSS = Expanded Disability Status Scale; SD = standard deviation.
Table 2. Sample level disability by gender and the type of multiple sclerosis.
Table 2. Sample level disability by gender and the type of multiple sclerosis.
VariablesLevelMaleFemale
PPRRSPTotalPPRRSPTotal
Level EDSSMild1141557882797
Moderate103685412681797
Severe4131936111713 41
Very Severe1012141 6
Total 26 90 33 149 32 171 38 241
PP = Primary—Progressive; RR = Relapsing—Remitting; SP = Secondary-Progressive; EDSS = Expanded Disability Status Scale.
Table 3. Strength values by gender.
Table 3. Strength values by gender.
VariablesMaleFemale
Mean SDMaxMinMean SDMaxMinp
1RM Bil.86.8±26.8 *160.016.058.7±21.8120.06.00.000
1RM Right46.9±16.5 *90.014.028.4±10.659.08.00.000
1RM Left49.3±17 *90.021.029.4±11.455.00.00.000
MVIC Bil.97.9±31.3 *182.624.862.9±19.6117.016.30.000
MVIC Right46.3±16.3 *101.610.031.0±10.362.15.40.000
MVIC Left47.2±17.4 *108.64.530.7±10.456.59.00.000
Asymmetry 1RM10.8±14.957.60.011.0±17.074.20.00.952
Asymmetry MVIC20.3±16.378.40.217.5±15.278.60.00.162
The strength is expressed in kilogram_force (Kg_f). MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; Bil. = bilateral; asymmetry is indicated in %; SD = standard deviation; Max = maximum value; Min = minimum value; * = significant difference between genders. Asymmetry is indicated in percentage values.
Table 4. Age, years of evolution, and force variables by type of multiple sclerosis.
Table 4. Age, years of evolution, and force variables by type of multiple sclerosis.
VariablesPP(P)RR (R)SP (S)
Mean SDMaxMinMeanSDMaxMinMeanSDMaxMinp
Age51.8±10.9 R,S70542.1±9.7 S682050.6±11.475290.000
Years of evolution6.8±7.2 R,S3209.8±7.341012.1±8.83400.002
1RM Bil.65.4±271201471.8±27.2160661.5±27.4130120.080
1RM Right31.8±15.1641334.6±15.490836.8±1777180.653
1RM Left37.8±17.6751635.9±1690032.8±18.172100.663
MVIC Bil.73.5±27.8141.227.980.7±30.5 S182.619.565.3±29.4144.716.30.002
MVIC Right33.7±13.265.813.538.9±14.8 S101.61031.9±14.970.45.40.007
MVIC Left36.2±15.766.49.338.7±15.9 S108.6931.4±15.1714.50.020
Asymmetry 1RM19.1±18.055.609.9±15.974.20.06.3±10.629.00.00.540
Asymmetry MVIC20.5±13.852.00.316.1±14.3 S78.40.026.6±17.874.30.50.000
The strength is expressed in kilogram_force (Kg_f). MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; Bil. = bilateral; asymmetry is indicated in %; SD = standard deviation; Max = maximum value; Min = minimum value. PP = Primary-Progressive; RR = Relapsing–Remitting; SP = Secondary-Progressive. Letters (P, R, S) indicate significant differences between groups. Asymmetry is indicated in percentage values.
Table 5. Age, years of evolution, and force variables by neurological disability level.
Table 5. Age, years of evolution, and force variables by neurological disability level.
VariablesMild (L) Moderate (M) Severe (S)
Mean SDMaxMinMean SDMaxMinMean SDMaxMinp
Age40.5±10.9 M,S67547.1±9.9752550±11.564330.000
Years of evolution8.1±7.2S34010.5±7.328011.4±8.94100.019
1RM Bil.77.5±24 M,S1302365.8±26.61601558.6±30.815060.001
1RM Right37.9±14.8771832.5±16.690829.6±13.955130.100
1RM Left39.1±16.285033.3±18901029.2±11.255170.081
MVIC Bil.87.7±28.1 M,S1794072±29.5176.116.362.1±27.9161.319.20.000
MVIC Right41.9±13.6 M,S10222.435±13.68711.128.9±14.165.55.40.000
MVIC Left41.3±14 M,S81.61235.5±1689.11029.2±13.664.74.50.000
Asymmetry 1RM8.5±10.7 37.30.011.0 ±19.074.20.013.8±18.757.60.00.235
Asymmetry MVIC13.8±11.8 M,S62.50.0 19.5±14.7 S67.70.026.2±18.574.30.20.000
The strength is expressed in kilogram_force (Kg_f). MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; Bil. = bilateral; asymmetry is indicated in %; SD = standard deviation; Max = maximum value; Min = minimum value. Letters (L, M, S) indicate significant differences between groups. Asymmetry is indicated in percentage values.
Table 6. Quartiles of force variables of sample by type of Multiple Sclerosis.
Table 6. Quartiles of force variables of sample by type of Multiple Sclerosis.
VariablesPPRRSP
Q1_Q2Q2_Q3Q3_Q4Q1_Q2Q2_Q3Q3_Q4Q1_Q2Q2_Q3Q3_Q4
1RM Bil.45.061.083.051.268.090.045.055.075.0
1RM Right16.030.042.022.533.044.525.027.050.0
1RM Left25.035.052.059.973.597.319.030.09.0
MVIC Bil.53.066.096.528.637.146.045.256.281.0
MVIC Right22.831.742.628.136.046.022.330.337.3
MVIC Left24.730.151.228.136.047.820.128.939.3
Asymmetry 1RM20.923.537.315.4243421.82628.4
Asymmetry MVIC21.525.132.415.120.530.617.228.441.1
The strength is expressed in kilogram_force (Kg_f). MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; Bil. = bilateral; asymmetry is indicated in %; SD = standard deviation; Max = maximum value; Min = minimum value. PP = Primary-Progressive; RR = Relapsing–Remitting; SP = Secondary-Progressive. Asymmetry is indicated in percentage values.
Table 7. Quartiles of force variables of sample by EDSS degree.
Table 7. Quartiles of force variables of sample by EDSS degree.
VariablesMildModerateSevere
Q1_Q2Q2_Q3Q3_Q4Q1_Q2Q2_Q3Q3_Q4Q1_Q2Q2_Q3Q3_Q4
1RM Bil.59.075.090.047.065.075.037.555.078.0
1RM Right25.033.046.520.028.542.017.226.542.0
1RM Left28.036.549.720.030.042.021.025.035.0
MVIC Bil.67.181.9100.352.864.778.546.056.180.1
MVIC Right31.939.848.524.731.845.118.627.337.5
MVIC Left31.038.750.623.031.541.119.528.938.8
Asymmetry 1RM15.320.924.71931.55123.531.936
Asymmetry MVIC16.122.727.816.624.235.120.131.144.4
The strength is expressed in kilogram_force (Kg_f). MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; Bil. = bilateral; asymmetry is indicated in %; SD = standard deviation; Max = maximum value; Min = minimum value. PP = Primary-Progressive; RR = Relapsing–Remitting; SP = Secondary-Progressive. Asymmetry is indicated in percentage values.
Table 8. Asymmetry of men and women.
Table 8. Asymmetry of men and women.
VariablesMaleFemale
MeanSDMaxMin%MeanSDMaxMin%p
Asymmetry 1RM 25.713.557.610.239.531.317.474.210.731.20.295
Asymmetry MVIC27.114.878.410.670.426.513.978.610.1600.776
MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; asymmetry is indicated in percentage values; % = percentage of patients presenting non-normal asymmetry.
Table 9. Asymmetry of sample by type of multiple sclerosis.
Table 9. Asymmetry of sample by type of multiple sclerosis.
VariablesMultiple Sclerosis Type
PP (P)RR (R)SP (S)
Mean SDMaxMin%Mean SDMaxMin%Mean SDMaxMin%p
Asymmetry 1RM 30.5±14.155.614.76028.2±1774.210.23025.1±4.32919.4200.845
Asymmetry MVIC27.6±9.552.010.86624.8±1378.410.15630.8±1674.310.4790.071
MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; asymmetry is indicated in percentage values; % = percentage of patients presenting non-normal asymmetry. PP = Primary-Progressive; RR = Relapsing–Remitting; SP = Secondary-Progressive.
Table 10. Asymmetry of sample by neurological disability level.
Table 10. Asymmetry of sample by neurological disability level.
VariablesNeurological Disability Level
Mild (L)Moderate (M)Severe (S)
Mean SDMaxMin%Mean SDMaxMin%Mean SDMaxMin%p
Asymmetry 1RM 21.3±8.2M37.310.23135.9±2074.214.72634±1357.622.9350.018
Asymmetry MVIC 23.1±9.9S62.510.23426.4±1367.710.16032.9±1674.310.7630.004
MVIC = maximal voluntary isometric contraction; 1RM = one repetition maximum; asymmetry is indicated in percentage values; % = percentage of patients presenting non-normal asymmetry.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Portilla-Cueto, K.; Medina-Pérez, C.; Romero-Pérez, E.M.; Hernández-Murúa, J.A.; Patrocinio de Oliveira, C.E.; Souza-Teixeira, F.d.; González-Bernal, J.J.; Vila-Chã, C.; de Paz, J.A. Reference Values for Isometric, Dynamic, and Asymmetry Leg Extension Strength in Patients with Multiple Sclerosis. Int. J. Environ. Res. Public Health 2020, 17, 8083. https://doi.org/10.3390/ijerph17218083

AMA Style

Portilla-Cueto K, Medina-Pérez C, Romero-Pérez EM, Hernández-Murúa JA, Patrocinio de Oliveira CE, Souza-Teixeira Fd, González-Bernal JJ, Vila-Chã C, de Paz JA. Reference Values for Isometric, Dynamic, and Asymmetry Leg Extension Strength in Patients with Multiple Sclerosis. International Journal of Environmental Research and Public Health. 2020; 17(21):8083. https://doi.org/10.3390/ijerph17218083

Chicago/Turabian Style

Portilla-Cueto, Kora, Carlos Medina-Pérez, Ena Monserrat Romero-Pérez, José Aldo Hernández-Murúa, Claudia Eliza Patrocinio de Oliveira, Fernanda de Souza-Teixeira, Jerónimo J González-Bernal, Carolina Vila-Chã, and José Antonio de Paz. 2020. "Reference Values for Isometric, Dynamic, and Asymmetry Leg Extension Strength in Patients with Multiple Sclerosis" International Journal of Environmental Research and Public Health 17, no. 21: 8083. https://doi.org/10.3390/ijerph17218083

APA Style

Portilla-Cueto, K., Medina-Pérez, C., Romero-Pérez, E. M., Hernández-Murúa, J. A., Patrocinio de Oliveira, C. E., Souza-Teixeira, F. d., González-Bernal, J. J., Vila-Chã, C., & de Paz, J. A. (2020). Reference Values for Isometric, Dynamic, and Asymmetry Leg Extension Strength in Patients with Multiple Sclerosis. International Journal of Environmental Research and Public Health, 17(21), 8083. https://doi.org/10.3390/ijerph17218083

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop