Next Article in Journal
Design of a Spark Big Data Framework for PM2.5 Air Pollution Forecasting
Previous Article in Journal
Urinary Incontinence in Adulthood in a Course of Ectopic Ureter—Description of Two Clinical Cases with Review of Literature
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Relationship between Musculoskeletal Disorders and Work Performance of Nursing Staff: A Comparison of Hospital Nursing Departments

1
Department of Creative Product Design, Southern Taiwan University of Science and Technology, Tainan 710301, Taiwan
2
Department of Medical Research, School of Nursing, Kaohsiung Medical University Hospital, Kaohsiung 807378, Taiwan
3
School of Nursing, The State University of New York, University at Buffalo, New York, NY 14214-3079, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(13), 7085; https://doi.org/10.3390/ijerph18137085
Submission received: 28 May 2021 / Revised: 30 June 2021 / Accepted: 30 June 2021 / Published: 2 July 2021
(This article belongs to the Section Occupational Safety and Health)

Abstract

:
This study aimed to explore the relationship between musculoskeletal disorders and the work performance of nursing staff. This cross-sectional study used the Checklist for Musculoskeletal Disorders (MSDs), the Nordic Musculoskeletal Questionnaire (NMQ), and the Work Ability Index to survey the prevalence of MSDs, as well as to determine the impact of MSDs on 117 nursing staff working in an emergency department, an intensive care unit, and general wards. The findings indicate that the nursing staff were exposed to a workplace environment with a high risk of MSDs. Nursing staff in the emergency department were at a particularly high risk of MSDs in their upper and lower limbs, while those working in the intensive care unit had a particularly high risk of injuries caused by manual material handling. Analyzing the relationship between MSD risk factors and NMQ scores showed a 6 times, 3.25 times, and 2.28 times increase in MSD conditions with a high workload compared to a low workload in the hand and wrist, the lower back or waist, and the knee, respectively. Medium and high workloads were found to increase the risk of MSD, which in turn affected the work ability of the nurses.

1. Introduction

The primary functions of the musculoskeletal system include enabling motion, offering protection, supporting the body, and maintaining body homeostasis. Overexertion, fatigue, prolonged loads, insufficient oxygen, and repetitive activities can reduce muscle contraction [1]. Lack of rest may induce injury risks. Musculoskeletal disorders (MSDs) involve pain and inflammation in body tissues (e.g., muscles, tendons, and nerves), reduced motor function, or muscle/bone discomfort caused by the continuous exertion of force and repeated movements [2]. Generally, MSDs are soft tissue inflammation in the body or degenerative diseases such as tendinitis, muscle strain, joint degeneration, nerve compression, or tenosynovitis. Symptoms of MSDs include pain, soreness, swelling, and restriction of posture angle. In addition to acute trauma, MSDs are mostly caused by chronic injuries attributable to long-term poor posture, repetitive movements, improper force exertion, and overloading [3].
Long-term clinical work subjects nurses to occupational risks for MSDs. The Occupational Hazards Survey conducted in the United States in 1984 revealed that the medical service industry ranked fourth in terms of occupational injury and illness incidence rate. Nursing staff accounted for 10.9% of the reported cases. Usually occupying two-fifths to one-half of total hospital staff, nurses are directly exposed to occupational hazards and risks (e.g., needle-stick injuries, violence, chemical exposure, over-exertion, and work-related stress) when delivering first-line clinical care. Prolonged standing and repetitive tasks such as handling/carrying objects, assisting with patient handling, changing patient wound dressings, injections, and turning patients over in bed render nurses as a group at high risk of MSDs [4,5,6,7,8]. Nursing staff are occupied with complicated work tasks and must handle various clinical tasks under time constraints and considerable stress. The literature indicates that the medical institution level, workload, job satisfaction, working hours, work-related stress, organizational climate and support, physical load of individuals, job tenure, gender, and exercise habits all affect the incidence rate of MSDs, which mostly occur in the shoulders, neck, or lower back [9,10,11,12,13,14,15,16,17,18]. Although not fatal, MSDs are likely to reduce work efficiency and quality of life because of the long disease course and become a factor in high turnover rates among nursing staff [7,19].
Nursing staff spend approximately 20% of their working time handling and moving patients [20]. According to the results of a survey conducted by the American Nurses Association in 2011, 62% of the nursing staff surveyed were highly concerned about MSDs, and 56% of the nursing staff developed MSDs or experienced worsened injuries or illnesses from work [21]. In Taiwan, only a few published studies have investigated MSDs among nurses, and were either conducted as a population-based study using diagnostic codes from the National Health Insurance Research Database [22], or surveys using self-report questionnaires without complementary objective evaluations [23,24]. Therefore, this study aims to improve understanding of the settings that contribute to MSDs in nurses. The objectives of this study were: (1) to survey work risk factors for MSDs in nurses using the ergonomic-based checklist for MSDs (hereafter, the “Checklist for MSDs”), explore MSD prevalence and work ability using the self-reported Nordic Musculoskeletal Questionnaire (NMQ) and Work Ability Index; and (2) to analyze relationship between MSD risk factors, MSD conditions, and work ability among nurses from different departments in the hospital.

2. Materials and Methods

2.1. Research Design

Based on a cross-sectional design, this study explored the relationship between the Checklist for MSDs and the Work Ability Index of nursing staff.

2.2. Participants and Setting

We recruited nursing staff from a teaching hospital in southern Taiwan with the following inclusion criteria: nursing staff with at least 3 years of seniority and aged no older than 45 years. Those who had painful sequelae from a traumatic injury (e.g., automobile accident or fall) or were pregnant were excluded. After an explanation of the study objectives by the researchers, the participants were asked to sign a consent form and complete the questionnaire. Subjects were recruited from each department by verbal invitation and joined the study on a voluntary basis, and stratified sampling was used based on the number of different units, such as the emergency department, the intensive care unit, and general wards. The general wards in this particular hospital are mostly admissions requiring medical-surgical care.

2.3. Research Data Collection

The research design for this study was approved by the Institutional Review Board of Chang Gung Medical Foundation (IRB No.: 201700922B0; date of approval: 25 July 2017). Data collection was conducted after obtaining the consent of the clinical ethics committee. Before data collection, an explanation was provided to the nursing departments of the hospital, and a trained, experienced research assistant was assigned to each nursing department to observe, evaluate, and interview nursing staff.

2.4. Research Tools

A scale-based assessment questionnaire was used to collect data for analysis, which included demographic data, the Checklist for MSDs for objective assessment of workload during work, the NMQ to characterize MSD symptoms, and the Work Ability Index to explore the effects of MSDs on work. All the surveys were paper-and-pencil.

2.4.1. Demographic Data

The demographic data were gender, age, height, weight, corresponding department, pregnancy history (for women only), frequency of exercise, tobacco use, and dominant hand.

2.4.2. The Checklist for MSDs

This checklist was designed by the United States Occupational Safety and Health Administration with a focus on identifying combinations of the most common and influential risk factors contributing to MSD [25]. The Chinese version of the checklist promoted by Taiwan’s Institute of Occupational Safety and Health (IOSH) is part of a government publication (in Chinese) freely available on the internet [26]. When evaluating across various occupations, the Checklist for MSDs was found to have an overall sensitivity of 0.537 and a specificity of 0.654 [27]. This observation checklist comprises two main scales. Scale I assess the risk factors of the upper limbs, and Scale II assesses the risk factors of the back and the lower limbs. There is also a Scale III, which is considered a part of Scale II. Scale III assesses risk factors in manual material handling, and its total score should be combined with Scale II’s score in calculation.
Scale I covers seven major risk factors, namely repetitive tasks (finger, wrist, elbow, and shoulder or neck movements), hand exertion (repetitive tasks or static loads), poor posture, contact pressure, vibration, environment, and control of working speed. Scale II consists of five major risk factors, namely poor posture (a repetitive posture or static posture), contact pressure, vibration, push/pull, and control of working speed. Scale III assesses the risk factors of manual material handling, such as weight, position, frequency, posture, walking distance, and duration. Each risk factor in the checklist has its own scoring standard; the score increases with working hours.
To determine the risk factor of each participant, the risk factor items in Sections A and B of Scales I and II were cross-referenced through observation during the study. The risk factor items were placed in respective sections corresponding to working hours. Sections C, D, and E, respectively, refer to 2–4 working hours, 4–8 working hours, and >8 working hours (with 0.5 added for each additional hour). The scores of Sections C–E were summarized in Section F. Scale III’s total score was combined into Scale II’s score in the calculation. Regardless of the scale, the higher the score, the more dangerous the job. If an individual receives a total score of >5 points on either Scale I or Scale II, their job is considered to be high risk for MSDs.
The Checklist for MSDs is usually administered by a trained observer who follows along throughout the subject’s workday and evaluates the latter’s hazards for occupational injuries while doing work. For this study, the Checklist for MSDs was performed by a research assistant observing the subject’s entire workday, except for breaks, to rate the subject’s different postures during work against the checklist. Photos of the different postures for work were also taken during the observation.

2.4.3. Nordic Musculoskeletal Questionnaire (NMQ)

Developed by a team of northern European researchers, this standardized questionnaire assesses work-related musculoskeletal symptoms and injuries common among operators in a workplace. Based on the subjective opinions of participants, this questionnaire investigates nine common work-related musculoskeletal symptom sites, namely the neck, shoulders, upper back, lower back or waist, elbows, hands or wrists, hips or thighs, knees, and ankles or feet. This questionnaire has been widely and internationally applied for the classification and investigation of occupational injuries, with a reliability ranging from 77% to 100% and a validity ranging from 80% to 100% [28]. The Chinese version of the NMQ commonly used in Taiwan was published as a part of MSD prevention guidelines [29], its content validity index (CVI) was found to be 0.85 as assessed by specialists in nursing, public health, ergonomics, statistics, and physicians, while its coefficient of correlation was 0.92 for work status and 0.93 for musculoskeletal disorders [30].

2.4.4. Work Ability Index

Developed by the Finnish Institute of Occupational Health in 1980, the Work Ability Index evaluates individual work competency, future job requirements, and physical and psychological work performance. This index can also be used to monitor individuals or groups. Translated by the Ministry of Labor in 2010 with a retest reliability of 0.81, construct validity of 0.80, and Cronbach’s alpha of 0.74 [31], the Chinese version of the Work Ability Index used in this study covers the following seven areas: (1) current work ability compared with one’s lifetime best; (2) work ability in relation to the demands of the job; (3) number of current diseases and injuries diagnosed by a physician; (4) estimated work impairment due to disease and injury; (5) amount of sick leave taken during the previous 12 months; (6) self-prognosis of work ability 2 years into the future; and (7) mental resources.

2.5. Statistical Analysis

Variance in the results was analyzed using SPSS v22.0 statistical software (IBM Corp., New York, NY, USA), and post hoc analyses were conducted using the least significant differences (LSD) test. The data were expressed as mean ± standard error (SE). Categorical variables were analyzed using the chi-square test. In the logistic regression model was used to estimate the Checklist for MSDs, NMQ, and Work Ability Index on the probability of hazard ratio. The level of significance used for all analyses was α < 0.05.

3. Results

3.1. Demographic Data

A total of 117 nurses from the emergency department, intensive care unit, and general wards participated in the study. According to the demographic data (Table 1), a wide gender gap existed: 115 (98.3%) of the participants were women, and 2 (1.7%) were men. In terms of pregnancy history, 33 (28.2%) and 84 (71.8%) of the participants had and had not experienced pregnancy, respectively. The participants in the emergency department and the intensive care unit had the lowest (30.7 years) and highest (31.2 years) mean age, respectively. Regarding frequency of exercise, 47 (40%) and 10 (8.3%) of the staff rarely exercised and exercised at least once a week, respectively. One (0.8%) nurse in the intensive care unit smoked tobacco. Finally, most (96.7%) of the participants were right-handed.

3.2. The Checklist for MSDs

3.2.1. Risk Factors for Upper Limbs

We discovered that all 117 subjects had a score over 5 in either Scale I or Scale II of the Checklist for MSDs, suggesting that they are all at a high risk of MSDs. Analysis of variance (ANOVA) showed a significant difference between the three departments for risk in the upper limbs (F(2.114) = 6.31, p =  0.003). The post hoc test showed a higher proportion with high risk in the emergency department (22.32) and in general wards (21.85) than those working in the intensive care unit (20.24). Observation revealed that nursing staff frequently switched between standing and sitting positions while working. Because the computer stand or mobile medical cart failed to match the height of each staff member, nursing staff had to lean forward to review the information displayed on the screen, which caused them to remain in a poor posture for long periods.

3.2.2. Risk Factors for Lower Limbs

According to the ANOVA results, significant differences were present in the risk factors for lower limbs among participants in different departments (F(2.114) = 32.22, p < 0.001). The post hoc test showed that the highest risk factor score was observed for the participants in the emergency department (17.36), followed by those in general wards (12.51) and those in the intensive care unit (10.89). Through observation, we discovered that nursing staff had to exert great force to push and pull wheelchairs and hospital beds, step on a pedal to switch between fixed and mobile modes of hospital beds, and lean forward and bend sideways when carrying patients to the wheelchair or hospital bed or helping them transfer. The nursing staff in the emergency department and general wards were constantly standing and walking. Therefore, they both received a mean score of 0.6 on postures without leg support, which was much higher than the score yielded by the nursing staff from the intensive care unit. In addition, the nursing staff in the emergency department received a mean score on kneeling and squatting postures that was much higher than those received by the nursing staff in the intensive care unit and general wards.

3.2.3. Risk Factors for Manual Material Handling

According to the ANOVA results, the participants differed significantly by department in manual material handling risks (F(2.114) = 50.45, p < 0.001). The post hoc test showed that the participants in the intensive care unit (9.91) were exposed to much greater manual material handling risks than the participants in the emergency department (5.64) and general wards (5.98) were. Through observation, we discovered that patients in the intensive care unit were confined to bed all day, where they received more rigorous and comprehensive care. To prevent the occurrence of pressure ulcers caused by prolonged bed rest, nursing staff conducted patient turning and repositioning several times a day, as well as giving sponge baths. The nursing staff in the emergency department and general wards did not or rarely performed the aforementioned tasks because most of their patients were able to move on their own. This explained why the participants in the intensive care unit received higher scores in manual material handling risks.

3.3. Nordic Musculoskeletal Questionnaire (NMQ)

Table 2 presents the MSD prevalence for each body part in the previous year. A higher prevalence of MSD was found in the neck, shoulders, and lower back/waist than in other parts of the body in nurses working in the emergency department (χ2 (8) = 58.14, p < 0.001), the intensive care unit (χ2 (8) = 86.45, p < 0.001), and the general wards (χ2 (8) = 93.44, p < 0.001).
In terms of the “duration of symptoms” for the subjects, 38 (82.7%) nurses working in the intensive care unit reported shoulder discomfort lasting for one month, which is a significantly higher proportion than those working in general wards and in the emergency department (χ2 (2) = 21.16, p < 0.001); for shoulder discomfort lasting over three years, the proportion in nurses working in the intensive care unit (45.7%) and emergency department (52%) was higher (χ2 (2) = 8.41, p = 0.02) than those working in general wards; for wrist discomfort lasting for one month, the proportion in nurses working in the intensive care unit (58.7%) was higher (χ2 (2) = 12.83, p = 0.01) (Table A1 in Appendix A) than those working in the other two departments—these findings suggest that working in the intensive care unit is associated with discomfort in the shoulders and the wrists. In terms of the subjects feeling a “presentation of pain in specific body parts”, the most common presentation was soreness, followed by numbness, then stabbing pain, occurring mostly in the neck, shoulders, upper back, lower back, or waist. Despite there being 10–15 subjects who reported soreness, there was no significant difference between the departments for soreness in the wrists, hips, thighs, knees, and ankles (Table A1 in Appendix A). In terms of the feeling of “affecting work and daily life”, most nurses expressed a slight decrease in the ability to do work. Working ability affected by shoulder symptoms was higher in those working in the intensive care unit and general wards compared to those in the emergency department (χ2 (2) = 14.00, p = 0.001), and one nurse working in the intensive care unit had lower back symptoms that prevented her ability to work. Nurses working in the intensive care unit and general wards who spend a long time standing and stepping on foot pedals to fix or move hospital beds were found to have ankle symptoms compromising their ability to work more than those working in the emergency department (χ2 (2) = 14.57, p = 0.001) (Table A1 in Appendix A).

3.4. Work Ability Index Questionnaire

According to the results of the ANOVA test, significant differences in work ability were observed between participants in different departments (F(2.114) = 4.496, p = 0.013), and the total scores of the Work Ability Index received for the emergency department (31.68) and the intensive care unit (32.48) were significantly lower than the score received for the general wards (34.07), indicating that the nursing staff in the general wards exhibited a greater work ability.

3.5. Hazard Ratio between the Checklist for MSDs and the NMQ

The objective Checklist for MSDs and the subjective NMQ were analyzed to explore the relationship between the workload and the MSDs of nursing staff by using a hazard ratio analysis. The Checklist for MSDs comprises three scales, namely Scales I, II, and III, for assessing the workload of body parts. This workload was analyzed based on the Checklist for MSDs and corresponding body parts in the NMQ.
The objective Checklist for MSDs and the subjective NMQ were analyzed. As Scale I is a checklist of risk factors for the upper limbs, only the two hand-related body parts covered by the NMQ (i.e., “elbows” and “hands and wrists”) were analyzed. Based on the scoring system of Scale I of the Checklist for MSDs, the workload was divided into three levels: low (<19), medium (19–24), and high (>24). The results indicated that medium and high workloads, respectively, induced a 5.75- and a 6-times increase of risk of MSDs in the hands and wrists of the nursing staff (Table 3).
Scale II of the Checklist for MSDs is a checklist of risk factors for the back and lower limbs, and five lower extremity body parts are covered by the NMQ (i.e., upper back, lower back or waist, hips or thighs, knees, and ankles or feet). Based on the scoring system of Scale II of the Checklist for MSDs, the workload was divided into three levels: low (<10), medium (10–14), and high (>14). The results indicated that medium and high workloads, respectively, induced a 1.86- and a 3.25-times higher risk of MSDs in the lower back or waist of the nursing staff, and that medium and high workloads, respectively, induced a 1.75- and 2.28-times higher risk of MSDs in the knees of the nursing staff (Table 4).
Because Scale III of the Checklist for MSDs is a checklist of risk factors for manual material handling, it subdivides the movements of various body parts during handling. Analysis was conducted of movements and the body parts performing these movements. For some movements, all the participants, regardless of department, were categorized into the same group (i.e., either all or none of them performed such movements). Therefore, only three movements that exhibited interdepartmental differences were analyzed, namely rotating the body while handling materials, material handling with one hand, and walking more than 3 m while handling/carrying materials. Because rotating the body while handling materials mainly puts a load on the lower back and waist, this movement was analyzed. Because material handling with one hand mainly puts a load on elbows, hands, and wrists, and because walking more than 3 m while handling/carrying materials requires whole body movement, all body parts covered by the NMQ were analyzed. The results are shown in Table 5. The increase in risk of MSDs in participants who walked more than 3 m while handling/carrying materials was 3.16 times in the neck, 2.03 times in the shoulders, 1.6 times in the elbows, and 1.6 times in the lower back or waist.

3.6. Correlation between the NMQ and the Work Ability Index

In this study, the NMQ was divided into upper limb and lower limb scales. Survey results for questionnaire items such as time of symptom onset, duration of symptom, the symptom’s impact on work and life, and frequency of symptom occurrence were used for correlation analysis with the Work Ability Index, thereby exploring the relationship between MSDs and the Work Ability Index. In the upper limb scale of the subjective NMQ, most items were significantly correlated with the Work Ability Index, except for frequency of symptom occurrence, which was non-significantly correlated with the Work Ability Index (Table 6). In the lower limb scale of the subjective NMQ, all variables were significantly correlated with the Work Ability Index (Table 6).

4. Discussion

In this study, the results of the MSD survey indicate that the nursing staff were a high-risk population for MSDs, and their working environments put them at high risk of MSDs. Specifically, the nursing staff from the emergency department were exposed to higher risks of MSDs than were the intensive care unit and general wards nursing staff. This finding differs from results reported elsewhere [32,33,34], where intensive care unit nursing staff had higher risks of injuries and illnesses than did nursing staff in other departments. Most MSDs were observed in the neck, shoulders, and lower back or waist of the nursing staff, and the most common type of pain induced by MSDs was soreness, followed by numbness—these findings are consistent with other studies in terms of body parts and symptoms [13,35,36,37,38]. Regardless of department, the majority of the nursing staff experienced varying levels of MSD-induced impact on their work and life, which concurs with the findings of relevant studies [35,39], as well as more recent surveys in Brazil [40] and the Czech Republic [41], and a large-scale survey in China [42]. As a possible predisposing factor, many nursing professionals were found to do inadequate exercise and to have pre-existing musculoskeletal problems in the lower back and neck even before they entered the workforce [43]. Causes of discomfort include long-term poor posture, stress from work without sufficient rest, handling/transferring patients, improper design of treatment carts/work carts/chairs, failure to use suitable tools, and wearing inappropriate work shoes without insoles [44,45,46,47,48,49], all of which are consistent with our on-site observations.
While other investigations, such as Akodu and Ashalejo [50], into the relationship between work ability and work-related musculoskeletal disorders assessed by the NMQ did not find a significant association, our study explored the relationship by examining time of symptom onset, duration of symptom, degree of impact of symptom, as well as frequency of symptom occurrence separately by upper and lower limbs and found significant correlation in all but frequency of symptom occurrence in the upper limbs. For the investigation of work ability, all subjects responded negatively regarding their performance with respect to physical and psychological demands and their future, which concurs with the finding of Amick et al. (1998) [51]. This may be attributable to the high probability of physical fatigue under immense stress and high physical demands [52].
This is one of the very few studies on nurses using human factor scales such as the Checklist for MSDs, and a lot of effort was made to collect data on all 117 subjects, as both self-reported and observational surveys (hence, both subjective and objective assessments) on musculoskeletal conditions were conducted for every subject. This study found that nursing staff in the emergency department were at a high risk of MSDs in their upper and lower limbs, while those working in the intensive care unit had a high risk of injuries caused by manual material handling. This suggests that the hospitals and nursing managers should pay close attention to those risk factors. Furthermore, they need to regularly assess the musculoskeletal condition of the nursing staff and focus on different body parts based on different departments. In addition, on-the-job training for nurses may need to incorporate the findings from this study to keep nurses aware of those injuries brought on by their daily work.
The limitations of this study are the small sample size due to the time- and effort-consuming nature of human factors scales such as the Checklist for MSDs, and no comparisons were made between male and female nurses. Possible ways to shorten the assessment time for the Checklist for MSDs include developing artificial intelligence (AI) measurement tools for MSD risk factors during work. Future studies could also explore the differences between male and female nurses. Recommended measures to improve MSDs among nurses include, but are not limited to, continuing education on ergonomic hazard prevention, the development and use of assistive devices as well as incentives for their use, and even changes in work scheduling to allow for adequate resting between work shifts.

5. Conclusions

This study provided evidence on the prevalence of MSDs by specific body parts in nursing staff working in different hospital departments. Through self-reported (subjective) surveys and objective observation, we described the patterns of MSDs among the nursing staff of a teaching hospital in southern Taiwan, and explored the hazards of poor ergonomic engineering by analyzing the effects of MSDs on work ability. We found that overexertion at work is highly prevalent, especially when moving patients, and that improper postures and improper force exertion increased MSD incidence among the nursing staff. Other studies have confirmed the correlation between physically demanding work and MSD incidence [53,54]. Regardless of department, most MSDs were observed in the neck, shoulders, and lower back or waist of the nursing staff. Furthermore, medium and high workloads for nurses was found to increase the risk of MSD conditions, which in turn affected their work ability. Based on the conclusions of this study, hospitals and institutions are highly recommended to promote body strengthening and rehabilitation programs for nursing staff.

Author Contributions

Conceptualization, Y.-K.O. and B.-O.L.; methodology, Y.-K.O. and B.-O.L.; formal analysis, Y.-K.O.; investigation, Y.L. and B.-O.L.; data curation, B.-O.L. and Y.-P.C.; writing—original draft preparation, Y.-K.O. and B.-O.L.; writing—review and editing, Y.-K.O., Y.L., Y.-P.C., and B.-O.L. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by the Allied Advanced Intelligent Biomedical Research Center (A21BRC) under the Higher Education Sprout Project of Ministry of Education.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of Chang Gung Medical Foundation (IRB No.: 201700922B0 and date of approval: 2017/07/25).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to legal restrictions imposed by the government of Taiwan in relation to the “Personal Information Protection Act”.

Acknowledgments

The authors are very grateful for the assistance and co-operation of all of the participants involved in the experiment. We would like to thank the anonymous reviewers and the editor for their comments.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Duration of symptom, type of pain, and impact on life and work for each body part.
Table A1. Duration of symptom, type of pain, and impact on life and work for each body part.
Duration of Symptom (Number of People)Type of Pain (Number of People)Impact on Life and Work (Number of People)
1 Month 3 Months 6 Months 1 Year3 Years>3 YearsSorenessSwelling Numbness TinglingPain that Wakes One up at NightMuscle AtrophyNo Impact on Life and Work at AllSlight Reduction in Work AbilitySignificant Reduction in Work Ability Has Required an Absence from Work to RestEven Affects One’s Life Complete Loss of Mobility
ABCABCABCABCABCABCABCABCABCABCABCABCABCABCABCABCABCABC
Neck 715122452431391125971836380103350220300109141782024000000020000
Left shoulder42010316246326104611319373500026304001101011151162021113000120000
Right shoulder6188316154316103710721343600015304011100012151371820013000210000
Upper back2117222351025102153924200000250201000005683169003000130000
Lower back or waist413825356544810251092037360003162252150001171072221134000240010
Left elbow144101000020000002254000012001010000130125000000000000
Right elbow134101000020000000266000023021010000131126000000010000
Left wrist2145002001120012012615140004551330300002331147002000010000
Right wrist21361230013110110146151400045513303000023431310102000020000
Left hip or thigh26303120201001123651413000252011000000453189101000010000
Right hip or thigh36303120201101123661313001242022010000453199101000001000
Left knee26323302011010022681111000142031102001423398021000100000
Right knee24323313010010021791011000134011101000523379021000100000
Left foot and ankle1552110120300042295102103012301110000021611014110000101000
Right foot and ankle16531201113000422107132202011400110000023631015100000101000
A = emergency department; B = intensive care unit; C = general wards.

References

  1. Fanello, S.; Jousset, N.; Roquelaure, Y.; Chotard, F.; Delbos, V. Valuation of a training program for the prevention of lower back pain among hospital employees. Nurs. Health Sci. 2002, 4, 51–54. [Google Scholar] [CrossRef]
  2. Pan, Y.T.; Guo, Y.L. Research of Evaluation of Ergonomics and Musculoskeletal Health Conditions in Taiwan; ILOSH103-H504; Institute of Labor, Occupational Safety and Health, Ministry of Labor: Taipei, Taiwan, 2015.
  3. Lee, H.C.; Lin, P.C.; Chou, M.C.; Huang, Y.C.; Li, Y.H.; Lin, H.M.; Hung, J.W.; Chang, K.C. Prevalence and risk factors for musculoskeletal discomfort among nursing attendants: A comparative review. Formos. J. Phys. Ther. 2011, 36, 55–66. [Google Scholar]
  4. Trepamn, E.; Yodlowski, M.L. Occupational disorders of the foot and ankle. Orthop. Clin. North Am. 1996, 27, 815–829. [Google Scholar] [CrossRef]
  5. Guo, H.R.; Tanaka, S.; Halperin, W.E.; Cameron, L.L. Back pain prevalence in US industry and estimates of lost workdays. Am. J. Public Health 1999, 89, 1029–1035. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Tung, C.Y.; Chang, T.M.; Chen, K.J.; Li, C.M.; Li, J.C.; Yang, C.H. A study of the nurses’ consciousness and the present condition toward the occupational injuries. Chin. J. Occup. Med. 2005, 12, 241–254. [Google Scholar]
  7. Kim, H.; Dropkin, J.; Spaeth, K.; Smith, F.; Moline, J. Patient handling and musculoskeletal disorders among hospital workers: Analysis of 7 years of institutional workers’ compensation claims data. Am. J. Ind. Med. 2012, 55, 683–690. [Google Scholar] [CrossRef] [PubMed]
  8. Chen, C.J.; Shieh, T.S.; Chang, S.L.; Fang, S.T. A study on musculoskeletal disorders of nursing staffs at a teaching hospital in southern Taiwan. Chin. J. Occup. Med. 2012, 19, 73–82. [Google Scholar]
  9. Lagerstrom, M.; Wenemark, M.; Hagberg, M. Occupational and individual factors related to musculoskeletal symptoms in five body regions among Swedish nursing personnel. Int. Arch. Occup. Environ. Health 1995, 68, 27–35. [Google Scholar] [CrossRef]
  10. Ahlberg-Hultén, G.; Theorell, T.; Sigala, F. Social support, job strain and musculoskeletal pain among female health care personnel. Scand. J. Work Environ. Health 1995, 21, 435–439. [Google Scholar] [CrossRef] [Green Version]
  11. Engels, J.A.; van der Gulden, J.W.; Senden, T.F. Work-Related risk factors for musculoskeletal complaints in the nursing profession: Results of a questionnaire survey. J. Occup. Environ. Med. 1996, 53, 636–641. [Google Scholar] [CrossRef] [Green Version]
  12. Josephson, M.; Lagerstrom, M.; Hagberg, M. Musculoskeletal Symptoms and Job Strain among Nursing Personnal: A study over a three year period. Occup. Environ. Med. 1997, 54, 681–685. [Google Scholar] [CrossRef] [Green Version]
  13. Ando, S.; Yuichiro, O.; Shimaoka, M. Associations of self-estimated workloads with musculoskeletal symptoms among hospital nurses. Occup. Environ. Med. 2000, 57, 211–216. [Google Scholar] [CrossRef] [Green Version]
  14. Alexopoulos, E.C.; Burdorf, A.; Kalokerinou, A. Risk factors for musculoskeletal disorders among nursing personnel in Greek hospitals. Int. Arch. Occup. Environ. Health 2003, 76, 289–294. [Google Scholar] [CrossRef]
  15. Eriksen, W. The prevalence of musculoskeletal pain in Norwegian nurses’ aides. Int. Arch. Occup. Environ. Health 2003, 76, 625–630. [Google Scholar] [CrossRef]
  16. Daraiseh, N.; Genaidy, A.M.; Karwowski, W. Musculoskeletal outcomes in multiple body regions and work effects among nurses: The effects of stressful and stimulating working conditions. Ergonomics 2003, 46, 1178–1179. [Google Scholar] [CrossRef]
  17. Feng, C.K.; Mao, I.F. A follow-up study of psychosocial risk factors for musculoskeletal disorders among nursing personnel in a nursing home. Taiwan J. Public Health 2006, 25, 231–241. [Google Scholar]
  18. Chen, W.L.; Chou, S.Y.; Yuan, S.C.; Kuo, H.H.; Yang, J.S.; Kuo, H.W. Factors affecting musculoskeletal disorders among hospital nurses. Mid Taiwan J. Med. 2006, 11, 252–260. [Google Scholar]
  19. Owen, B.D. Preventing injuries using an ergonomic approach. AORN J. 2000, 72, 1031–1036. [Google Scholar] [CrossRef]
  20. Holman, G.; Ellison, K.; Maghsoodloo, S.; Thomas, R. Nurses’ perceptions of how job environment and culture influence patient handling. Int. J. Orthop. Trauma Nurs. 2010, 14, 18–29. [Google Scholar] [CrossRef]
  21. ANA Releases 2011 Health and Safety Survey Results. Available online: https://www.americannursetoday.com/ana-releases-2011-health-and-safety-surveyresults/. (accessed on 13 December 2020).
  22. Chung, Y.-C.; Hung, C.-T.; Li, S.F.; Lee, H.-M.; Wang, S.-G.; Chang, S.-C.; Pai, L.-W.; Huang, C.-N.; Yang, J.-H. Risk of musculoskeletal disorder among Taiwanese nurses cohort: A nationwide population-based study. BMC Musculoskelet. Disord. 2013, 14, 144. [Google Scholar] [CrossRef] [Green Version]
  23. Shieh, S.-H.; Sung, F.-C.; Su, C.-H.; Tsai, Y.; Hsieh, V.C.-R. Increased low back pain risk in nurses with high workload for patient care: A questionnaire survey. Taiwan J. Obstet. Gynecol. 2016, 55, 525–529. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Lin, S.C.; Lin, L.L.; Liu, C.J.; Fang, C.K.; Lin, M.H. Exploring the factors affecting musculoskeletal disorders risk among hospital nurses. PLoS ONE 2020, 15, e0231319. [Google Scholar] [CrossRef] [Green Version]
  25. Occupational Safety and Health Administration. Draft: Instructions for Completing a Risk Factor Checklist; Occupational Safety and Health Administration: Washington, DC, USA, 1995; pp. 24–32.
  26. Employee Musculoskeletal Disorders Checklist Instruction Manual. Available online: https://docsplayer.com/22877519-%E5%8B%9E%E5%B7%A5%E8%82%8C%E8%82%89%E9%AA%A8%E9%AA%BC%E5%82%B7%E5%AE%B3%E6%AA%A2%E9%BB%9E%E6%8A%80%E8%A1%93%E6%89%8B%E5%86%8A.html (accessed on 1 July 2015). (In Chinese).
  27. Yeh, Y.Y.; Lin, Y.H. Worksite Applicability Study of the MSD Checklist; IOSH86-H329; Institute of Occupational Safety and Health, Council of Labor Affairs, Executive Yuan: Taipei, Taiwan, 1997. (In Chinese)
  28. Deakin, J.M.; Stevenson, J.M.; Vail, G.R.; Nelson, J.M. The use of the Nordic questionnaire in an industrial setting: A case study. Appl. Ergon. 1994, 25, 182–185. [Google Scholar] [CrossRef]
  29. IOSH (Institute of Occupational Safety and Health). Prevention Guidelines for Musculoskeletal Disorders; IOSH90-T042; Institute of Occupational Safety and Health, Council of Labor Affairs, Executive Yuan: Taipei, Taiwan, 2001. (In Chinese)
  30. Yuan, S.C.; Lai, C.H.; Weng, Y.C.; Chang, Y.; Lee, C.H.; Kuo, H. The effect of physical stretching fitness on decreasing musculoskeletal disorders among clinical nurses. Chung Shan Med. J. 2014, 25, 21–30. [Google Scholar]
  31. Wang, T.J.; Pan, C.H. Work Ability Index Study for Aging Workers; IOSH98-M318; Institute of Labor, Occupational Safety and Health, Ministry of Labor: Taipei, Taiwan, 2010. (In Chinese)
  32. Pınar, R. Work-related musculoskeletal disorders in Turkish hospital nurses. Turk. Clin. J. Med Sci. 2010, 30, 1869–1875. [Google Scholar] [CrossRef]
  33. Black, T.R.; Shah, S.M.; Busch, A.J.; Metcalfe, J.; Lim, H.J. Effect of transfer, lifting, and repositioning (TLR) injury prevention program on musculoskeletal injury among direct care workers. J. Occup. Environ. Hyg. 2011, 8, 226–235. [Google Scholar] [CrossRef]
  34. Sezgin, D.; Esin, M.N. Predisposing factors for musculoskeletal symptoms in intensive care unit nurses. Int. Nurs. Rev. 2014, 62, 92–101. [Google Scholar] [CrossRef] [PubMed]
  35. Trinkoff, A.M.; Lipscomb, J.G.; Geiger-Brown, J.; Brady, B. Musculoskeletal problems of the neck, shoulder, and back and functional consequences in nurse. Am. J. Ind. Med. 2002, 41, 170–178. [Google Scholar] [CrossRef] [PubMed]
  36. Smith, D.R.; Wei, N.; Zhao, L.; Wang, R.S. Musculoskeletal complaints and psychosocial risk factors among Chinese hospital nurses. Occup. Med. 2004, 54, 579–582. [Google Scholar] [CrossRef] [Green Version]
  37. Smith, D.R.; Mihashi, M.; Adachi, Y.; Koga, H.; Ishitake, T. A detailed analysis of musculoskeletal disorders risk factors among Japanese nurses. J. Saf. Res. 2006, 37, 195–200. [Google Scholar] [CrossRef] [PubMed]
  38. Rypicz, T.; Karniej, P.; Witczak, I.; Kołcz, A. Evaluation of the occurrence of work-related musculoskeletal pain among anesthesiology, intensive care, and surgical nurses: An observational and descriptive study. Nurs. Health Sci. 2020, 22, 1056–1064. [Google Scholar] [CrossRef]
  39. Gropelli, T.M.; Corle, K. Nurse’s and therapist’s experiences with occupational musculoskeletal injuries. AAOHN J. 2010, 58, 159–166. [Google Scholar]
  40. Cargnin, Z.A.; Schneider, D.G.; Vargas, M.A.O.; Machado, M.M. Non-specific low-back pain and its relation to the nursing work process. Revista Latino-Americana de Enfermagem. 2019, 27, e3172. [Google Scholar] [CrossRef] [PubMed]
  41. Gilchrist, A.; Pokorná, A. Prevalence of musculoskeletal low back pain among registered nurses: Results of an online survey. J. Clin. Nurs. 2021, 30, 1675–1683. [Google Scholar] [CrossRef] [PubMed]
  42. Yang, Y.; Huang, A.M.; Wang, Y.N.; Zhang, L.; Li, F.Y.; Yao, H.; Yan, P. Study on the correlation between work-related musculoskeletal disorders and work ability among nurses at three level general hospital in Xinjiang. Zhonghua Lao Dong Wei Shen Zhi Ye Bing Za Zhi 2018, 36, 669–673. [Google Scholar]
  43. Pugh, J.D.; Cormack, K.; Williams, A.M.; Gelder, L.; Twig, D.E.; Blazevich, A.J. Exercise, fitness, and musculoskeletal health of undergraduate nursing students: A cross-sectional study. J. Adv. Nurs. 2019, 75, 2110–2121. [Google Scholar] [CrossRef]
  44. Miranda, H.; Punnet, L.; Viikari-Juntura, E.; Heliovaara, M.; Knekt, P. Physical work and chronic shoulder disorder: Results of a prospective population-based study. Ann. Rheum. Dis. 2008, 67, 218–223. [Google Scholar] [CrossRef] [PubMed]
  45. Long, M.E.; Johnston, V.; Bogossian, F.E. Helping women but hurting ourselves? Neck and upper back musculoskeletal symptoms in a cohort of Australian midwives. Midwifery 2013, 29, 359–367. [Google Scholar] [CrossRef] [PubMed]
  46. Attarchi, M.; Raeisi, S.; Namvar, M.; Golabadi, M. Association between shift working an musculoskeletal symptoms among nursing personnel. Iran. J. Nurs. Midwifery Res. 2014, 19, 309–314. [Google Scholar] [PubMed]
  47. Linaker, C.H.; Walker-Bone, K. Shoulder disorders and occupation. Best Pract. Res. Clin. Rheumatol. 2015, 29, 405–423. [Google Scholar] [CrossRef] [Green Version]
  48. Lier, R.; Nilsen, T.I.; Vasseljen, O.; Mork, P.J. Neck/upper back and low back pain in parents and their adult offspring: Family linkage data from the Norwegian HUNT Study. Eur. J. Pain 2015, 19, 762–771. [Google Scholar] [CrossRef] [PubMed]
  49. Al-Mohrej, O.A.; AlShaalan, N.S.; Ai-Bani, W.M.; Masuadi, E.M.; Almodaimegh, H.S. Prevalence of musculoskeletal pain of the neck, upper extremities and lower back among dental practitioners working in Riyadh, Saudi Arabia: A cross-sectional study. BMJ Open 2016, 6, e011100. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Akodu, A.K.; Ashalejo, Z.O. Work-related musculoskeletal disorders and work ability among hospital nurses. J. Taibah Univ. Med. Sci. 2019, 14, 252–261. [Google Scholar] [CrossRef]
  51. Amick, B.C.; Kawachi, I.; Coakley, E.H.; Lemer, D.; Levin, S.; Colditz, G.A. Relationship of job strain and iso-strain to health status in a cohort of woman in the United State. Scand. J. Work. Environ. Health 1998, 24, 54–61. [Google Scholar] [CrossRef] [Green Version]
  52. Cassou, B.; Derriennic, F.; Monfort, C.; Norton, J.; Touranchet, A. Chronic neck and shoulder pain, age, and working conditions: Longitudinal results from a large random sample in France. Occup. Environ. Med. 2002, 59, 537–544. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Harcombe, H.; McBride, D.; Derrett, S.; Gray, A. Physical and psycho-social risk factors for musculoskeletal disorders in New Zealand nurses, postal workers and office workers. Inj. Prev. 2010, 16, 96–100. [Google Scholar] [CrossRef] [PubMed]
  54. Trinkoff, A.M.; Lipscomb, J.A.; Geiger-Brown, J.; Storr, C.L.; Brady, B.A. Perceived physical demands and reported musculoskeletal problems in registered nurses. Am. J. Prev. Med. 2003, 24, 270–275. [Google Scholar] [CrossRef]
Table 1. Health and lifestyle characteristics of nursing staff.
Table 1. Health and lifestyle characteristics of nursing staff.
Variable Emergency Department
Mean (SD)
Intensive Care Unit
Mean (SD)
General Ward
Mean (SD)
Gender Male 1 (4%)1 (2.1%)0 (0%)
Female24 (96%)45 (97.9%)46 (100%)
Pregnancy history (female only)No18 (75%)32 (71.1%)32 (69.6%)
Yes6 (25%)13 (28.9%)14 (30.4%)
Age 30.7 (3.4)31.2 (4.5)30.8 (4.1)
Height 162.5 (5.0)160 (4.6)160.7 (5.4)
Weight 60.2 (9.4)59.1 (13.5)60.9 (12.4)
Frequency of exerciseRarely10 (40)16 (34.8)21 (45.7)
Sometimes12 (48)23 (50)25 (54.3)
At least once a week3 (12)7 (15.2)0 (0)
Tobacco use Yes0 (0%)1 (2.1%)0 (0%)
No25 (100%)45 (97.9%)46 (100%)
Dominant handLeft0 (0%)2 (4.2%)2 (4.3%)
Right25 (10%0)44 (95.8%)44 (95.7%)
Table 2. Musculoskeletal disorder (MSD) prevalence for each body part in the past year.
Table 2. Musculoskeletal disorder (MSD) prevalence for each body part in the past year.
Body PartEmergency Department *
(n = 25)
Number of Occurrences (Prevalence)
Intensive Care Unit *
(n = 46)
Number of Occurrences (Prevalence)
General Wards *
(n = 46)
Number of Occurrences (Prevalence)
Neck 18 (72%)32 (70%)37 (80%)
Shoulders 21 (84%)37 (80%)37 (80%)
Upper back9 (36%)22 (48%)18 (39%)
Lower back or waist20 (80%)36 (78%)34 (74%)
Elbows2 (8%)5 (11%)7 (15%)
Hands or wrists7 (28%)18 (39%)18 (39%)
Hips or thighs 7 (28%)16 (35%)12 (26%)
Knees9 (36%)13 (28%)11 (24%)
Feet and ankles8 (32%)15 (33%)22 (48%)
* p < 0.001.
Table 3. Hazard ratio analysis between the Nordic musculoskeletal questionnaire (NMQ) and scale I of the checklist for MSDs.
Table 3. Hazard ratio analysis between the Nordic musculoskeletal questionnaire (NMQ) and scale I of the checklist for MSDs.
Variable (NMQ)Musculoskeletal Disorders (MSDs)
OR (95% CI)
Elbows
 Low (<19) (n = 10)1.00
 Moderate (19–24) (n = 77)1.19 (0.14–10.54)
 High (>24) (n = 30)1.39 (0.14–14.07)
Wrists/hands
 Low (<19) (n = 10)1
 Moderate (19–24) (n = 77)5.75 (0.69–47.68)
 High (>24) (n = 30)6 (0.67–53.68)
Note: OR: odds ratio; CI: confidence interval.
Table 4. Hazard ratio analysis between the NMQ and scale II of the checklist for MSDs.
Table 4. Hazard ratio analysis between the NMQ and scale II of the checklist for MSDs.
Variable (NMQ)Musculoskeletal Disorders (MSDs)
OR (95% CI)
Upper back
 Low (<10) (n = 37)1.00
 Moderate (10–14) (n = 31)0.83 (0.31–2.19)
 High (>14) (n = 49)0.98 (0.42–2.33)
Lower back
 Low (<10) (n = 37)1.00
 Moderate (10–14) (n = 31)1.86 (0.63–5.46)
 High (>14) (n = 49)3.25 (1.14–9.26)
Hips/thighs
 Low (<10) (n = 37)1.00
 Moderate (10–14) (n = 31)0.82 (0.28–2.40)
 High (>14) (n = 49)1.146 (0.46–2.89)
Knees
 Low (<10) (n = 37)1.00
 Moderate (10–14) (n = 31)1.75 (0.57–5.43)
 High (>14) (n = 49)2.28 (0.83–6.26)
Ankles/feet
 Low (<10) (n = 37)1.00
 Moderate (10–14) (n = 31)0.34 (0.12–0.99)
 High (>14) (n = 49)0.88 (0.37–2.08)
Note: OR: odds ratio; CI: confidence interval.
Table 5. Hazard ratio analysis between the NMQ and scale III of the checklist for MSDs.
Table 5. Hazard ratio analysis between the NMQ and scale III of the checklist for MSDs.
Variable (NMQ)Musculoskeletal Disorders (MSDs)
OR (95% CI)
Rotating the body while handling materials Lower back
No1.00
Yes0.924 (0.35–2.48)
Material handling with one hand Elbows
No1.00
Yes0.579 (0.15–2.21)
Wrists/hands
No1.00
Yes1.14 (0.51–2.56)
Walking more than 3 m while handling/carrying materialsNeck
No1.00
Yes3.16 (0.68–14.62)
Shoulders
No1.00
Yes2.03 (0.43–9.54)
Elbows
No1.00
Yes1.60 (0.40–6.42)
Wrists/hands
No1.00
Yes1.11 (0.40–3.13)
Upper back
No1.00
Yes1.13 (0.41–3.11)
Lower back
No1.00
Yes1.60 (0.43–6.00)
Hips/thighs
No1.00
Yes0.89 (0.29–2.70)
Knees
No1.00
Yes0.98 (0.32–3.00)
Ankles/feet
No1.00
Yes1.022 (0.36–2.86)
Note: OR: odds ratio; CI: confidence interval.
Table 6. Correlation between the subjective NMQ and the work ability index.
Table 6. Correlation between the subjective NMQ and the work ability index.
Time of Symptom
Onset
Duration of SymptomDegree of Impact of SymptomFrequency of Symptom
Occurrence
Work Ability
Index
Upper limbs
Time of symptom onset1
Duration of symptom0.658 **1
Degree of impact of symptom0.764 **0.598 **1
Frequency of symptom
occurrence
0.774 **0.367 **0.679 **1
Work Ability Index0.256 **0.223 *0.237 *0.1441
Lower limbs
Time of symptom onset1
Duration of symptom0.752 **1
Degree of impact of symptom0.770 **0.746 **1
Frequency of symptom
occurrence
0.825 **0.617 **0.744 **1
Work Ability Index0.307 **0.287 **0.264 **0.287 **1
* Two-tailed test with a significance level of 0.05; ** Two-tailed test with a significance level of 0.01.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ou, Y.-K.; Liu, Y.; Chang, Y.-P.; Lee, B.-O. Relationship between Musculoskeletal Disorders and Work Performance of Nursing Staff: A Comparison of Hospital Nursing Departments. Int. J. Environ. Res. Public Health 2021, 18, 7085. https://doi.org/10.3390/ijerph18137085

AMA Style

Ou Y-K, Liu Y, Chang Y-P, Lee B-O. Relationship between Musculoskeletal Disorders and Work Performance of Nursing Staff: A Comparison of Hospital Nursing Departments. International Journal of Environmental Research and Public Health. 2021; 18(13):7085. https://doi.org/10.3390/ijerph18137085

Chicago/Turabian Style

Ou, Yang-Kun, Yi Liu, Yu-Ping Chang, and Bih-O Lee. 2021. "Relationship between Musculoskeletal Disorders and Work Performance of Nursing Staff: A Comparison of Hospital Nursing Departments" International Journal of Environmental Research and Public Health 18, no. 13: 7085. https://doi.org/10.3390/ijerph18137085

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop