A Wearable Multi-Modal Digital Upper Limb Assessment System for Automatic Musculoskeletal Risk Evaluation
Abstract
:1. Introduction
- Multi-modal wireless wearable sensors are used for digitally computing RULA scores.
- A robust kinematic model has been developed for upper limbs motion tracking.
- Digital implementation of the new method has been validated by comparison with an online RULA calculator.
2. DULA Method
2.1. RULA
2.2. Kinematics for DULA
2.2.1. Reference Coordinate Setup
- Stretch the arm forward while the palm is facing downwards. This is considered the right arm base posture.
- Record the gravity vector g at base posture, upon which the for the forearm frame is determined.
- Perform supination motion and record angular velocity during the motion. The for the forearm frame is hence obtained as:
- The cross product of and results in for the forearm frame. However, it is not humanly possible to have and exactly perpendicular to each other, hence, is normalized.
- Finally, is obtained to complete right hand coordinate frame convention.
- Thus, the computed rotation matrix belongs to a special orthogonal group . The forearm reference frame in the IMU frame has the following form:
2.2.2. Frame Transformations
- Record IMU orientation when the arm is in the base posture.
- is computed according the method in Section 2.2.1.
- is continuously acquired from the IMU sensor in real-time.
- To find the forearm orientation with respect to IMU frame, i.e, , the following equations are presented:
- Finally, we find the orientation of the forearm with respect to the forearm reference frame ,
2.2.3. Upper Arm Orientation
2.2.4. Forearm Orientation
- Find the orientations of upper arm base frame and forearm base frame with respect to global reference frame as:
- Compute the relative rotation between both frames and :
- The forearm orientation defined in is mapped in the upper arm reference frame using similarity transformation technique:
- Since both forearm and upper arm orientations are now established in the same coordinate system defined by , the relative rotation matrix is found as:
- The forearm orientation with respect to the upper arm is considered to be formed by the combination of two rotations, the forearm extension/flexion about the current Y, and the forearm pronation/supination about the current Z axis.
2.3. Load Identification
3. DULA System Development
3.1. Hardware
3.2. Software
4. Results
5. Discussion
6. Conclusions
Author Contributions
Funding
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
MSD | Musculoskeletal disorders |
RULA | Rapid upper limb assessment |
DULA | Digital upper limb assessment |
IMU | Inertial measurement unit |
F or f | Forearm |
U or f | Upper arm |
References
- Winkel, J.; Mathiassen, S.E. Assessment of physical work load in epidemiologic studies: Concepts, issues and operational considerations. Ergonomics 1994, 37, 979–988. [Google Scholar] [CrossRef]
- Dockrell, S.; O’Grady, E.; Bennett, K.; Mullarkey, C.; Mc Connell, R.; Ruddy, R.; Twomey, S.; Flannery, C. An investigation of the reliability of Rapid Upper Limb Assessment (RULA) as a method of assessment of children’s computing posture. Appl. Ergon. 2012, 43, 632–636. [Google Scholar] [CrossRef] [PubMed]
- Lei, L.; Dempsey, P.G.; Xu, J.G.; Ge, L.N.; Liang, Y.X. Risk factors for the prevalence of musculoskeletal disorders among Chinese foundry workers. Int. J. Ind. Ergon. 2005, 35, 197–204. [Google Scholar] [CrossRef]
- Parent-Thirion, A.; Biletta, I.; Cabrita, J.; Vargas Llave, O.; Vermeylen, G.; Wilczyńska, A.; Wilkens, M. Sixth European Working Conditions Survey–Overview report. Eurofound 2016. [Google Scholar] [CrossRef]
- Hignett, S.; McAtamney, L. Rapid entire body assessment (REBA). Appl. Ergon. 2000, 31, 201–205. [Google Scholar] [CrossRef]
- Sanchez-Lite, A.; Garcia, M.; Domingo, R.; Angel Sebastian, M. Novel ergonomic postural assessment method (NERPA) using product-process computer aided engineering for ergonomic workplace design. PLoS ONE 2013, 8, e72703. [Google Scholar] [CrossRef]
- Moore, J.S.; Vos, G.A. The strain index. In Handbook of Human Factors and Ergonomics Methods; CRC Press: Boca Raton, FL, USA, 2004; pp. 109–114. [Google Scholar]
- Karhu, O.; Kansi, P.; Kuorinka, I. Correcting working postures in industry: A practical method for analysis. Appl. Ergon. 1977, 8, 199–201. [Google Scholar] [CrossRef]
- McAtamney, L.; Corlett, E.N. RULA: A survey method for the investigation of work-related upper limb disorders. Appl. Ergon. 1993, 24, 91–99. [Google Scholar] [CrossRef]
- Basahel, A.M. Investigation of work-related musculoskeletal disorders (MSDs) in warehouse workers in Saudi Arabia. Procedia Manuf. 2015, 3, 4643–4649. [Google Scholar] [CrossRef]
- Bao, S.; Howard, N.; Spielholz, P.; Silverstein, B. Two posture analysis approaches and their application in a modified rapid upper limb assessment evaluation. Ergonomics 2007, 50, 2118–2136. [Google Scholar] [CrossRef]
- Intranuovo, G.; De Maria, L.; Facchini, F.; Giustiniano, A.; Caputi, A.; Birtolo, F.; Vimercati, L. Risk assessment of upper limbs repetitive movements in a fish industry. BMC Res. Notes 2019, 12, 1–7. [Google Scholar] [CrossRef] [PubMed]
- Valentim, D.P.; de Oliveira Sato, T.; Comper, M.L.C.; da Silva, A.M.; Boas, C.V.; Padula, R.S. Reliability, construct validity and interpretability of the Brazilian version of the Rapid Upper Limb Assessment (RULA) and Strain Index (SI). Braz. J. Phys. Ther. 2018, 22, 198–204. [Google Scholar] [CrossRef] [PubMed]
- Balasubramanian, V.; Swami Prasad, G. An EMG-based ergonomic evaluation of manual bar bending. Int. J. Ind. Syst. Eng. 2007, 2, 299–310. [Google Scholar] [CrossRef]
- González, A.; Barrios-Muriel, J.; Romero-Sánchez, F.; Salgado, D.; Alonso, F. Ergonomic assessment of a new hand tool design for laparoscopic surgery based on surgeons’ muscular activity. Appl. Ergon. 2020, 88, 103161. [Google Scholar] [CrossRef]
- Kong, Y.K.; Choi, K.H.; Cho, M.U.; Kim, S.Y.; Kim, M.J.; Shim, J.W.; Park, S.S.; Kim, K.R.; Seo, M.T.; Chae, H.S.; et al. Ergonomic assessment of a lower-limb exoskeleton through electromyography and Anybody modeling system. Int. J. Environ. Res. Public Health 2022, 19, 8088. [Google Scholar] [CrossRef]
- Huang, C.; Kim, W.; Zhang, Y.; Xiong, S. Development and validation of a wearable inertial sensors-based automated system for assessing work-related musculoskeletal disorders in the workspace. Int. J. Environ. Res. Public Health 2020, 17, 6050. [Google Scholar] [CrossRef]
- Moore, J.; Stuart, S.; McMeekin, P.; Walker, R.; Celik, Y.; Pointon, M.; Godfrey, A. Enhancing free-living fall risk assessment: Contextualizing mobility based IMU data. Sensors 2023, 23, 891. [Google Scholar] [CrossRef]
- Akhmad, S.; Arendra, A.; Findiastuti, W.; Lumintu, I.; Pramudita, Y.D. Wearable IMU Wireless Sensors Network for Smart Instrument of Ergonomic Risk Assessment. In Proceedings of the 6th Information Technology International Seminar (ITIS), Surabaya, Indonesia, 14–16 October 2020; pp. 213–218. [Google Scholar]
- Mohamad, D.; Md Deros, B.; Ismail, A.R.; Daruis, D.D.I.; Sukadarin, E.H. RULA analysis of work-related disorder among packaging industry worker using digital human modeling (DHM). In Advanced Engineering Forum; Trans Tech Publications Ltd.: Kuala Lumpur, Malaysia, 2013; Volume 10, pp. 9–15. [Google Scholar]
- Hussain, M.M.; Qutubuddin, S.; Kumar, K.P.R.; Reddy, C.K. Digital human modeling in ergonomic risk assessment of working postures using RULA. In Proceedings of the International Conference on Industrial Engineering and Operations Management, Bangkok, Thailand, 5–7 March 2019; pp. 5–7. [Google Scholar]
- Hu, B.; Ma, L.; Zhang, W.; Salvendy, G.; Chablat, D.; Bennis, F. Predicting real-world ergonomic measurements by simulation in a virtual environment. Int. J. Ind. Ergon. 2011, 41, 64–71. [Google Scholar] [CrossRef]
- Cao, W.; Zhong, J.; Cao, G.; He, Z. Physiological Function Assessment Based on Kinect V2. IEEE Access 2019, 7, 105638–105651. [Google Scholar] [CrossRef]
- Yu, Y.; Yang, X.; Li, H.; Luo, X.; Guo, H.; Fang, Q. Joint-level vision-based ergonomic assessment tool for construction workers. J. Constr. Eng. Manag. 2019, 145, 04019025. [Google Scholar] [CrossRef]
- Forsman, M.; Hansson, G.Å.; Medbo, L.; Asterland, P.; Engström, T. A method for evaluation of manual work using synchronised video recordings and physiological measurements. Appl. Ergon. 2002, 33, 533–540. [Google Scholar] [CrossRef] [PubMed]
- David, G.C. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occup. Med. 2005, 55, 190–199. [Google Scholar] [CrossRef] [PubMed]
- Cheng, H.Y.K.; Cheng, C.Y.; Ju, Y.Y. Work-related musculoskeletal disorders and ergonomic risk factors in early intervention educators. Appl. Ergon. 2013, 44, 134–141. [Google Scholar] [CrossRef] [PubMed]
- McDevitt, S.; Hernandez, H.; Hicks, J.; Lowell, R.; Bentahaikt, H.; Burch, R.; Ball, J.; Chander, H.; Freeman, C.; Taylor, C.; et al. Wearables for biomechanical performance optimization and risk assessment in industrial and sports applications. Bioengineering 2022, 9, 33. [Google Scholar] [CrossRef]
- Padilla, B.E.O.; Glushkova, A.; Menychtas, D.; Manitsaris, S. Designing a web-based automatic ergonomic assessment using motion data. In Proceedings of the 12th ACM International Conference on Pervasive Technologies Related to Assistive Environments, Rhodes, Greece, 5–7 June 2019; pp. 528–534. [Google Scholar]
- Balser, F.; Desai, R.; Ekizoglou, A.; Bai, S. A novel passive shoulder exoskeleton designed with variable stiffness mechanism. IEEE Robot. Autom. Lett. 2022, 7, 2748–2754. [Google Scholar] [CrossRef]
- Islam, M.; Bai, S. Payload estimation using forcemyography sensors for control of upper-body exoskeleton in load carrying assistance. Model. Identif. Control (Online) 2019, 40, 189–198. [Google Scholar] [CrossRef]
- Tahir, A.; An, Z.; Bai, S.; Shen, M. Robust payload recognition based on sensor-over-muscle-independence deep learning for the control of exoskeletons. IEEE Trans. Circuits Syst. II Express Briefs 2023. [Google Scholar] [CrossRef]
- Ergonomics, O. RULA—Rapid Upper Limb Assessment. 2019. Available online: https://www.rula.co.uk/assessment.html (accessed on 12 May 2023).
Reference | Assessment Tool | Data Acquisition Method | Wearable | Non-Obstructive | Load Identification |
---|---|---|---|---|---|
[10,11,12,13,23,24] | RULA/Modified RULA/SI | Optical/Self-report | No | No | No |
[14,15,16] | Muscle activity level | EMG/AnyBody software | Yes | Yes | Yes |
[20,21,22] | RULA | DHM/VR/CATIA software | Yes | No | No |
[17,19] | RULA/REBA/NIOSH | Inertial | Yes | Yes | No |
[18] | Artificial Intelligence based | Inertial and optical | Yes | No | No |
Our work | RULA | Inertial | Yes | Yes | Yes |
RULA Score | Action Level | Action |
---|---|---|
1–2 | 1 | Acceptable working pattern; no changes are required. |
3–4 | 2 | Working pattern may be changed; hence, further investigations are suggested. |
5–6 | 3 | Working pattern will soon require changes; therefore, further investigations are needed. |
>7 | 4 | Working pattern highly risks health and should be immediately changed. |
Posture | DULA | RULA | Posture | DULA | RULA |
---|---|---|---|---|---|
1 | 6 | 6 | 6 | 6 | 6 |
2 | 5 | 5 | 7 | 7 | 6 |
3 | 5 | 4 | 8 | 5 | 5 |
4 | 4 | 4 | 9 | 6 | 6 |
5 | 6 | 5 | 10 | 7 | 7 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Tahir, A.; Bai, S.; Shen, M. A Wearable Multi-Modal Digital Upper Limb Assessment System for Automatic Musculoskeletal Risk Evaluation. Sensors 2023, 23, 4863. https://doi.org/10.3390/s23104863
Tahir A, Bai S, Shen M. A Wearable Multi-Modal Digital Upper Limb Assessment System for Automatic Musculoskeletal Risk Evaluation. Sensors. 2023; 23(10):4863. https://doi.org/10.3390/s23104863
Chicago/Turabian StyleTahir, Abdullah, Shaoping Bai, and Ming Shen. 2023. "A Wearable Multi-Modal Digital Upper Limb Assessment System for Automatic Musculoskeletal Risk Evaluation" Sensors 23, no. 10: 4863. https://doi.org/10.3390/s23104863
APA StyleTahir, A., Bai, S., & Shen, M. (2023). A Wearable Multi-Modal Digital Upper Limb Assessment System for Automatic Musculoskeletal Risk Evaluation. Sensors, 23(10), 4863. https://doi.org/10.3390/s23104863