Identifying Developmental Motor Difficulties: A Review of Tests to Assess Motor Coordination in Children
Abstract
:1. Introduction
2. Motor Coordination Assessment Tools
2.1. Motor Performance Measures
2.1.1. The Motoriktest für vier-bis sechsjährige Kinder (MOT 4–6)
2.1.2. The McCarron Assessment of Neuromuscular Development (MAND)
2.1.3. The Peabody Developmental Motor Scales–2nd Edition (PDMS-2)
2.1.4. The Test of Gross Motor Development—2nd Edition (TGMD-2)
2.1.5. The Maastrichtse Motoriek Test (MMT)
2.1.6. The Bruininks-Oseretsky Test of Motor Proficiency (BOTMP)
2.1.7. The Körperkoordinationtest für Kinder (KTK)
2.1.8. The Movement Assessment Battery for Children—2nd Edition (M-ABC 2)
2.1.9. Abilità Prassiche e della Coordinazione Motoria—2nd Edition (APCM-2)
2.1.10. The Zurich Neuromotor Assessment 2 (ZNA-2)
2.2. Self-Report Questionnaires
2.2.1. The Motor Observation Questionnaire for Teachers (MOQ-T)
2.2.2. The Movement Assessment Battery for Children—2nd Edition (M-ABC 2) Checklist
2.2.3. The Developmental Coordination Disorder Questionnaire (DCDQ)
2.2.4. The Early Years Movement Skills Checklist (EYMSC)
3. Discussion and Conclusions
Funding
Conflicts of Interest
References
- American Psychiatric Association Diagnostic and Statistical Manual of Mental Disorders (DSM-5®); American Psychiatric Pub.: Washington, DC, USA, 2013; ISBN 978-0-89042-557-2.
- World Health Organization. The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines; World Health Organization: Geneva, Switzerland, 1992; ISBN 978-92-4-154422-1. [Google Scholar]
- Blank, R.; Smits-Engelsman, B.; Polatajko, H.; Wilson, P. European Academy for Childhood Disability European Academy for Childhood Disability (EACD): Recommendations on the definition, diagnosis and intervention of developmental coordination disorder (long version). Dev. Med. Child. Neurol. 2012, 54, 54–93. [Google Scholar] [CrossRef]
- Harris, S.R.; Mickelson, E.C.R.; Zwicker, J.G. Diagnosis and management of developmental coordination disorder. CMAJ 2015, 187, 659–665. [Google Scholar] [CrossRef] [Green Version]
- Goyen, T.-A.; Lui, K. Developmental coordination disorder in “apparently normal” schoolchildren born extremely preterm. Arch. Dis. Child. 2009, 94, 298. [Google Scholar] [CrossRef]
- Pearsall-Jones, J.G.; Piek, J.P.; Levy, F. Developmental Coordination Disorder and cerebral palsy: Categories or a continuum? Hum. Mov. Sci. 2010, 29, 787–798. [Google Scholar] [CrossRef]
- Williams, J.; Hyde, C.; Spittle, A. Developmental Coordination Disorder and Cerebral Palsy: Is There a Continuum? Curr. Dev. Disord. Rep. 2014, 1, 118–124. [Google Scholar] [CrossRef] [Green Version]
- Zwicker, J.G.; Missiuna, C.; Harris, S.R.; Boyd, L.A. Developmental coordination disorder: A review and update. Eur. J. Paediatr. Neurol. 2012, 16, 573–581. [Google Scholar] [CrossRef] [PubMed]
- Wilson, P.H.; Smits-Engelsman, B.; Caeyenberghs, K.; Steenbergen, B.; Sugden, D.; Clark, J.; Mumford, N.; Blank, R. Cognitive and neuroimaging findings in developmental coordination disorder: New insights from a systematic review of recent research. Dev. Med. Child Neurol. 2017, 59, 1117–1129. [Google Scholar] [CrossRef] [PubMed]
- Vaivre-Douret, L.; Lalanne, C.; Golse, B. Developmental Coordination Disorder, an Umbrella Term for Motor Impairments in Children: Nature and Co-Morbid Disorders. Front. Psychol. 2016, 7, 502. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Biotteau, M.; Chaix, Y.; Blais, M.; Tallet, J.; Péran, P.; Albaret, J.-M. Neural Signature of DCD: A Critical Review of MRI Neuroimaging Studies. Front. Neurol. 2016, 7, 227. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fuelscher, I.; Caeyenberghs, K.; Enticott, P.G.; Williams, J.; Lum, J.; Hyde, C. Differential activation of brain areas in children with developmental coordination disorder during tasks of manual dexterity: An ALE meta-analysis. Neurosci. Biobehav. Rev. 2018, 86, 77–84. [Google Scholar] [CrossRef]
- Hyde, C.; Fuelscher, I.; Williams, J. Neurophysiological Approaches to Understanding Motor Control in DCD: Current Trends and Future Directions. Curr. Dev. Disord. Rep. 2019, 6, 78–86. [Google Scholar] [CrossRef]
- McIntyre, F.; Parker, H.; Thornton, A.; Licari, M.; Piek, J.; Rigoli, D.; Hands, B. Assessing motor proficiency in young adults: The Bruininks Oseretsky Test-2 Short Form and the McCarron Assessment of Neuromuscular Development. Hum. Mov. Sci. 2017, 53, 55–62. [Google Scholar] [CrossRef] [PubMed]
- Tan, S.K.; Parker, H.E.; Larkin, D. Concurrent Validity of Motor Tests Used to Identify Children with Motor Impairment. Adapt. Phys. Act. Q. 2001, 18, 168–182. [Google Scholar] [CrossRef]
- Crawford, S.G.; Wilson, B.N.; Dewey, D. Identifying Developmental Coordination Disorder. Phys. Occup. Ther. Pediatrics 2001, 20, 29–50. [Google Scholar]
- Brantner, S.; Piek, J.P.; Smith, L.M. Evaluation of the validity of the MAND in assessing motor impairment in young children. Rehabil. Psychol. 2009, 54, 413–421. [Google Scholar] [CrossRef]
- Cools, W.; Martelaer, K.D.; Samaey, C.; Andries, C. Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools. J. Sports Sci. Med. 2009, 8, 154–168. [Google Scholar]
- Tieman, B.L.; Palisano, R.J.; Sutlive, A.C. Assessment of motor development and function in preschool children. Ment. Retard. Dev. Disabil. Res. Rev. 2005, 11, 189–196. [Google Scholar] [CrossRef]
- Hands, B.; Licari, M.; Piek, J. A review of five tests to identify motor coordination difficulties in young adults. Res. Dev. Disabil. 2015, 41–42, 40–51. [Google Scholar] [CrossRef]
- Zimmer, R.; Volkamer, M. MOT 4-6: Motoriktest Für Vier-Bis Sechsjährige Kinder; Manual; Beltz Test: Weinheim, Germany, 1987. [Google Scholar]
- McCarron, L. McCarron Assessment of Neuromuscular Development: Fine and Gross Motor Abilities (Revised); McCarron-Dial Systems: Dallas, TX, USA, 1997. [Google Scholar]
- Folio, M.; Fawell, R. Peabody Developmental Motor Scales Second Edition (PDMS-2); Stoelting Company: Wood Dale, IL, USA, 2000. [Google Scholar]
- Ulrich, D. Test of Gross Motor Development, Examiner’s Manual; Pro-ED. Inc.: Austin, TX, USA, 2000. [Google Scholar]
- Schoemaker, M. Manual of the Motor Observation Questionnaire for Teachers. In Groningen: Center for Human Movement Sciences; Dutch Internal Publication: Groningen, The Netherlands, 2003. [Google Scholar]
- Vles, J.; Kroes, M.; Feron, F. Maastrichtse Motoriek Test (MMT); PITS: Leiden, The Netherlands, 2004. [Google Scholar]
- Bruininks, B.D. Bruininks-Oseretsky Test of Motor Proficiency: BOT-2; NCS Pearson/AGS: Bloomington, MN, USA, 2005. [Google Scholar]
- Kiphard, E.J.; Schilling, F. Körperkoordinationstest Für Kinder: KTK; Beltz-Test: Weinheim, Germany, 2007. [Google Scholar]
- Henderson, S.E.; Sugden, D.; Barnett, A.L. Movement Assessment Battery for Children-2. (MABC-2); Examiner’s manual; The Psychological Corporation: London, UK, 2007. [Google Scholar]
- Wilson, B.N.; Crawford, S.G.; Green, D.; Roberts, G.; Aylott, A.; Kaplan, B.J. Psychometric Properties of the Revised Developmental Coordination Disorder Questionnaire. Phys. Occup. Ther. Pediatrics 2009, 29, 182–202. [Google Scholar] [CrossRef]
- Sabbadini, L. APCM-2—Abilità Prassiche e Della Coordinazione Motoria, 2nd ed.; Hogrefe: Florence, Italy, 2015. [Google Scholar]
- Chambers, M.; Sugden, D. Early Years Movement Skills: Description, Diagnosis and Intervention; Whurr: London, UK; Philadelphia, PA, USA, 2006; ISBN 978-1-86156-498-6. [Google Scholar]
- Kakebeeke, T.H.; Knaier, E.; Chaouch, A.; Caflisch, J.; Rousson, V.; Largo, R.H.; Jenni, O.G. Neuromotor development in children. Part 4: New norms from 3 to 18 years. Dev. Med. Child Neurol. 2018, 60, 810–819. [Google Scholar] [CrossRef] [Green Version]
- Smits-Engelsman, B.C.M.; Niemeijer, A.S.; van Waelvelde, H. Is the Movement Assessment Battery for Children-2nd edition a reliable instrument to measure motor performance in 3 year old children? Res. Dev. Disabil. 2011, 32, 1370–1377. [Google Scholar] [CrossRef] [PubMed]
- Schoemaker, M.M.; Niemeijer, A.S.; Flapper, B.C.T.; Smits-Engelsman, B.C.M. Validity and reliability of the Movement Assessment Battery for Children-2 Checklist for children with and without motor impairments. Dev. Med. Child Neurol. 2012, 54, 368–375. [Google Scholar] [CrossRef] [PubMed]
- Tseng, M.-H.; Fu, C.-P.; Wilson, B.N.; Hu, F.-C. Psychometric properties of a Chinese version of the Developmental Coordination Disorder Questionnaire in community-based children. Res. Dev. Disabil. 2010, 31, 33–45. [Google Scholar] [CrossRef] [PubMed]
- Prado, M.; Magalhães, L.; Wilson, B. Cross-cultural adaptation of the Developmental Coordination Disorder Questionnaire for Brazilian children. Braz. J. Phys. Ther. 2009, 13, 236–243. [Google Scholar] [CrossRef] [Green Version]
- Folio, M.R.; Fewell, R.R. Peabody developmental motor scales: Manual; George Peabody College for Teachers: Nashville, TN, USA, 1983. [Google Scholar]
- Ulrich, D.A.; Sanford, C.B. Test of Gross Motor Development; Pro-Ed: Austin, TX, USA, 1985. [Google Scholar]
- Bruininks, R.H. Bruininks-Oseretsky Test of Motor Proficiency; American Guidance Service: Circle Pines, MN, USA, 1978. [Google Scholar]
- Schilling, F.; Kiphard, E.J. Körperkoordinationstest Für Kinder: KTK; Beltz: Weinheim, Germany, 1974. [Google Scholar]
- Henderson, S.; Sugden, D. Movement Assessment Battery for Children; Movement ABC—Batteria per la Valutazione Motoria del Bambino 2000; The Psychological Corporation: London, UK, 1992. [Google Scholar]
- Chow, S.M.K.; Henderson, S.E.; Barnett, A.L. The Movement Assessment Battery for Children: A Comparison of 4-Year-Old to 6-Year-Old Children from Hong Kong and the United States. Am. J. Occup. Ther. 2001, 55, 55–61. [Google Scholar] [CrossRef] [Green Version]
- Chow, S.M.K.; Hsu, Y.-W.; Henderson, S.E.; Barnett, A.L.; Lo, S.K. The Movement ABC: A Cross-Cultural Comparison of Preschool Children from Hong Kong, Taiwan, and the USA. Adapt. Phys. Act. Q. 2006, 23, 31–48. [Google Scholar] [CrossRef] [Green Version]
- Marquet-Doléac, J.; Soppelsa, R.; Albaret, J. MABC-2 Batterie D’évaluation du Mouvement Chez L’enfant–2e Édition–Adaptation Française; Montreuil; Centre de Psychologie Appliquée: Montreuil, France, 2016. [Google Scholar]
- Zoia, S.; Biancotto, M.; Guicciardi, M.; Lecis, R.; Lucidi, F.; Pelamatti, G.M.; Carrozzi, M.; Skabar, A.; Sugden, D.A.; Barnett, A.L.; et al. An evaluation of the Movement ABC-2 Test for use in Italy: A comparison of data from Italy and the UK. Res. Dev. Disabil. 2019, 84, 43–56. [Google Scholar] [CrossRef]
- Hua, J.; Gu, G.; Meng, W.; Wu, Z. Age band 1 of the Movement Assessment Battery for Children-Second Edition: Exploring its usefulness in mainland China. Res. Dev. Disabil. 2013, 34, 801–808. [Google Scholar] [CrossRef]
- Largo, R.; Fischer, J.; Caflisch, J. Zurich Neuromotor Assessment; AWE Verlag: Zurich, Swizerland, 2002. [Google Scholar]
- Van Dellen, T.; Vaessen, W.; Schoemaker, M.M. Clumsiness: Definition and selection of subjects. In Developmental Biopsychology, Experimental and Observational Studies in Children at Risk; Kalverboer, A.F., Ed.; University of Michigan Press: Ann Arbor, MI, USA, 1990; pp. 135–152. [Google Scholar]
- Wilson, B.N.; Kaplan, B.J.; Crawford, S.G.; Campbell, A.; Dewey, D. Reliability and Validity of a Parent Questionnaire on Childhood Motor Skills. Am. J. Occup. Ther. 2000, 54, 484–493. [Google Scholar] [CrossRef] [Green Version]
- Nowak, A. Cross-cultural adaptation of the Developmental Coordination Disorder Questionnaire (DCDQ’07) for the population of Polish children. Biomed. Hum. Kinet. 2016, 8, 17–23. [Google Scholar] [CrossRef] [Green Version]
- Caravale, B.; Baldi, S.; Gasparini, C.; Wilson, B.N. Cross-cultural adaptation, reliability and predictive validity of the Italian version of Developmental Coordination Disorder Questionnaire (DCDQ). Eur. J. Paediatr. Neurol. 2014, 18, 267–272. [Google Scholar] [CrossRef]
- Schoemaker, M.M.; Flapper, B.; Verheij, N.P.; Wilson, B.N.; Reinders-Messelink, H.A.; de Kloet, A. Evaluation of the Developmental Coordination Disorder Questionnaire as a screening instrument. Dev. Med. Child Neurol. 2006, 48, 668. [Google Scholar] [CrossRef]
- Martini, R.; St-Pierre, M.-F.; Wilson, B.N. French Canadian Cross-Cultural Adaptation of the Developmental Coordination Disorder Questionnaire ’07: DCDQ-FC. Can. J. Occup. Ther. 2011, 78, 318–327. [Google Scholar] [CrossRef] [PubMed]
- Kennedy-Behr, A.; Wilson, B.; Rodger, S.; Mickan, S. Cross-Cultural Adaptation of the Developmental Coordination Disorder Questionnaire 2007 for German-Speaking Countries: DCDQ-G. Neuropediatrics 2013, 44, 245–251. [Google Scholar] [PubMed]
- Nakai, A.; Miyachi, T.; Okada, R.; Tani, I.; Nakajima, S.; Onishi, M.; Fujita, C.; Tsujii, M. Evaluation of the Japanese version of the Developmental Coordination Disorder Questionnaire as a screening tool for clumsiness of Japanese children. Res. Dev. Disabil. 2011, 32, 1615–1622. [Google Scholar] [CrossRef] [PubMed]
- Salamanca Duque, L.M.; Aristizábal, N.; Del Carmen, M.M.; González Marín, A.D.P. Traducción al español del cuestionario para diagnóstico de trastorno del desarrollo de la coordinación. Rev. Cienc. De La Salud 2012, 10, 31–42. [Google Scholar]
- Chambers, M.E.; Sugden, D.A. The Identification and Assessment of Young Children with Movement Difficulties Identification et e’valuation des jeunes souffrant de difficulte’s d’ordre moteur La Identificación y Evaluación de Niños de Preescolar con Problemas de Movimento. Int. J. Early Years Educ. 2002, 10, 157–176. [Google Scholar] [CrossRef]
- Moser, T.; Reikerås, E. Motor-life-skills of toddlers—A comparative study of Norwegian and British boys and girls applying the Early Years Movement Skills Checklist. Eur. Early Child. Educ. Res. J. 2016, 24, 115–135. [Google Scholar] [CrossRef]
- Iwamizu, J.S.; Dantas, L.E.P.B.T. Tradução e adaptação transcultural de um instrumento para identificação do perfil motor de crianças entre 3 e 5 anos. J. Phys. Educ. 2018, 29. [Google Scholar] [CrossRef] [Green Version]
- Kirby, A.; Sugden, D.; Purcell, C. Diagnosing developmental coordination disorders. Arch. Dis. Child. 2014, 99, 292. [Google Scholar] [CrossRef]
- Shadmehr, R.; Krakauer, J.W. A computational neuroanatomy for motor control. Exp. Brain Res. 2008, 185, 359–381. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Bhoyroo, R.; Hands, B.; Wilmut, K.; Hyde, C.; Wigley, A. Investigating motor planning in children with DCD: Evidence from simple and complex grip-selection tasks. Hum. Mov. Sci. 2018, 61, 42–51. [Google Scholar] [CrossRef] [PubMed]
- Blank, R.; Barnett, A.L.; Cairney, J.; Green, D.; Kirby, A.; Polatajko, H.; Rosenblum, S.; Smits-Engelsman, B.; Sugden, D.; Wilson, P.; et al. International clinical practice recommendations on the definition, diagnosis, assessment, intervention, and psychosocial aspects of developmental coordination disorder. Dev. Med. Child Neurol. 2019, 61, 242–285. [Google Scholar] [CrossRef] [PubMed]
- Livesey, D.; Coleman, R.; Piek, J. Performance on the Movement Assessment Battery for Children by Australian 3- to 5-year-old children. Child Care Health Dev. 2007, 33, 713–719. [Google Scholar] [CrossRef]
- Hands, B.; Larkin, D.; Rose, E. The psychometric properties of the McCarron Assessment of Neuromuscular Development as a longitudinal measure with Australian youth. Hum. Mov. Sci. 2013, 32, 485–497. [Google Scholar] [CrossRef] [Green Version]
- Brown, T.; Lalor, A. The Movement Assessment Battery for Children—Second Edition (MABC-2): A Review and Critique. Phys. Occup. Therapy Pediatrics 2009, 29, 86–103. [Google Scholar] [CrossRef]
- Tripathi, R.; Joshua, A.M.; Kotian, M.S.; Tedla, J.S. Normal Motor Development of Indian Children on Peabody Developmental Motor Scales-2 (PDMS-2). Pediatric Phys. Therapy 2008, 20, 167–172. [Google Scholar] [CrossRef]
- Vanvuchelen, M.; Mulders, H.; Smeyers, K. Onderzoek naar de bruikbaarheid van de recente Amerikaanse Peabody Developmental Motor Scales-2 voor vijfjarige, Vlaamse kinderen. Signaal J. Van De Sticht. Integr. Gehandicap. 2003, 45, 24–41. [Google Scholar]
Test | Authors and Year | Country, Language | Type | Age Range | N. Items | Test–Retest Reliability | Inter-Rater Reliability (Cohen’s k) | Internal Consistency (Cronbach’s α) | Concurrent Validity (M-ABC 2, r) | Cultural Adaptations |
---|---|---|---|---|---|---|---|---|---|---|
MOT 4–6 | Zimmer & Volkamer (1987) [21] | Germany, German | Performance measure | 4–6 yrs | 18 | 0.85 | 0.88 | 0.81 | NR | - |
MAND | McCarron (1997) [22] | US, English | Performance measure | 3.5–16 yrs | 10 | 0.99 | NR | NR | NR | - |
PDMS-2 | Folio & Fawell (2000) [23] | US, English | Performance measure | 0–6.11 yrs | 249 | 0.89–0.96 | 0.96 | 0.97 | NR | - |
TGMD-2 | Ulrich (2000) [24] | US, English | Performance measure | 3–10 yrs | 12 | 0.91 | 0.84–0.96 | 0.85–0.91 | NR | - |
MOQ-T | Schoemaker et al. (2003) [25] | The Netherlands, Dutch | Self-report questionnaire | 5–11 yrs | 18 | NR | NR | 0.95 | 0.57 | - |
MMT | Vles, Kroes & Feron (2004) [26] | The Netherlands, Dutch | Performance measure | 5–6 yrs | 70 | 0.43–0.93 | 0.83–0.97 | NR | NR | - |
BOTMP | Bruininks & Bruininks (2005) [27] | US, English | Performance measure | 4–21 yrs | Complete form: 53; Short form: 14 | 0.79 | 0.98 | 0.95–0.96 | rho = 0.80 | - |
KTK | (Kiphard & Schilling, 2007) [28] | Germany, German | Performance measure | 5–14 yrs | 4 | 0.85 | > 0.85 | NR | NR | - |
M-ABC 2 Motor test | Henderson, Sudgen & Barnett (2007) [29] | UK, English | Performance measure | 3–17 yrs | 3–6 yrs: 8; 7–10 yrs: 8; 11–16 yrs: 8 | ICC: 0.94 a | 0.58 a | 0.70–0.76 a | NR | Chinese, Dutch, Danish, Swedish, Italian, Japanese |
M-ABC 2 Checklist | Henderson, Sudgen & Barnett (2007) [29] | UK, English | Self-report questionnaire | 5–12 yrs | 30 | NR | NR | 0.94 b | 0.35–0.44 c | Chinese, Dutch, Danish, Swedish, Italian, Japanese |
DCDQ ‘07 | Wilson et al. (2009) [30] | Canada, English | Self-report questionnaire | 5–15 yrs | 15 | 0.94–0.97 d | NR | 0.89 | 0.76 | Polish, Taiwanese, Brazilian, Italian, Dutch, French Canadian, German, Japanese, Spanish |
APCM-2 | Sabbadini (2015) [31] | Italy, Italian | Performance measure | 2-8 yrs | 2–3 yrs short form: 37; 2–3 yrs: 58; 37–48 mon: 77; 49–60 mon: 80; 61–72 mon: 76; 6.1–8 yrs: 56 | NR | NR | >0.75 | NR | - |
EYMSC | Chambers & Sudgen (2006) [32] | UK, English | Self-report questionnaire | 3–5 yrs | 23 | 0.95 | 0.96 | NR | −0.55 | Norwegian, Portuguese, French, Dutch, German, Hebrew |
ZNA | Kakebeeke et al. (2018) [33] | Switzerland, German | Performance measure | 3–18 yrs | 11 | 0.84 | 0.92 | NR | NR | - |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Cancer, A.; Minoliti, R.; Crepaldi, M.; Antonietti, A. Identifying Developmental Motor Difficulties: A Review of Tests to Assess Motor Coordination in Children. J. Funct. Morphol. Kinesiol. 2020, 5, 16. https://doi.org/10.3390/jfmk5010016
Cancer A, Minoliti R, Crepaldi M, Antonietti A. Identifying Developmental Motor Difficulties: A Review of Tests to Assess Motor Coordination in Children. Journal of Functional Morphology and Kinesiology. 2020; 5(1):16. https://doi.org/10.3390/jfmk5010016
Chicago/Turabian StyleCancer, Alice, Rebecca Minoliti, Maura Crepaldi, and Alessandro Antonietti. 2020. "Identifying Developmental Motor Difficulties: A Review of Tests to Assess Motor Coordination in Children" Journal of Functional Morphology and Kinesiology 5, no. 1: 16. https://doi.org/10.3390/jfmk5010016
APA StyleCancer, A., Minoliti, R., Crepaldi, M., & Antonietti, A. (2020). Identifying Developmental Motor Difficulties: A Review of Tests to Assess Motor Coordination in Children. Journal of Functional Morphology and Kinesiology, 5(1), 16. https://doi.org/10.3390/jfmk5010016