Further Examination of the Psychometric Properties of the Multicomponent Mental Health Literacy Scale: Evidence from Chinese Elite Athletes
Abstract
:1. Introduction
1.1. Mental Disorders in Elite Athletes
1.2. The Role of Mental Health Literacy in the Prevention of Mental Disorders
1.3. Measurement Instruments for MHL
2. Materials and Methods
2.1. Participants
2.2. Procedure
2.3. Translation of the MMHLS into Chinese
2.4. Instrument
2.5. Data Analysis
3. Results
3.1. Preliminary Analysis
3.2. Factorial Validity
3.3. Convergent Validity and Discriminant Validity
3.4. Concurrent Validity
3.5. Internal-Consistency Reliability and Test–Retest Reliability
3.6. Rasch Analysis
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Küttel, A.; Larsen, C.H. Risk and protective factors for mental health in elite athletes: A scoping review. Int. Rev. Sport Exerc. Psychol. 2020, 13, 231–265. [Google Scholar] [CrossRef]
- Reardon, C.L.; Bindra, A.; Blauwet, C.; Budgett, R.; Campriani, N.; Currie, A.; Gouttebarge, V.; McDuff, D.; Mountjoy, M.; Purcell, R.; et al. Mental health management of elite athletes during COVID-19: A narrative review and recommendations. Br. J. Sport. Med. 2021, 55, 608–615. [Google Scholar] [CrossRef] [PubMed]
- Eime, R.M.; Young, J.A.; Harvey, J.T.; Charity, M.J.; Payne, W.R. A systematic review of the psychological and social benefits of participation in sport for children and adolescents: Informing development of a conceptual model of health through sport. Int. J. Behav. Nutr. Phys. Act. 2013, 10, 1–21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Taliaferro, L.A.; Eisenberg, M.E.; Johnson, K.E.; Nelson, T.F.; Neumark-Sztainer, D. Sport participation during adolescence and suicide ideation and attempts. Int. J. Adolesc. Med. Health 2011, 23, 3–10. [Google Scholar] [CrossRef] [PubMed]
- Gouttebarge, V.; Castaldelli-Maia, J.M.; Gorczynski, P.; Hainline, B.; Hitchcock, M.E.; Kerkhoffs, G.M.; Rice, S.; Reardon, C.L. Occurrence of mental health symptoms and disorders in current and former elite athletes: A systematic review and meta-analysis. Br. J. Sport. Med. 2019, 53, 700–706. [Google Scholar] [CrossRef] [Green Version]
- Tan, Y.; Cao, Z.; Wu, Y. Current research of psychological health of high-level athletes in Guangdong province. J. Sport. Adult Educ. 2014, 30, 48–51. [Google Scholar]
- Si, G.; Li, X.; Huang, Z.; Wang, D.; Wang, Y.; Liu, J.-D.; Liu, H.; Zhao, D.; Bu, D.; Zhang, C.-Q. The mental health of Chinese elite athletes: Revisiting the assessment methods and introducing a management framework. Int. J. Sport Exerc. Psychol. 2021, 1–15. [Google Scholar] [CrossRef]
- Purcell, R.; Gwyther, K.; Rice, S.M. Mental health in elite athletes: Increased awareness requires an early intervention framework to respond to athlete needs. Sports Med. -Open 2019, 5, 1–8. [Google Scholar] [CrossRef]
- Xanthopoulos, M.S.; Benton, T.; Lewis, J.; Case, J.A.; Master, C.L. Mental health in the young athlete. Curr. Psychiatry Rep. 2020, 22, 1–15. [Google Scholar] [CrossRef]
- Rice, S.M.; Purcell, R.; De Silva, S.; Mawren, D.; McGorry, P.D.; Parker, A.G. The mental health of elite athletes: A narrative systematic review. Sport. Med. 2016, 46, 1333–1353. [Google Scholar] [CrossRef] [Green Version]
- Gardner, F.; Moore, Z. Clinical Sport Psychology; Human Kinetics: Champaign, QC, Canada, 2006. [Google Scholar]
- Schinke, R.J.; Stambulova, N.B.; Si, G.; Moore, Z. International society of sport psychology position stand: Athletes’ mental health, performance, and development. Int. J. Sport Exerc. Psychol. 2018, 16, 622–639. [Google Scholar] [CrossRef]
- Dave, D.; Rashad, I.; Spasojevic, J. The effects of retirement on physical and mental health outcomes. South. Econ. J. 2008, 75, 497–523. [Google Scholar] [CrossRef]
- Jorm, A.F.; Korten, A.E.; Jacomb, P.A.; Christensen, H.; Rodgers, B.; Pollitt, P. “Mental health literacy”: A survey of the public’s ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med. J. Aust. 1997, 166, 182–186. [Google Scholar] [CrossRef]
- Jorm, A.F. Mental health literacy: Empowering the community to take action for better mental health. Am. Psychol. 2012, 67, 231. [Google Scholar] [CrossRef] [Green Version]
- Chow, G.M.; Bird, M.D.; Gabana, N.T.; Cooper, B.T.; Becker, M.A.S. A program to reduce stigma toward mental illness and promote mental health literacy and help-seeking in National Collegiate Athletic Association Division I student-athletes. J. Clin. Sport Psychol. 2020, 15, 185–205. [Google Scholar] [CrossRef]
- Bu, D.; Chung, P.-K.; Zhang, C.-Q.; Liu, J.; Wang, X. Mental health literacy intervention on help-seeking in athletes: A systematic review. Int. J. Environ. Res. Public Health 2020, 17, 7263. [Google Scholar] [CrossRef]
- Rickwood, D.; Deane, F.P.; Wilson, C.J.; Ciarrochi, J. Young people’s help-seeking for mental health problems. Aust. e-J. Adv. Ment. Health 2005, 4, 218–251. [Google Scholar] [CrossRef] [Green Version]
- Jung, H.; von Sternberg, K.; Davis, K. The impact of mental health literacy, stigma, and social support on attitudes toward mental health help-seeking. Int. J. Ment. Health Promot. 2017, 19, 252–267. [Google Scholar] [CrossRef]
- Han, Z.; Wang, D.; Ouyang, L.; Niu, P.; Yun, Z. Adaptation and psychometric properties of mental health literacy scale in Chinese elite athletes. Hubei Sport Sci. 2019, 38, 226–229. [Google Scholar]
- Ratnayake, P.; Hyde, C. Mental health literacy, help-seeking behaviour and wellbeing in young people: Implications for practice. Educ. Dev. Psychol. 2019, 36, 16–21. [Google Scholar] [CrossRef] [Green Version]
- O’Connor, M.; Casey, L.; Clough, B. Measuring mental health literacy–a review of scale-based measures. J. Ment. Health 2014, 23, 197–204. [Google Scholar] [CrossRef] [Green Version]
- Wei, Y.; McGrath, P.J.; Hayden, J.; Kutcher, S. Measurement properties of tools measuring mental health knowledge: A systematic review. BMC Psychiatry 2016, 16, 1–16. [Google Scholar] [CrossRef] [PubMed]
- Wang, J.; He, Y.; Jiang, Q.; Cai, J.; Wang, W.; Zeng, Q.; Miao, J.; Qi, X.; Chen, J.; Bian, Q.; et al. Mental health literacy among residents in Shanghai. Shanghai Arch. Psychiatry 2013, 25, 224. [Google Scholar]
- Compton, M.T.; Hankerson-Dyson, D.; Broussard, B. Development, item analysis, and initial reliability and validity of a multiple-choice knowledge of mental illnesses test for lay samples. Psychiatry Res. 2011, 189, 141–148. [Google Scholar] [CrossRef] [Green Version]
- Dias, P.; Campos, L.; Almeida, H.; Palha, F. Mental health literacy in young adults: Adaptation and psychometric properties of the mental health literacy questionnaire. Int. J. Environ. Res. Public Health 2018, 15, 1318. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- O’Connor, M.; Casey, L. The Mental Health Literacy Scale (MHLS): A new scale-based measure of mental health literacy. Psychiatry Res. 2015, 229, 511–516. [Google Scholar] [CrossRef] [Green Version]
- Jiang, G.; Zhao, C.; Wei, H.; Yu, L.; Li, D.; Lin, X.; Ren, Z. Mental health literacy: Connotation, measurement and new framework. Psychol Sci. 2020, 43, 232–238. [Google Scholar]
- Jung, H.; von Sternberg, K.; Davis, K. Expanding a measure of mental health literacy: Development and validation of a multicomponent mental health literacy measure. Psychiatry Res. 2016, 243, 278–286. [Google Scholar] [CrossRef]
- Sullivan, P.; Murphy, J.; Blacker, M. The psychometric properties of the multicomponent mental health literacy measure with a sample of student athletes and student athletic therapists. J. Appl. Sport Psychol. 2021, 33, 343–356. [Google Scholar] [CrossRef]
- Ming, Z.-J.; Chen, Z.-Y.; Wang, Y.-X. Reliability and validity of multicomponent mental health literacy measure-Chinese version in male military personnel. Chin. J. Public Health 2021, 37, 86–91. [Google Scholar]
- Lu, S.; Oldenburg, B.; Li, W.; He, Y.; Reavley, N. Population-based surveys and interventions for mental health literacy in China during 1997–2018: A scoping review. BMC Psychiatry 2019, 19, 1–12. [Google Scholar] [CrossRef]
- Hambleton, R.K.; Merenda, P.F.; Spielberger, C.D. Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In Adapting Educational and Psychological Tests for Cross-Cultural Assessment; Psychology Press: Mahwah, NJ, USA, 2004; pp. 15–50. [Google Scholar]
- McKay, R.B.; Breslow, M.J.; Sangster, R.L.; Gabbard, S.M.; Reynolds, R.W.; Nakamoto, J.M.; Tarnai, J. Translating survey questionnaires: Lessons learned. New Dir. Eval. 1996, 1996, 93–104. [Google Scholar] [CrossRef]
- Liang, W.; Wang, D.D.; Shang, B.R.; Zhang, C.-Q.; Duan, Y.P.; Si, G.Y. Further examination of the psychometric properties of the Brief Self-Control Scale: Evidence from Chinese athletes and students. Int. J. Sport Exerc. Psychol. 2022, 20, 16–35. [Google Scholar] [CrossRef]
- Fischer, E.H.; Turner, J.I. Orientations to seeking professional help: Development and research utility of an attitude scale. J. Consult. Clin. Psychol. 1970, 35, 79. [Google Scholar] [CrossRef]
- Hao, Z.-H. Revision of the questionnaire of attitudes toward seeking professional psychological help. Chin. J. Clin. Psychol. 2007, 15, 1. [Google Scholar]
- Hao, Z.-H.; Liang, B.-Y. Revision of the questionnaire of the intention of seeking counseling inventory. Chin. J. Clin. Psychol. 2011, 19, 309–311. [Google Scholar]
- DeVellis, R.F.; Thorpe, C.T. Scale Development: Theory and Applications; Sage Publications: New York, NY, USA, 2021. [Google Scholar]
- West, S.G.; Finch, J.F. Structural equation models with nonnormal variables: Problems and remedies. In Structural Equation Modeling: Concepts, Issues, and Applications; Sage Publications: New York, NY, USA, 1995. [Google Scholar]
- Finney, S.J.; DiStefano, C. Non-normal and categorical data in structural equation modeling. Struct. Equ. Model. A Second. Course 2006, 10, 269–314. [Google Scholar]
- Wang, J.; Wang, X. Structural Equation Modeling: Applications Using Mplus; John Wiley & Sons: Hoboken, NJ, USA, 2019. [Google Scholar]
- Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. A Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
- McDonald, R.P.; Ho, M.-H.R. Principles and practice in reporting structural equation analyses. Psychol. Methods 2002, 7, 64. [Google Scholar] [CrossRef] [PubMed]
- Raykov, T. Estimation of composite reliability for congeneric measures. Appl. Psychol. Meas. 1997, 21, 173–184. [Google Scholar] [CrossRef]
- Liu, H.-X.; Chow, B.-C.; Liang, W.; Hassel, H.; Huang, Y.W. Measuring a broad spectrum of eHealth skills in the Web 3.0 context using an eHealth Literacy Scale: Development and validation study. J. Med. Internet Res. 2021, 23, e31627. [Google Scholar] [CrossRef] [PubMed]
- Franke, G.; Sarstedt, M. Heuristics versus statistics in discriminant validity testing: A comparison of four procedures. Internet Res. 2019, 29, 430–447. [Google Scholar] [CrossRef]
- Wang, X.; Yan, Z.; Huang, Y.; Tang, A.; Chen, J. Re-Developing the Adversity Response Profile for Chinese University Students. Int. J. Environ. Res. Public Health 2022, 19, 6389. [Google Scholar] [CrossRef] [PubMed]
- Deneen, C.; Brown, G.T.; Bond, T.G.; Shroff, R. Understanding outcome-based education changes in teacher education: Evaluation of a new instrument with preliminary findings. Asia-Pac. J. Teach. Educ. 2013, 41, 441–456. [Google Scholar] [CrossRef]
- Testa, I.; Capasso, G.; Colantonio, A.; Galano, S.; Marzoli, I.; di Uccio, U.S.; Trani, F.; Zappia, A. Development and validation of a university students’ progression in learning quantum mechanics through exploratory factor analysis and Rasch analysis. Int. J. Sci. Educ. 2019, 41, 388–417. [Google Scholar] [CrossRef]
- Yan, Z.; Brubacher, S.; Boud, D.; Powell, M. Psychometric properties of the self-assessment practice scale for professional training contexts: Evidence from confirmatory factor analysis and Rasch analysis. Int. J. Train. Dev. 2020, 24, 357–373. [Google Scholar] [CrossRef]
- Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
- Bagozzi, R.P.; Yi, Y. On the evaluation of structural equation models. J. Acad. Mark. Sci. 1988, 16, 74–94. [Google Scholar] [CrossRef]
- Rasch, G. Probabilistic Models for Some Intelligence and Attainment Tests; ERIC: Chicago, IL, USA, 1993.
- Heinemann, A.W.; Michael Linacre, J.; Wright, B.D.; Hamilton, B.B.; Granger, C. Measurement characteristics of the functional independence measure. Top. Stroke Rehabil. 1994, 1, 1–15. [Google Scholar] [CrossRef]
- Conrad, K.J.; Dennis, M.L.; Bezruczko, N.; Funk, R.R.; Riley, B.B. Substance use disorder symptoms: Evidence of differential item functioning by age. J. Appl. Meas. 2007, 8, 373. [Google Scholar]
- Malhotra, N.; Hall, J.; Shaw, M.; Oppenheim, P. Marketing Research: An Applied Orientation; Pearson Education Australia: Frenchs Forest, Australia, 2006. [Google Scholar]
- DeBate, R.D.; Gatto, A.; Rafal, G. The effects of stigma on determinants of mental health help-seeking behaviors among male college students: An application of the information-motivation-behavioral skills model. Am. J. Men’s Health 2018, 12, 1286–1296. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Gorczynski, P.; Sims-Schouten, W.; Wilson, C. Evaluating mental health literacy and help-seeking behaviours in UK university students: A country wide study. J. Public Ment. Health 2020, 19, 311–319. [Google Scholar] [CrossRef] [Green Version]
- Gorczynski, P.; Currie, A.; Gibson, K.; Gouttebarge, V.; Hainline, B.; Castaldelli-Maia, J.M.; Mountjoy, M.; Purcell, R.; Reardon, C.L.; Rice, S.; et al. Developing mental health literacy and cultural competence in elite sport. J. Appl. Sport Psychol. 2021, 33, 387–401. [Google Scholar] [CrossRef]
Model | χ2 | df | χ2/df | CFI | TLI | RMSEA | RMSEA 90%CI |
---|---|---|---|---|---|---|---|
Model | 473.062 | 296 | 1.598 | 0.930 | 0.923 | 0.043 | 0.036–0.050 |
Model a | 364.813 | 249 | 1.465 | 0.955 | 0.950 | 0.038 | 0.029–0.046 |
Dimension | Item | M | SD | α | CR | AVE | 1 | 2 | 3 |
---|---|---|---|---|---|---|---|---|---|
1. MHL-Knowledge | 11 | 5.35 | 2.74 | 0.75 | 0.87 | 0.39 | 0.62 * | ||
2. MHL-Beliefs | 9 | 3.98 | 2.58 | 0.78 | 0.89 | 0.46 | 0.36 | 0.69 * | |
3. MHL-Resources | 4 | 1.79 | 1.49 | 0.78 | 0.92 | 0.73 | 0.42 | 0.19 | 0.86 * |
ATSPPH-SF | SSPPH | |
---|---|---|
MHL-Knowledge | 0.17 ** | −0.18 ** |
MHL-Belief | 0.17 ** | −0.14 * |
MHL-Resource | 0.16 ** | −0.20 ** |
Total MMHLS | 0.23 ** | −0.23 ** |
n | Knowledge | Beliefs | Resources | |
---|---|---|---|---|
M(SD) | M(SD) | M(SD) | ||
Male | 183 | 4.90 (2.69) | 3.42 (2.59) | 1.73 (1.53) |
Female | 138 | 5.94 (2.72) | 4.72 (2.39) | 1.86 (1.42) |
High school | 111 | 5.28 (2.63) | 3.83 (2.45) | 1.84 (1.51) |
University | 209 | 5.38 (2.81) | 4.06 (2.65) | 1.76 (1.47) |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wang, X.; Liang, W.; Liu, J.; Zhang, C.-Q.; Duan, Y.; Si, G.; Bu, D.; Zhao, D. Further Examination of the Psychometric Properties of the Multicomponent Mental Health Literacy Scale: Evidence from Chinese Elite Athletes. Int. J. Environ. Res. Public Health 2022, 19, 12620. https://doi.org/10.3390/ijerph191912620
Wang X, Liang W, Liu J, Zhang C-Q, Duan Y, Si G, Bu D, Zhao D. Further Examination of the Psychometric Properties of the Multicomponent Mental Health Literacy Scale: Evidence from Chinese Elite Athletes. International Journal of Environmental Research and Public Health. 2022; 19(19):12620. https://doi.org/10.3390/ijerph191912620
Chicago/Turabian StyleWang, Xiang, Wei Liang, Jingdong Liu, Chun-Qing Zhang, Yanping Duan, Gangyan Si, Danran Bu, and Daliang Zhao. 2022. "Further Examination of the Psychometric Properties of the Multicomponent Mental Health Literacy Scale: Evidence from Chinese Elite Athletes" International Journal of Environmental Research and Public Health 19, no. 19: 12620. https://doi.org/10.3390/ijerph191912620