Next Article in Journal
Metabolic, Oxidative and Psychological Stress as Mediators of the Effect of COVID-19 on Male Infertility: A Literature Review
Next Article in Special Issue
Effectiveness of a Co-Production with Dialogue Program for Reducing Stigma against Mental Illness: A Quasi-Experimental Study with a Pre- and Post-Test Design
Previous Article in Journal
Implementation Challenges and Recommendations for Employing Peer Support Workers in Emergency Departments to Support Patients Presenting after an Opioid-Related Overdose
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 19
Issue 9
10.3390/ijerph19095269
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effectiveness of Mental Health Literacy Curriculum among Undergraduate Public Health Students

by
Hsuan-Jung Lai
1,
Yin-Ju Lien
1,*,
Kai-Ren Chen
2 and
Yu-Kai Lin
3
1
Department of Health Promotion and Health Education, National Taiwan Normal University, 162, Heping East Road Section 1, Taipei 106, Taiwan
2
Department of Public Health, Fu Jen Catholic University, 510, Zhongzheng Road, New Taipei 242, Taiwan
3
Department of Health and Welfare, University of Taipei, 101, Zhongcheng Road Section 2, Taipei 111, Taiwan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(9), 5269; https://doi.org/10.3390/ijerph19095269
Submission received: 16 March 2022 / Revised: 22 April 2022 / Accepted: 23 April 2022 / Published: 26 April 2022
(This article belongs to the Special Issue Mental Health Literacy)
Versions Notes

Abstract

:
Mental health literacy (MHL) plays an important role in public health. Improving MHL can promote mental health at the individual and public levels. To date, no published studies have assessed the effectiveness of MHL curriculum interventions among undergraduate public health students. The participants in this study were undergraduate public health students (n = 48) who were enrolled in an 18-week MHL curriculum for 100 min per week. MHL was assessed using the Mental Health Literacy Scale for Healthcare Students. A paired sample t-test was performed to examine the immediate and delayed effects of the MHL curriculum. The total MHL score significantly improved, and a moderate effect size was found directly after the intervention and six weeks later. There were significant differences in the recognition of mental illness (p < 0.01), help-seeking efficacy (p < 0.05), and help-seeking attitude (p < 0.05) in the five components of MHL between pre- and post-test. Furthermore, significant improvements were obtained for the maintenance of positive mental health (p < 0.05) and reduction of mental illness stigma (p < 0.001) between the pre-test and follow-up. Our findings provide evidence for the development and implementation of an MHL curriculum for public health education.

1. Introduction

Jorm et al. [1] first defined mental health literacy (MHL) as “knowledge and beliefs about mental disorders which aid their recognition, management or prevention”. Jorm [2] then extended the concept of MHL into five elements: (1) understanding how to prevent mental illness; (2) understanding when a disorder is developing; (3) awareness of support and treatments for mental illness, (4) ability to effectively address mild mental health problems, and (5) mental health first aid skills to support others. Recently, Kutcher, Wei, and Coniglio [3] unified and expanded the definition of MHL. They proposed four components, namely: (1) knowledge about obtaining and maintaining good mental health; (2) understanding mental illnesses and treatments; (3) reducing mental illness-related stigma; and (4) enhancing help-seeking efficacy. Based on the definitions proposed by Jorm [2] and Kutcher et al. [3], Chao et al. [4] added help-seeking attitude as a component of MHL, because it was found to be a powerful predictor of help-seeking behavior [5].
A study investigating the prevalence of mental illness among university students found that the lifetime prevalence of at least one mental illness was 35.3%, and the 12-month prevalence was 31.4% [6]. During the COVID-19 pandemic, 71% of university students reported an increase in stress and anxiety [7]. Research has shown that 86% of undergraduates with mental health problems will drop out of school [8]. Despite the high prevalence of mental illness among university students, less than half seek professional help [9]. Possible reasons are poor MHL, such as inadequate positive mental health (i.e., the ability to manage stress or emotion) [10], lack of knowledge about mental illness [11,12], stigma associated with mental illness [12,13], and not understanding how to seek help [12,14]. Accordingly, MHL among university students must be improved.
Public health education aims to cultivate public health professionals in this respect [15,16]. Healthcare professionals are experiencing huge clinical care workloads after the COVID-19 outbreak, which has placed a heavy burden on their physical and mental health [17,18,19]. In addition to healthcare professionals, public health professionals are also under significant pressure due to outbreak investigations and epidemic management. A study in Taiwan indicated that work burnout is prevalent among public health staff; thus, mental health promotion or education programs are important for this group [20]. If mental health promotion and education can be started earlier during the university period, it can prevent public health students from being unable to complete their studies because of mental health problems. Moreover, it may help them detect mental health problems early, know how to seek help, and face these issues with a positive attitude in the event of a mental health crisis, which may ultimately promote their own mental health.
To date, interventions for MHL among university students have targeted medical, nursing, and pharmacology students [21,22,23,24]. In public health courses, curricula related to MHL cover mental health and general psychology. However, these are basic curricula, comprising just two hours per week for a single semester. To our knowledge, there has been no published research on the effects of MHL interventions on undergraduates in public health to date. Therefore, this intervention study aimed to improve MHL among undergraduate public health students. We hypothesized that students would demonstrate superior MHL after completing the MHL curriculum.

2. Methods

2.1. Participants

The inclusion criteria for participation were current enrollment in an undergraduate program in a public health-related department, and aged 18 years old or over. The participants were at two universities in the Taipei Metro Area. This study was conducted using convenience sampling between September 2020 and February 2021. The evaluation involved a one-group pretest-posttest design. Before and after the study, the students were asked to fill out a questionnaire in class. It took approximately 10 min to complete. In total, 60 students participated in the MHL curriculum on their own, but only 48 completed the pre-test, post-test, and six-week follow-up, an 80% response rate. To encourage participation, participants were compensated around NT$ 150 after completing the surveys.
To confirm that the sample size in the study had appropriate statistical power, G*Power 3.1 (Heinrich-Heine-Universität, Düsseldorf, Germany) was used to calculate the sample size [25]. The results indicated that 34 participants would be required, where α = 0.5, β = 0.2, assuming a moderate effect size (d = 0.5). The data of 12 people were missing more than 10% of the overall data; thus, these were regarded as invalid and were deleted [26]. As mentioned, 48 participants completed three valid surveys. Therefore, the sample size is adequate.

2.2. Intervention

We used content analysis, modified Delphi method and a focus group interview to develop the curricula modules of MHL in public education. In order to construct a curriculum with the five major components of MHL, the present research reviewed previous studies and research projects to develop a modified Delphi questionnaire. A panel of experts and scholars were invited to participate in the modified Delphi process. After two rounds of modified Delphi surveys, fourteen MHL learning objectives and sixty-eight learning components were constructed. On the basis of these findings, an 18-week MHL curriculum was developed which was thoroughly evaluated by means of a student focus group and an expert focus group. This intervention was an 18-week MHL curriculum of 100 min per week. It consisted of four main sections with a variety of delivery modes: (1) MHL lectures delivered in elective courses by the two professors specializing in mental health and with experience in the field; (2) people with mental illnesses were invited to discuss their mental status and recovery, and to answer students’ questions about mental illness; (3) films or short videos providing students with mental health-related knowledge and experience; and (4) group presentations requiring students to cooperate with each other and learn more about MHL-related issues. The curriculum materials included PowerPoint presentations, supplementary videos, and books related to MHL. The MHL curriculum contained several components (see Table 1) including:
  • Maintenance of positive mental health: Students acquire positive mental health-related concepts and skills by learning about self-concept, self-esteem, self-efficacy, and self-regulation; human relationships and communication skills; and stress and emotion management.
  • Recognition of mental illness and reduction of stigma: Students obtain knowledge regarding the symptoms, epidemiology, prevention, and treatment of common mental disorders (i.e., depression, anxiety, schizophrenia), and can identify negative attitudes toward mental illness.
  • Help-seeking efficacy and attitude: Students obtain knowledge regarding improving their own and others’ help-seeking resources, skills, and attitudes.
Table
Table 1. MHL curriculum components, target concepts and delivery mode.
Table 1. MHL curriculum components, target concepts and delivery mode.
MHL ComponentsTarget ConceptsDelivery Mode
Maintenance of positive mental healthSelf-concept, self-esteem, self-efficacy and self-regulation, human relationships and communication skills, stress and emotion managementLecture, cooperative learning
Recognition of mental illnessMental illness and global mental health review, depression, bipolar disorder, anxiety disorder, schizophrenia, suicide and self-mutilationLecture, direct contact (face-to-face), indirect contact (film based), cooperative learning
Reduction of stigma associated with mental illness The impact of mental illness stigma, strategies for stigma reductionLecture, direct contact (face-to-face), indirect contact (film based), cooperative learning
Recognition of mental illness, reduction of stigma associated with mental illness To understand mental illness and reduce mental illness stigma by visiting mental rehabilitation institutions and watching a video related to mental illness and the process of rehabilitationLecture, direct contact (face-to-face), indirect contact (film based), cooperative learning
Help-seeking efficacy, help-seeking attitudeResources of mental health care, help-seeking and helping skillsLecture, indirect contact (film based), cooperative learning

2.3. Measures

2.3.1. Demographics

Participants were asked to complete a demographics questionnaire that included items on gender, age, and living situation (i.e., with family, with relatives, with roommates, with friends, or alone).

2.3.2. Level of Contact Report

The revised version of the Level of Contact Report [LCR] was developed by Corrigan et al. [27] to assess familiarity with mental illness. It consists of eight options regarding people’s intimacy with people with mental illness, ranging from low intimacy (“I have never observed a person that I was aware had a mental illness”) to high intimacy (“I have a mental illness”). Scores range from 0–7, with higher scores indicating higher familiarity with mental illness. Previous studies have confirmed the interrater reliability and validity of this instrument [28,29].

2.3.3. Positive Mental Health Scale

The five-item revised Positive Mental Health Scale (PMHS) was developed by Lukat, Margraf, Lutz, van der Veld, and Becker [30] to assess mental health status. It consists of a five-point Likert scale ranging from 1 (completely disagree) to 5 (completely agree). Higher scores indicate a more positive mental health status. The PMHS has demonstrated high internal consistency reliability (α = 0.93) [30].

2.3.4. Mental Health Literacy Scale for Healthcare Students

Chao et al. [4] developed a 26-item mental health literacy scale for healthcare students [MHLS-HS] to assess MHL. It consists of a five-point Likert scale ranging from 1 (completely disagree) to 5 (completely agree). Higher scores indicate higher levels of MHL. The MHLS-HS has demonstrated good construct validity (factorial, convergent, discriminant, and known groups validity) (α = 0.81) [4]. It comprises five subscales: maintenance of positive mental health, recognition of mental illness, attitude toward mental illness stigma, help-seeking efficacy, and help-seeking attitude.
The 10-item maintenance of the positive mental health subscale addresses knowledge of competence, autonomy, relatedness, and resilience. It consists of a five-point Likert scale ranging from 1 (completely disagree) to 5 (completely agree). A higher score indicates higher knowledge of positive mental health. The subscale has demonstrated good internal consistency and reliability (α = 0.87) [4]. The four-item recognition of mental illness subscale addresses knowledge about mental illness. It consists of a five-point Likert scale ranging from 1 (completely disagree) to 5 (completely agree). Higher scores indicate more comprehensive knowledge of mental illness. The subscale has demonstrated acceptable internal consistency reliability (α = 0.70) [4]. The six-item mental illness stigma attitude subscale addresses public stigma, dangerousness, and emotional reaction. It consists of a five-point Likert scale ranging from 1 (completely disagree) to 5 (completely agree). All items were reverse scored, and as such, higher scores indicate less problematic attitudes toward mental illness stigma. The subscale has demonstrated acceptable internal consistency reliability (α = 0.76) [4]. The three-item help-seeking efficacy subscale addresses knowledge of when and where to seek professional mental help. It consists of a five-point Likert scale ranging from 1 (completely disagree) to 5 (completely agree). Higher scores indicate more comprehensive help-seeking knowledge. The subscale has demonstrated good internal consistency reliability (α = 0.81) [4]. The three-item help-seeking attitude subscale addresses attitudes toward seeking mental professional help. It consists of a five-point Likert scale ranging from 1 (completely disagree) to 5 (completely agree). Higher scores indicate a greater inclination for help-seeking behavior. The subscale has demonstrated acceptable internal consistency reliability (α = 0.72) [4].

2.4. Data Analysis

All statistical analyses were conducted using SPSS version 25 (IBM Corp., Armonk, NY, USA). Frequencies and percentages were calculated for categorical variables, and the means and standard deviations were calculated for continuous variables. A paired sample t-test and Cohen’s d test were performed to evaluate the effectiveness of the MHL curriculum intervention. Statistical significance for all analyses was expressed as p-value less than 0.05. Cohen’s d of less than 0.2 represents a small effect, about 0.5 represents a moderate effect, and higher than 0.8 represents a large effect [31].

2.5. Ethical Procedures

Ethical approval for this study was obtained from local Research Ethics Committees (NTNUREC-201905HS015, No. FJU-IRB NO: C108185). All participants provided written informed consent.

3. Results

3.1. Descriptive Statistics of Participant Characteristics

As noted, 48 students (11 males and 37 females) completed the intervention. Table 2 provides the characteristics of the participants. The majority of the sample was in the second year of undergraduate studies (97.92%). The mean age was 20.47 years (SD = 0.62), and around 62.50% reported living with their families. The mean score of the Level of Contact Report was 3.52 (SD = 1.76), which was between low and medium (range 2–4). The mean score of the Positive Mental Health Scale was 18.04 (SD = 3.47), which was at high levels (range 15.75–25). The mean scores of MHL and five components at baseline were all high based on the corresponding range of scores.

3.2. Effectiveness of the Mental Health Literacy Curriculum

The degree of change between pre- and post-test scores differed significantly (p < 0.001): the post-test scores (M = 108.08, SD = 9.30) were higher than the pre-test scores (M = 103.25, SD = 8.38) with a moderate effect size (d = 0.55) (Table 3). To examine the effectiveness of the MHL curriculum on the five components of MHL, the pre- and post-test scores were analyzed. The results showed borderline differences for maintenance of positive mental health (p = 0.06) and reducing mental illness stigma (p = 0.09). However, compared to the pre-test scores, the relevant scores in both components significantly increased post-test (see Table 3). The post-test scores increased significantly compared to the pre-test scores for recognition of mental illness (p < 0.01), help-seeking efficacy (p < 0.05), and help-seeking attitude (p < 0.05). A small to moderate effect size was found for the recognition of mental illness (d = 0.48), help-seeking efficacy (d = 0.35), and help-seeking attitude (d = 0.39). Significant increases were found for each component of MHL (Table 3).
Regarding the degree of change between the pre-test and follow-up scores, the change in total MHL scores differed significantly (p < 0.01): the follow-up scores (M = 108.60, SD = 9.83) were higher than the pre-test scores (M = 103.25, SD = 8.38) with a moderate effect size (d = 0.59) (Table 4). Statistically significant changes were evident in the pre-test and follow-up scores for maintenance of positive mental health (p < 0.05) and reducing mental illness stigma (p < 0.001). A moderate effect size was found for maintenance of positive mental health (d = 0.49) and reducing mental illness stigma (d = 0.49). There were also significant changes in the items related to both components (see Table 4). In contrast, for recognition of mental illness, help-seeking efficacy, and help-seeking attitude, only small increases were found after the intervention. Compared to the pre-test scores, there was no difference in the follow-up for any item related to the recognition of mental illness. However, there were significant differences for help-seeking efficacy and help-seeking attitude (Table 4).

4. Discussion

To the best of our knowledge, this is the first study to examine the effectiveness of MHL interventions among undergraduate public health students. The students’ MHL may have been improved by the educational intervention, which is consistent with prior studies [32,33,34,35]. Research has found that regularly providing an MHL educational curriculum can improve students’ knowledge of mental illness and reduce stigmatizing attitudes significantly and consistently [36]. Atkins, Hoagwood, Kutash, and Seidman [37] and Mcluckie, Kutcher, Wei, and Weaver [38] indicated that school is the most influential environment for students’ cognitive and social development. Therefore, students could improve their MHL by regularly following MHL curricula.
Our MHL intervention had different immediate or delayed effects on each component of MHL. First, we found a significant immediate rather than delayed effect for recognition of mental illness. This indicated that newly acquired knowledge from the intervention might gradually decrease over time, which is in line with previous research [39]. One study showed that the transition from short- to long-term memory requires long-term educational interventions, but long-term intervention is still affected by information overload. Therefore, content related to mental illness should be easy to understand [40]. After the curriculum, information related to mental illness in the mass media and on the Internet may lead to information anxiety among students. An overload of relevant information meant that students cannot determine what is correct [41]. It is suggested that the content of the MHL curriculum be combined to distinguish true and false content regarding mental illness in the mass media or on the Internet in order to reduce information anxiety.
Second, as hypothesized, our study showed that undergraduates’ help-seeking efficacy significantly improved, which is in line with the results of previous studies [3,33]. One study indicated that a school-based MHL intervention effectively improved adolescents’ knowledge of mental illness and help-seeking behavior [33]. A possible reason for this is that interventions at school can provide a complete curriculum, and students can continuously acquire knowledge related to mental health. However, the observed delayed effect decreased over time. A systematic review showed that five facilitators can effectively promote the MHL of adolescents by using interactive teaching methods, supplying diverse educational content, employing trainers with different backgrounds, having direct contact with people with mental illness, and utilizing technological advancements in education [42]. In this study, lecture and cooperative learning were used as teaching strategies for the maintenance of positive mental health, while lectures, contact-based education and cooperative learning were used to improve students’ ability to recognize mental illness, reduce mental illness stigma, increase help-seeking efficacy, and improve help-seeking attitudes. However, only immediate or delayed effects were obtained for each component in this study. Accordingly, it is suggested that a variety of teaching methods (i.e., more than lectures and contact-based education or cooperative learning) be used to increase the effect of such interventions.
Third, the results of this study were consistent with those of others, e.g., that help-seeking attitudes improved significantly after completing the curriculum [43,44]. The literature shows that knowledge of mental illnesses [2], mental illness stigma [45,46,47], and help-seeking efficacy [48] affect help-seeking attitudes. Our MHL curriculum included aspects such as the recognition of mental illness, mental illness stigma, and help-seeking efficacy, which led to significant improvements after the intervention. Accordingly, these findings might account for the increased positive help-seeking attitude.
Fourth, we found a delayed effect in the maintenance of positive mental health. However, research has shown that the positive mental health of adolescents improved immediately after the MEST (MEST is a short version of the Norwegian word for coping) intervention [49]. The intervention aimed to promote positive mental health and well-being among adolescents by inviting them to attend a one-year course. It provided information about understanding personal emotional changes, stress management, relaxation techniques, self-esteem, sleep hygiene, and other related topics [49]. The period of our intervention was shorter than that of the MEST intervention, and the content of our curriculum did not focus solely on the maintenance or improvement of mental health. These factors might have caused the absence of immediate effects in this component of our study. However, the MHL intervention might increase students’ levels of interest in positive mental health and enhance their ability to subsequently assimilate relevant knowledge. This may result in a delayed intervention effect on the maintenance of positive mental health.
Finally, a delayed effect was also found for reducing stigmatizing attitudes toward mental illness. It is noteworthy is that several studies in Western countries showed that destigmatizing interventions had a significant immediate effect on reducing stigmatizing attitudes toward mental illness [50,51,52], or both immediate and delayed effects simultaneously [53]. Prior studies also confirmed culture as one of the factors affecting attitudes toward mental illness. In Asia, a diagnosis of a mental illness is considered shameful. Compared to Western countries, the stigma associated with mental illness is worse in Asian countries [47]. As such, more time may be needed to change attitudes toward mental illness in Asia. To this end, our intervention might increase students’ levels of interest in mental illness, even after the MHL program. This may help students gradually change their attitudes.
This study had several limitations. First, it was conducted using convenience sampling, which limits its generalizability to broader populations. Future research should include more representative samples, e.g., by expanding the intervention to public health students across Taiwan. Second, the sample size calculation was based on a moderate effect size (d = 0.5). The fact that the effect sizes of some components were small might indicate that the sample size was inadequate. Due to the lack of statistical power, the results might be insignificant. Thus, in future studies, the sample size should be increased. Third, the follow-up took place six weeks after the intervention, and a longer effect could not be determined. Future studies could extend the duration of the follow-up to determine whether the results are maintained beyond a six-week period. Finally, the self-reported questionnaire might have led participants to choose options which were inconsistent with their own ideas in order to meet social norms.

5. Conclusions

An MHL curriculum may increase the level of MHL among undergraduate public health students. Our findings provide a foundation for the development and implementation of an MHL curriculum for students of public health. Based on this study, we suggest that the program form a mandatory part of the curriculum for public health students and be provided to various students to improve their MHL.

Author Contributions

Conceptualization, H.-J.L. and Y.-J.L.; Data curation, H.-J.L., Y.-J.L. and K.-R.C.; Formal analysis, H.-J.L.; Funding acquisition, Y.-J.L.; Investigation, H.-J.L., Y.-J.L., K.-R.C. and Y.-K.L.; Methodology, H.-J.L. and Y.-J.L.; Project administration, H.-J.L. and Y.-J.L.; Resources, Y.-J.L.; Supervision, Y.-J.L.; Writing—original draft, H.-J.L.; Writing—review & editing, Y.-J.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by grants from the Ministry of Science and Technology, Taiwan (MOST 108-2410-H-003-079-MY2). The Ministry of Science and Technology of Taiwan was not involved in the study design, data collection, analysis, interpretation, or writing of the manuscript.

Institutional Review Board Statement

The ethical approval for this study was obtained from local Research Ethics Committees (NTNUREC-201905HS015, No. FJU-IRB NO: C108185).

Informed Consent Statement

Written informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Acknowledgments

We thank all participants who kindly volunteered to take part in this study. This article was subsidized by the National Taiwan Normal University (NTNU), Taiwan, ROC.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Jorm, A.F.; Korten, A.E.; Jacomb, P.A.; Christensen, H.; Rodgers, B.; Pollitt, P. “Mental health literacy”: A survey of the public’s ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med. J. Aust. 1997, 166, 182–186. [Google Scholar] [CrossRef] [PubMed]
  2. Jorm, A.F. Mental health literacy: Empowering the community to take action for better mental health. Am. Psychol. 2012, 67, 231–243. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Kutcher, S.; Wei, Y.; Coniglio, C. Mental health literacy: Past, present, and future. Can. J. Psychiatry 2016, 61, 154–158. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Chao, H.J.; Lien, Y.J.; Kao, Y.C.; Tasi, I.C.; Lin, H.S.; Lien, Y.Y. Mental health literacy in healthcare students: An expansion of the mental health literacy scale. Int. J. Environ. Res. Public Health 2020, 17, 948. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Li, W.; Dorstyn, D.S.; Denson, L.A. Psychosocial correlates of college students’ help-seeking intention: A meta-analysis. Prof. Psychol. Res. Pract. 2014, 45, 163–170. [Google Scholar] [CrossRef]
  6. Auerbach, R.P.; Mortier, P.; Bruffaerts, R.; Alonso, J.; Benjet, C.; Cuijpers, P.; Demyttenaere, K.; Ebert, D.D.; Green, J.G.; Hasking, P.; et al. WHO WMH-ICS Collaborators. WHO world mental health surveys international college student project: Prevalence and distribution of mental disorders. J. Abnorm. Psychol. 2018, 127, 623–638. [Google Scholar] [CrossRef]
  7. Son, C.; Hegde, S.; Smith, A.; Wang, X.; Sasangohar, F. Effects of COVID-19 on college students’ mental health in the United States: Interview survey study. J. Med. Internet Res. 2020, 22, e21279. [Google Scholar] [CrossRef]
  8. Reavley, N.J.; McCann, T.V.; Jorm, A.F. Mental health literacy in higher education students. Early Interv. Psychiatry 2012, 6, 45–52. [Google Scholar] [CrossRef]
  9. Eisenberg, D.; Hunt, J.; Speer, N.; Zivin, K. Mental health service utilization among college students in the United States. J. Nerv. Ment. Dis. 2011, 199, 301–308. [Google Scholar] [CrossRef]
  10. Lai, E.S.Y.; Kwok, C.-L.; Wong, P.W.C.; Fu, K.-W.; Law, Y.-W.; Yip, P.S.F. The effectiveness and sustainability of a universal school-based programme for preventing depression in Chinese adolescents: A follow-up study using quasi-experimental design. PLoS ONE 2016, 11, e0149854. [Google Scholar] [CrossRef] [Green Version]
  11. Bonabi, H.; Müller, M.; Ajdacic-Gross, V.; Eisele, J.; Rodgers, S.; Seifritz, E.; Rössler, W.; Rüsch, N. Mental health literacy, attitudes to help seeking, and perceived need as predictors of mental health service use: A longitudinal study. J. Nerv. Ment. Dis. 2016, 204, 321–324. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Henderson, C.; Evans-Lacko, S.; Thornicroft, G. Mental illness stigma, help seeking, and public health programs. Am. J. Public Health 2013, 103, 777–780. [Google Scholar] [CrossRef] [PubMed]
  13. Henderson, C.; Noblett, J.; Parke, H.; Clement, S.; Caffrey, A.; Gale-Grant, O.; Schulze, B.; Druss, B.; Thornicroft, G. Mental health-related stigma in health care and mental health-care settings. Lancet Psychiatry 2014, 1, 467–482. [Google Scholar] [CrossRef]
  14. Fischbein, R.; Bonfine, N. Pharmacy and medical students’ mental health symptoms, experiences, attitudes and help-seeking behaviors. Am. J. Pharm. Educ. 2019, 83, 7558. [Google Scholar] [CrossRef] [PubMed]
  15. Chen, W.J.; Chiang, T.L. Public Health Education and Workforce: Current Status and Perspectives; National Health Research Institutes: Zhunan, Taiwan, 2010. [Google Scholar]
  16. Sullivan, L.; Magaña, L.; Galea, S. Peering into the future of public health teaching. Lancet Public Health 2018, 3, e268. [Google Scholar] [CrossRef]
  17. Frenkel, M.O.; Pollak, K.M.; Schilling, O.; Voigt, L.; Fritzsching, B.; Wrzus, C.; Egger-Lampl, S.; Merle, U.; Weigand, M.A.; Mohr, S. Stressors faced by healthcare professionals and coping strategies during the early stage of the COVID-19 pandemic in Germany. PLoS ONE 2022, 17, e0261502. [Google Scholar] [CrossRef]
  18. Huang, J.Z.; Han, M.F.; Luo, T.D.; Ren, A.K.; Zhou, X.P. Mental health survey of medical staff in a tertiary infectious disease hospital for COVID-19. Chin. J. Ind. Hyg. Occup. Dis. 2020, 38, 192–195. [Google Scholar] [CrossRef]
  19. Vasiliu, O.; Marinescu, I.; Vasile, D. Diagnostic and treatment features of work stress-related disorders in healthcare professionals in the context of COVID-19 pandemic. Psihiatru.ro 2021, 66, 22–29. [Google Scholar] [CrossRef]
  20. Liu, T.Y.; Li, C.J.; Su, C.H.; Wu, P.L. Relationship among emotional labor, emotional intelligence and job burnout of public health staff. Policy Pers. Manag. 2016, 7, 89–114. [Google Scholar] [CrossRef]
  21. Bond, K.S.; Jorm, A.F.; Kitchener, B.A.; Reavley, N.J. Mental health first aid training for Australian medical and nursing students: An evaluation study. BMC Psychol. 2015, 3, 11. [Google Scholar] [CrossRef] [Green Version]
  22. Liu, W. The effects of virtual simulation on undergraduate nursing students’ mental health literacy: A prospective cohort study. Issues Ment. Health Nurs. 2020, 42, 239–248. [Google Scholar] [CrossRef] [PubMed]
  23. Patten, S.B.; Remillard, A.; Phillips, L.; Modgill, G.; Szeto, A.C.; Kassam, A.; Gardner, D.M. Effectiveness of contact-based education for reducing mental illness-related stigma in pharmacy students. BMC Med. Educ. 2012, 12, 120. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Papish, A.; Kassam, A.; Modgill, G.; Vaz, G.; Zanussi, L.; Patten, S. Reducing the stigma of mental illness in undergraduate medical education: A randomized controlled trial. BMC Med. Educ. 2013, 13, 141. [Google Scholar] [CrossRef] [Green Version]
  25. Faul, F.; Erdfelder, E.; Buchner, A.; Lang, A.-G. Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 2009, 41, 1149–1160. [Google Scholar] [CrossRef] [Green Version]
  26. Cohen, J.; Cohen, P. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences; Erlbaum: Hillsdale, NJ, USA, 1983. [Google Scholar]
  27. Corrigan, P.W.; Lurie, B.D.; Goldman, H.H.; Slopen, N.; Medasani, K.; Phelan, S. How adolescents perceive the stigma of mental illness and alcohol abuse. Psychiatr. Serv. 2005, 56, 544–550. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Corrigan, P.W.; Green, A.; Lundin, R.; Kubiak, M.A.; Penn, D.L. Familiarity with and social distance from people who have serious mental illness. Psychiatr. Serv. 2001, 52, 953–958. [Google Scholar] [CrossRef]
  29. Holmes, E.P.; Corrigan, P.W.; Williams, P.; Canar, J.; Kubiak, M.A. Changing attitudes about schizophrenia. Schizophr. Bull. 1999, 25, 447–456. [Google Scholar] [CrossRef]
  30. Lukat, J.; Margraf, J.; Lutz, R.; van der Veld, W.M.; Becker, E.S. Psychometric properties of the Positive Mental Health Scale (PMH-scale). BMC Psychol. 2016, 4, 8. [Google Scholar] [CrossRef] [Green Version]
  31. Cohen, J. Statistical Power Analysis for the Behavioral Sciences; Academic Press: New York, NY, USA, 1977. [Google Scholar]
  32. Hunt, S.; Wei, Y.; Kutcher, S. Addressing mental health literacy in a UK university campus population: Positive replication of a Canadian intervention. Health Educ. J. 2019, 78, 537–544. [Google Scholar] [CrossRef]
  33. Lindow, J.C.; Hughes, J.L.; South, C.; Minhajuddin, A.; Gutierrez, L.; Bannister, E.; Trivedi, M.H.; Byerly, M.J. The youth aware of mental health intervention: Impact on help seeking, mental health knowledge, and stigma in U.S. adolescents. J. Adolesc. Health 2020, 67, 101–107. [Google Scholar] [CrossRef]
  34. Moll, S.E.; Patten, S.; Stuart, H.; MacDermid, J.C.; Kirsh, B. Beyond silence: A randomized, parallel-group trial exploring the impact of workplace mental health literacy training with healthcare employees. Can. J. Psychiatry 2018, 63, 826–833. [Google Scholar] [CrossRef] [PubMed]
  35. Perry, Y.; Petrie, K.; Buckley, H.; Cavanagh, L.; Clarke, D.; Winslade, M.; Hadzi-Pavlovic, D.; Manicavasagar, V.; Christensen, H. Effects of a classroom-based educational resource on adolescent mental health literacy: A cluster randomised controlled trial. J. Adolesc. 2014, 37, 1143–1151. [Google Scholar] [CrossRef] [PubMed]
  36. Kitchener, B.A.; Jorm, A.F. Mental health first aid training: Review of evaluation studies. Aust. N. Z. J. Psychiatry 2006, 40, 6–8. [Google Scholar] [CrossRef] [PubMed]
  37. Atkins, M.S.; Hoagwood, K.E.; Kutash, K.; Seidman, E. Toward the integration of education and mental health in schools. Adm. Policy Ment. Health 2010, 37, 40–47. [Google Scholar] [CrossRef] [Green Version]
  38. Mcluckie, A.; Kutcher, S.; Wei, Y.; Weaver, C. Sustained improvements in students’ mental health literacy with use of a mental health curriculum in Canadian schools. BMC Psychiatry 2014, 14, 379. [Google Scholar] [CrossRef] [Green Version]
  39. Ibrahim, N.; Mohd Safien, A.; Siau, C.S.; Shahar, S. The effectiveness of a depression literacy program on stigma and mental help-seeking among adolescents in Malaysia: A control group study with 3-month follow-up. Inq.-J. Health Care Organ. Provis. Financ. 2020, 57, 0046958020902332. [Google Scholar] [CrossRef]
  40. Corrigan, P.W. Beware the educational fix: Limitations of efforts to promote mental health literacy. Psychiatr. Serv. 2018, 69, 469–471. [Google Scholar] [CrossRef]
  41. Wurman, R.S. Information Anxiety; Doubleday: New York, NY, USA, 1989. [Google Scholar]
  42. Mohammadi, A.S.; Panahi, S.; Sayarifard, A.; Ashouri, A. Identifying the prerequisites, facilitators, and barriers in improving adolescents’ mental health literacy interventions: A systematic review. J. Educ. Health Promot. 2020, 9, 322. [Google Scholar] [CrossRef]
  43. Kurki, M.; Gilbert, S.; Mishina, K.; Lempinen, L.; Luntamo, T.; Hinkka-Yli-Salomäki, S.; Sinokki, A.; Upadhyaya, S.; Wei, Y.; Sourander, A. Digital mental health literacy-program for the first-year medical students’ wellbeing: A one group quasi-experimental study. BMC Med. Educ. 2021, 21, 563. [Google Scholar] [CrossRef]
  44. Fernandez, A.; Tan, K.-A.; Knaak, S.; Chew, B.H.; Ghazali, S.S. Effects of brief psychoeducational program on stigma in Malaysian pre-clinical medical students: A randomized controlled trial. Acad. Psychiatry 2016, 40, 905–911. [Google Scholar] [CrossRef]
  45. Lauber, C.; Rössler, W. Stigma towards people with mental illness in developing countries in Asia. Int. Rev. Psychiatry 2007, 19, 157–178. [Google Scholar] [CrossRef] [PubMed]
  46. Martinez, A.B.; Co, M.; Lau, J.; Brown, J.S.L. Filipino help-seeking for mental health problems and associated barriers and facilitators: A systematic review. Soc. Psychiatry Psychiatr. Epidemiol. 2020, 55, 1397–1413. [Google Scholar] [CrossRef] [PubMed]
  47. Zhang, Z.; Sun, K.; Jatchavala, C.; Koh, J.; Chia, Y.; Bose, J.; Li, Z.; Tan, W.; Wang, S.; Chu, W.; et al. Overview of stigma against psychiatric illnesses and advancements of anti-stigma activities in six Asian societies. Int. J. Environ. Res. Public Health 2020, 17, 280. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Gulliver, A.; Griffiths, K.M.; Christensen, H. Perceived barriers and facilitators to mental health help-seeking in young people: A systematic review. BMC Psychiatry 2010, 10, 113. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Bjørnsen, H.N.; Ringdal, R.; Espnes, G.A.; Eilertsen, M.-E.B.; Moksnes, U.K. Exploring MEST: A new universal teaching strategy for school health services to promote positive mental health literacy and mental wellbeing among Norwegian adolescents. BMC Health Serv. Res. 2018, 18, 1001. [Google Scholar] [CrossRef] [PubMed]
  50. Bulanda, J.J.; Bruhn, C.; Byro-Johnson, T.; Zentmyer, M. Addressing mental health stigma among young adolescents: Evaluation of a youth-led approach. Health Soc. Work 2014, 39, 73–80. [Google Scholar] [CrossRef]
  51. Kosyluk, K.; Marshall, J.; Macias, D.R.; Andrus, D.; Guerra, D.; Robinson, M.; Ostos, A.; Chapman, S. Examining the impact of This Is My Brave on mental illness stigma and willingness to seek help: A pilot study. Community Ment. Health J. 2018, 54, 276–281. [Google Scholar] [CrossRef]
  52. Riebschleger, J.; Costello, S.; Cavanaugh, D.L.; Grové, C. Mental health literacy of youth that have a family member with a mental illness: Outcomes from a new program and scale. Front. Psychiatry 2019, 10, 2. [Google Scholar] [CrossRef] [Green Version]
  53. Economou, M.; Louki, E.; Peppou, L.E.; Gramandani, C.; Yotis, L.; Stefanis, C.N. Fighting psychiatric stigma in the classroom: The impact of an educational intervention on secondary school students’ attitudes to schizophrenia. Int. J. Soc. Psychiatry 2012, 58, 544–551. [Google Scholar] [CrossRef]
Table
Table 2. Characteristics of the sample (n = 48).
Table 2. Characteristics of the sample (n = 48).
Variablen (%)
Gender
 Male11 (22.92)
 Female37 (77.08)
Living situation
 With family30 (62.50)
 With relatives1 (2.08)
 With roommates5 (10.42)
 With friends8 (16.67)
 Alone4 (8.33)
VariableM (SD)Range
Age20.47 (0.62)18–22
Level of Contact Report3.52 (1.76)0–7
Positive Mental Health Scale18.04 (3.47)5–25
Mental health literacy (at baseline)103.25 (8.38)26–130
 Maintenance of positive mental health subscale41.75 (4.66)10–50
 Recognition of mental illness subscale17.02 (1.76)4–20
 Reduction of mental illness stigma subscale21.27 (3.10)6–30
 Help-seeking efficacy subscale12.15 (1.86)3–15
 Help-seeking attitude subscale11.06 (2.50)3–15
Table
Table 3. Differences of mental health literacy, subscale and items scores between pre- and post-test surveys (n = 48).
Table 3. Differences of mental health literacy, subscale and items scores between pre- and post-test surveys (n = 48).
Items and ScalesPre-TestPost-TesttpEffect Size
MSDMSDd95% C.I.
Mental health literacy103.258.38108.089.34.08<0.0010.55−1.933.03
1. Maintenance of positive mental health subscale41.754.6643.384.621.90.060.36−0.941.65
 1-1 Handling stressful situations in an appropriate manner.4.490.614.650.61.470.150.270.10.44
 1-2 Making decisions based on your own will.3.90.954.310.623.52<0.010.520.290.74
 1-3 Setting limits for what is acceptable for you.4.310.954.440.580.80.430.17−0.050.39
 1-4 Having religious or spiritual beliefs.3.50.923.671.081.160.250.17−0.110.45
 1-5 Feeling valuable irrespective of your own accomplishments.4.380.734.420.790.270.790.05−0.160.27
 1-6 Able to adapt to change.4.550.614.60.570.460.650.09−0.080.25
 1-7 Able to achieve goals despite obstacles.4.150.774.350.641.570.120.290.090.48
 1-8 Able to stay focused under pressure.3.881.14.230.811.920.060.370.10.64
 1-9 Not easily discouraged by failure.4.150.994.190.940.240.810.04−0.230.31
 1-10 Able to handle unpleasant feelings.4.460.824.520.710.420.680.08−0.140.29
2. Recognition of mental illness subscale17.021.7617.831.663.1<0.010.48−0.000.96
 2-1 If someone experiences excessive worry about events.4.020.674.460.53.68<0.010.750.590.92
 2-2 If someone experiences a low mood for two or more weeks.4.420.54.560.51.730.090.280.140.42
 2-3 If someone requires higher doses of a drug.4.440.684.420.61−0.200.84−0.03−0.210.15
 2-4 If someone experiences delusions and hallucinations.4.150.654.40.572.590.010.410.240.58
3. Reduction of mental illness stigma subscale21.273.122.123.51.760.090.26−0.671.19
 3-1 I think having a mental illness is shameful.4.290.624.210.71−0.850.4−0.12−0.310.07
 3-2 Most people with mental illness are dangerous.3.920.824.080.711.310.20.2100.43
 3-3 Most people with mental illness are at risk of self-harm.2.920.9931.050.410.680.08−0.210.36
 3-4 Most people with mental illness may pose a risk to the public.3.750.864.130.672.77<0.010.50.280.71
 3-5 I think people with mental illness are unpredictable.2.710.992.961.091.550.130.24−0.050.53
 3-6 I think people with mental illness are frightening.3.690.883.750.840.520.610.07−0.170.31
4. Help-seeking efficacy subscale12.151.8612.731.432.360.020.35−0.110.82
 4-1 I know where to go to receive mental health promotion services.3.770.934.150.583.19<0.010.50.280.71
 4-2 I know where to go to receive psychiatry services.3.980.814.210.52.120.040.350.160.53
 4-3 I know where to obtain information about mental illness.4.40.544.380.53−0.240.81−0.04−0.190.11
5. Help-seeking attitude subscale11.062.512.022.532.390.020.39−0.321.09
 5-1 To address a mental health problem, my first choice would be…4.190.74.440.712.210.030.360.160.56
 5-2 If I face emotional problems, I would seek help.3.541.1341.032.440.020.430.130.73
 5-3 If I were having a mental breakdown, my first inclination would be…3.331.123.581.131.340.190.22−0.090.54
Table
Table 4. Differences of mental health literacy, subscale and items scores between pre-test and follow-up surveys (n = 48).
Table 4. Differences of mental health literacy, subscale and items scores between pre-test and follow-up surveys (n = 48).
Items and ScalesPre-TestFollow-UptpEffect Size
MSDMSDd95% C.I.
Mental health literacy103.258.38108.69.833.56<0.010.59−1.963.15
1. Maintenance of positive mental health subscale41.754.6644.064.792.50.020.49−0.831.82
 1-1 Handling stressful situations in an appropriate manner.4.490.614.690.592.350.020.340.170.5
 1-2 Making decisions based on your own will.3.90.954.330.753.57<0.010.510.270.75
 1-3 Setting limits for what is acceptable for you.4.310.954.580.711.790.080.330.090.56
 1-4 Having religious or spiritual beliefs.3.50.923.850.972.510.020.370.110.64
 1-5 Feeling valuable irrespective of your own accomplishments.4.380.734.540.651.180.240.230.040.43
 1-6 Able to adapt to change.4.550.614.670.481.010.320.220.070.37
 1-7 Able to achieve goals despite obstacles.4.150.774.350.731.530.130.270.060.48
 1-8 Able to stay focused under pressure.3.881.14.210.821.650.110.340.070.62
 1-9 Not easily discouraged by failure.4.150.994.290.710.910.370.16−0.080.41
 1-10 Able to handle unpleasant feelings.4.460.824.540.650.570.570.11−0.10.32
2. Recognition of mental illness subscale17.021.7617.132.050.330.750.06−0.480.59
 2-1 If someone experiences excessive worry about events.4.020.674.250.571.80.080.370.20.55
 2-2 If someone experiences a low mood for two or more weeks.4.420.54.420.58010−0.150.15
 2-3 If someone requires higher doses of a drug.4.440.684.290.62−1.310.2−0.23−0.42−0.05
 2-4 If someone experiences delusions and hallucinations.4.150.654.170.660.190.850.03−0.150.21
3. Reduction of mental illness stigma subscale21.273.122.883.473.85<0.0010.49−0.431.42
 3-1 I think having a mental illness is shameful.4.290.624.350.670.60.550.09−0.090.27
 3-2 Most people with mental illness are dangerous.3.920.824.170.722.210.030.330.110.54
 3-3 Most people with mental illness are at risk for self-harm.2.920.993.131.141.260.220.2−0.10.5
 3-4 Most people with mental illness may pose a risk to the public.3.750.864.10.752.690.010.440.210.66
 3-5 I think people with mental illness are unpredictable.2.710.993.41.054.8<0.0010.680.40.97
 3-6 I think people with mental illness are frightening.3.690.883.730.890.380.710.05−0.20.29
4. Help-seeking efficacy subscale12.151.8612.542.710.930.360.17−0.480.82
 4-1 I know where to go to receive mental health promotion services.3.770.934.150.952.030.050.410.150.67
 4-2 I know where to go to receive psychiatry services.3.980.814.170.931.180.250.22−0.020.46
 4-3 I know where to seek information about mental illness.4.40.544.230.91−1.240.22−0.23−0.44−0.02
5. Help-seeking attitude subscale11.062.5122.6520.050.37−0.351.09
 5-1 To address a mental health problem, my first choice would be…4.190.74.210.970.130.890.02−0.210.26
 5-2 If I were facing emotional problems, I would seek help.3.541.134.040.972.560.010.480.190.77
 5-3 If I were having a mental breakdown, my first inclination would be…3.331.123.751.022.250.030.40.10.7
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lai, H.-J.; Lien, Y.-J.; Chen, K.-R.; Lin, Y.-K. The Effectiveness of Mental Health Literacy Curriculum among Undergraduate Public Health Students. Int. J. Environ. Res. Public Health 2022, 19, 5269. https://doi.org/10.3390/ijerph19095269

AMA Style

Lai H-J, Lien Y-J, Chen K-R, Lin Y-K. The Effectiveness of Mental Health Literacy Curriculum among Undergraduate Public Health Students. International Journal of Environmental Research and Public Health. 2022; 19(9):5269. https://doi.org/10.3390/ijerph19095269

Chicago/Turabian Style

Lai, Hsuan-Jung, Yin-Ju Lien, Kai-Ren Chen, and Yu-Kai Lin. 2022. "The Effectiveness of Mental Health Literacy Curriculum among Undergraduate Public Health Students" International Journal of Environmental Research and Public Health 19, no. 9: 5269. https://doi.org/10.3390/ijerph19095269

APA Style

Lai, H. -J., Lien, Y. -J., Chen, K. -R., & Lin, Y. -K. (2022). The Effectiveness of Mental Health Literacy Curriculum among Undergraduate Public Health Students. International Journal of Environmental Research and Public Health, 19(9), 5269. https://doi.org/10.3390/ijerph19095269

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop