1. Background
Global climate change, with increased frequency, intensity, and duration of extreme heat events, has and will continue to lead to more morbidity and mortality of heat-related diseases and injuries [
1]. It was reported that the number of attributable deaths due to climate change was above 150,000 in the year 2000, of which 88% were children younger than 5 years old in both developed and developing countries [
2]. Children are a particularly vulnerable population to climate change due to immature physiological and cognitive functions, poor acquired functional immune response, higher exposure per unit body weight, and spending more time outdoors [
3,
4]. The impacts of climate change on children’s health include direct and indirect adverse effects of extreme weather events, increased heat stress, reduced air quality, altered disease patterns of climate-related infections, and water, food, and nutrition insecurity in vulnerable areas [
5,
6].
Extreme heat has become one of the main causes of deaths in many regions [
7]. Many epidemiological studies have reported the adverse health impacts of hot temperature and heatwaves [
8]. Moore et al. [
9] reported that children in the United States had a higher risk of heat-related death than the general population, whereas another study [
5] found that infant heat-related mortality rate in the US may increase by 5.5% for girls and 7.8% for boys by the end of the 21st century under a business-as usual scenario. Several studies have found an increase in pediatric hospital admissions and emergency department (ED) visits during extreme heat events [
10,
11,
12], and that about one-third of the annual exertional heat illness cases in EDs in the US from 2001 to 2009 were teenage male athletes [
11]. Our previous multi-city study on heat and ED visits in China found that young people under 18 years had the highest risk from a 1 °C increase in the daily maximum temperature in summer [
12].
Heat-related illnesses are preventable to some extent. Prompt and effective implementation of adaptation actions will protect human health from the effects of heat waves. Intervention strategies that focus on addressing threats of heat waves have been implemented in many countries, especially in North America, Europe, Australia, and parts of Asia [
13,
14]. The prominent strategies are heat health warning systems with risk communication and health education implemented in communities, targeting vulnerable populations and their carers [
13,
15,
16]. However, there has been limited evidence about their evaluations [
15,
17], especially among children. A London study [
15], for example, targeted the elderly, whereas an evaluation of the Heat Wave Intervention Program in China also focused on people over 15 years old, and the improvement in their knowledge, attitude, and practice [
16]. Although intervention plans aimed at community residents’ prevention may also typically benefit children, no specific study has targeted children to assess the effectiveness of heat wave implementation programs.
To provide scientific evidence for local health and education authorities for adaptation to extreme heat among school children, we implemented a primary school-based intervention program to improve knowledge, attitude, and practice (KAP) related to extreme heat among school children, and evaluated the effectiveness of the intervention in Dongtai City, Jiangsu Province, China. We hope the findings can have policy implications for other countries and regions with similar climatic situations.
2. Methods
2.1. Study Area
We performed a primary school-based intervention study in Dongtai City, which is located in the central coastal area of Jiangsu Province in China, at 120°07′~120°53′ east longitude and 32°33′~32°57′ north latitude, with a total area of 3175.67 square kilometers and a permanent resident population of proximately 980,000. It belongs to the subtropical monsoon maritime climate, and has four distinct seasons with cold winters and hot summers. The annual average temperature is 15.0 °C in Dongtai.
2.2. Study Design
Two primary schools located in two communities with similar economic and education levels were selected in Dongtai on the basis of their willingness to participate. One school was randomly chosen as the intervention school and the other one as the control school. Considering their understanding ability, all the students from the third to the fifth grades at each school were chosen as the study population. In addition, the parents of these students were also invited to participate in this study.
A series of health education activities were carried out at the intervention school to raise the primary school students’ awareness of and ability to respond to climate change and heatwaves from May to September in 2017 (
Table S1). The main health education activities included running related health education courses, launching lectures and class meetings on climate change adaptation and children’s health protection, and holding competitions involving blackboard newspapers, drawing, and writing. The school clinic was required to prepare enough medicine to prevent and treat heatstroke in summer. Enough warm boiling water was provided to ensure that students could drink clean warm water at all times. Students were supervised to help develop the habit of washing hands before eating and after using the toilet. During the school summer holiday, the students were required to participate in the practice activities against climate change or heatwave at least three times, such as observing and writing down how their families or friends respond to the heatwaves. The students at the intervention school were also required to spread the knowledge on climate change and health impacts to their families. Furthermore, early warning information on heatwaves and health risks was also sent to the parents through mobile phone text messages to protect the health of students during the summer holiday. The percentages of students participating in various health education activities at the intervention school are shown in
Figure S1. There were no intervention activities at the control school.
2.3. Questionnaire Survey and Data Collection
A structured questionnaire was used to assess the knowledge, attitude, and practice of both students and their parents in the adaptation to extreme heat and climate change. The pre- and post-intervention questionnaire surveys were carried out in May and October 2017, respectively. Each questionnaire survey was performed simultaneously at the intervention and control schools, for both primary school students and their parents. Each participant signed a written informed consent before each survey.
The answers to each question in the questionnaire were scored quantitatively (see
Table S2). The full score of knowledge (K), attitude (A), and practice (P) was 8, 3, and 4, respectively. The total KAP score was the sum of the scores of these three components, with the full score of 15.
Ethical approval for this study was granted by the National Institute of Environmental Health, Chinese Center for Disease Control and Prevention (Approval number: 201610). This project has been registered in Chinese Clinical Trial Registry (Registration number: ChiCTR2200056005).
2.4. Data Analysis
Difference-in-difference (DID) analysis is a popular method to evaluate the effectiveness of interventions [
18,
19,
20]. In this study, DID analysis was conducted to examine the differences in KAP scores of the students and the parents after intervention between the intervention school and the control school. We established the dummy variable (time) for before and after intervention and the dummy variable (group) that distinguished the intervention school and control school. The time was considered 1 (time = 1) after intervention and 0 (time = 0) before intervention. The intervention school was assigned as 1 (group = 1), and the control school as 0 (group = 0). The DID variable was set by multiplying group and time. In addition, the individual factors such as age, sex, marital status, and education levels among parents were taken as covariates in the DID analysis to control for the possible confounding effects. A DID study is usually analyzed with a regression model, such as [
21,
22]:
where
Y represents the dependent variable, that is, the KAP score.
and
are the coefficients of group and time, respectively.
is the DID estimator, which represents the difference in the average value (
) before and after implementing intervention in the intervention school, minus the difference in the average value (
) before and after implementing intervention in the control school, that is,
.
represents the covariates including age and sex for students, and age, sex, education, and marital status for parents.
ε is the random error term.
In order to compare the score changes among knowledge, attitude, and practice, we assigned a new indicator through a DID estimator divided by the full marks of each item, which was the standardized percentage of the increased scores.
The t-test and chi-square test were used to determine the homogeneity of study subjects between the intervention and control schools for the descriptive analysis, and to compare the KAP scores between different groups. Spearman correlation analysis was conducted to assess the correlations between KAP score changes after intervention and health education activities of the students at the intervention school, in order to identify the more effective intervention measures.
All the statistical analysis were performed using SAS9.4 (SAS Institute Inc., Cary, NC, USA).
3. Results
3.1. General Information of Subjects
The essential information of the primary school students was collected before and after intervention, as shown in
Table 1. At the intervention school, 427 and 405 primary school students of third to fifth grades completed the questionnaire survey before and after the intervention, respectively; at the same time, 499 and 539 primary school students of third to fifth grades at the control school also completed the questionnaire survey during baseline and endline periods, respectively. The average age of the participated students at the intervention and control schools was 10.5 years and 10.4 years, respectively. The male students accounted for 52.9% and 53.1%, respectively, before and after intervention at the intervention school, whereas the percentage of male students at the control school was 59.0% and 58.4%, respectively. There was no significant difference in the age between the two schools at either the baseline or the endline. The percentage of the boys at the control school (59.0%) was significantly higher than that at the intervention school (52.9%) at the baseline, whereas no significant difference was found at the endline.
A total of 1264 parents were investigated at the two schools before and after intervention (
Table 1). The age, sex ratio, and education level of the parents were significantly different between two schools at the baseline level.
3.2. Difference-in-Difference (DID) Analysis on KAP Score Changes of Primary School Students after Intervention
Table 2 shows the results of the DID analysis on KAP score changes (DID estimators) of students after intervention. Overall, the score changes for attitude and practice were smaller than that for knowledge. The scores for all the KAP items, except for the knowledge of climate change, were significantly increased; in particular, the score for knowledge increased 19.9% (95%CI: 16.3%, 23.6%) after intervention. The scores for attitude and practice increased 9.60% (95%CI: 5.35%, 13.9%) and 9.94% (95%CI: 8.26%, 18.3%), respectively. The total score for KAP increased 15.0% (95%CI: 12.1%, 17.8%) after intervention.
In terms of knowledge, the scores for cognition of heat waves, high temperature warning, and hot weather definition increased the most, by 44.7% (95%CI: 35.8%, 53.6%), 34.2% (95%CI: 24.7%, 43.7%), and 33.4% (95%CI: 27.4%, 39.4%), respectively. The scores for the awareness of climate change adaptation measures and heatstroke treatment measures increased 14.9% (95%CI: 8.94%, 20.9%) and 13.8% (95%CI: 8.78%, 18.9%). The relatively low change level for awareness of climate change and its health effects suggested that relevant education contents in the health education curriculum should be improved in future intervention campaigns.
For attitude and practice, the scores for willing to learn relevant knowledge and paying attention to weather forecasts increased relatively more, by 11.9% (95%CI: 6.79%, 16.9%) and 14.8% (95%CI: 8.48%, 21.1%), respectively.
Figure 1 shows the sex-specific KAP score changes (DID estimator) at the endline for the primary school students at the intervention school compared with the control school. It was found that all the KAP score changes of the male students were higher than those of the female students, even though there was no statistically significant change.
The age-specific KAP score changes (DID estimator) after intervention for the primary school students at the intervention school compared with the control school are shown in
Figure 2. The results implied that older students had higher score changes, especially in knowledge and attitude. However, for appropriate practice, score changes increased with age until 11 years old.
3.3. Relationship between Health Education Activities and KAP Improvement of Primary School Students
In order to further evaluate the relationship between various health education activities and KAP improvement among primary school students, and to explore better intervention methods, Spearman correlation analysis was conducted between the changes in KAP scores and the participation in various health education activities at the intervention school. The results are shown in
Table 3. All the health education activities at the intervention school in the program were significantly correlated with the changes in KAP scores of primary school students after the intervention. In particular, listening to lectures/watching cartoons, broadcasts between classes, hand-copying newspapers, and speech contests were more relevant. In contrast, attending none of the activities was negatively related to the score changes of all the KAP indicators.
Among the students that completed the questionnaire survey at the intervention school during the endline, 58.0% answered that they could obtain medicine to prevent heatstroke at the school clinic when they felt unwell during hot days. A share of 87.0% of the students believed that participating in these activities was helpful to increase their knowledge of climate change and health impacts, and 87.6% of the students indicated that they would be willing to participate in such activities again, indicating the impacts and effectiveness of the intervention activities.
The analysis of the differences in the age and sex ratio among students participating in different numbers of activities (
Table S3) demonstrated that older students participated in more activities than younger students (
p < 0.0001). However, the sex difference was not statistically significant (
p = 0.0783).
3.4. Intervention Effects on Parents
The KAP scores for parents of primary school students at the intervention and the control schools before and after intervention, and the results of the DID analysis of score changes, are shown in
Table 4. The results of DID analysis show that all the score changes for knowledge, attitude, and practice were significantly increased after intervention; in particular, the score for knowledge increased by 22.5% (95%CI: 17.8%, 27.1%). Furthermore, the score changes for all of the knowledge items were positively significant; in particular, the scores for cognition of hot weather, high temperature warning, and heat wave increased the most, which was similar to the results of the students. The score for attitude and practice increased by 7.22% (95%CI: 0.96%, 13.5%) and 5.22% (95%CI: 0.73%, 9.71%), respectively. The total score for KAP increased by 14.8% (95%CI: 10.8%, 18.3%) after intervention.
Table 5 shows the estimates of effects of sex, age, marriage, and education on the KAP change of parents after intervention. It shows that the parents’ education level was positively related to the score change for knowledge, attitude, and practice, and that the score changes of females were higher than those of males.
4. Discussion
We assessed the effectiveness of implementing health education intervention program on climate change and health adaptation through a primary school-based intervention study in China using difference-in-difference (DID) analysis. The results indicated that not only the primary school students but also their parents had significantly improved the cognition of extreme heat and health adaptation.
To the best of our knowledge, this is the first primary school-based intervention program on improving KAP to adapt to extreme heat in China. Xu et al. performed a community-based intervention during heat waves to improve knowledge, attitude, and practice in Jinan, China [
16]. Another community-based intervention program [
20] was conducted to reduce the number of heat-related illnesses in Licheng, China. Both of these studies were focused on adults. Our findings provide robust evidence for intervention programs for children’s adaptation to heat waves and climate change.
We set up a standardized percentage of increased scores to facilitate comparison of the score changes among items. The itemized results of attitudes and practices of primary school students showed that changes in attitudes and behaviors were smaller than the improvement in knowledge. Smaller changes in attitude and practice scores may be because changes in attitude and behavior require more intensive and long-term education than the change in knowledge. Another possible reason may be associated with higher baseline scores due to the items being common questions or behaviors that most participants already performed [
16], such as using air conditioning on hot days and washing hands before meals, which would make it difficult to distinguish differences after intervention. It was suggested that more questions should be designed in future studies to better evaluate the effect of the intervention on attitude and practice. Furthermore, the items with relatively lower changes suggested that the contents should be strengthened in future intervention, such as the contents regarding awareness of climate change and its health effects, in addition to long-term and reinforced health education, especially in enhancing transfer of knowledge change to attitude and behavior change. However, according to the standardized percentage of increased scores, the improvement in the use of air conditioning contributed to the second highest behavior score for both children and parents. It was shown that using air conditioning was an effective and feasible means of heatwave intervention.
We found greater changes, in particular, in knowledge and attitudes among older primary school students. For appropriate practice, however, score changes increased with age until 11 years old. This might may be because older students have higher capacity of knowledge acceptance, but find it difficult to easily change their behaviors once their own habits have been developed when reaching some certain age. It was further suggested that more efforts should be made to transfer knowledge to behavior change, and improving pupils’ behaviors or helping them develop good habits in future interventions. Schools have the best opportunity to develop curricula that prepare students for the anticipated changes to adapt to heat waves and climate change [
23]. Our findings verified that good behavior should be developed at an early age, and health education to adapt to climate change should start with children. The findings also provided strong evidence for the inclusion of climate change and health in the curricula of primary schools.
It is notable in this study that we also evaluated the influence of implementing intervention in primary school students on the KAP of their parents. The results showed that the KAP, especially for knowledge items, of parents on heat waves and health were also significantly increased after implementing intervention for their children at the intervention school. It was found that the improvement in children’s cognition can promote parents’ awareness and cognition, and parents as the closest caregiver can, in turn, influence and improve children’s cognition, and urge children to develop good behavior, thus forming a virtuous circle. Strengthening health school programs is urgently needed to strengthen a country’s capability to successfully cope with the effects of climate change, according to a study on global health [
24]. The successful practice of our study demonstrated that “small hands holding big hands” is an effective way to improve the awareness and behavior of children and their families to adapt to heat waves, and it has profound significance to enhance the national capacity to adapt to climate change. Moreover, it can also provide a successful experience for other public health education schemes, such as in the control and prevention of COVID-19.
All the health education activities in the program were significantly correlated with the changes in the KAP scores of primary school students after intervention. It was found that the health education activities had great impacts on the improvement and change in the relevant knowledge, attitude, and practice of primary school students. This was particularly the case of the health education curricula that included interesting activities, such as listening to lectures/watching cartoons, and experiential learning that can explore the activeness of students, such as broadcasts between classes, hand-copying newspapers, and speech contests. Curriculum and experiential learning approaches have also been proved to be effective strategies in nutrition health education of elementary school students [
25]. Our results can provide a reference for the choice of intervention measures in the future when carrying out climate change adaptation-related intervention activities for primary school students.
We found the scores for most of the items of attitude and practice of students in the control school tended to decline after intervention compared with those before intervention. This may be related to the timing of the two surveys. The baseline survey was conducted in May when the weather was becoming warmer, whereas the endline survey was conducted in October when it was cooler. Different feelings about the weather may influence the attitude and practice for heat waves, which could induce information bias or memory bias. Even if these kinds of bias can be eliminated using the DID analysis, our results implied that the impacts of the time when questionnaire surveys on climate change-related perception estimation were performed should be considered, particularly for children who usually typically only remember short-term feelings.
Several limitations should be noted. First, the general information of participants in the intervention and controls school were not totally balanced and we only adjusted several observed factors, including age, sex, education, and marital status, in the DID analysis. Other possible factors should be further considered in future studies. Second, the pre- and post-intervention surveys were conducted during different seasons, which may induce information bias or memory bias. Third, in the study design, we did not group intervention measures according to the health education activities, so it is difficult to analyze the effects of different activities.
5. Conclusions
The effectiveness of a primary school-based intervention study in China was assessed using difference-in-difference (DID) analysis, with controls for age, sex, etc. The results demonstrated that not only the primary school students but also their parents’ cognition of extreme heat and health adaptation were significantly improved after health education and health promotion were implemented in the intervention school. The KAP improvement of boys and older students was higher than that of girls and younger students. For parents, the higher the education level, the higher the KAP improvement, and the increase was higher for females than for males. Health education in primary school, and particularly education that can influence students’ subjective activeness, was found to be an effective means to improve the cognition and behavior to adapt to heat waves and climate change for both primary school students and their parents. The results indicated that intervention to adapt to climate change should start from an early age in children, and particularly the measures for transferring knowledge to behavior change, and improving pupils’ behaviors or helping them develop good habits. Our findings provide strong evidence for the feasibility and importance of the inclusion of climate change and health in the primary school curricula. Moreover, our findings demonstrated that “small hands holding big hands” is an effective way to improve the awareness and behavior of children and their families to adapt to heat waves, and it has profound significance for enhancing the national capacity to adapt to climate change. The successful experience of our study can be generalized to respond to the increasing extreme weather/climate events in the context of climate change, such as heatwaves, and other emergent occasions or public health education, such as the control and prevention of COVID-19.