Next Article in Journal
Refined Network Topology for Improved Reliability and Enhanced Dijkstra Algorithm for Optimal Path Selection during Link Failures in Cluster Microgrids
Next Article in Special Issue
Approaches to Bio-Cultural Diversity in British Columbia
Previous Article in Journal
Pollution Characteristics and Risk Assessments of Mercury in Jiutai, a County Region Thriving on Coal Mining in Northeastern China
Previous Article in Special Issue
Closing the Gap: Potentials of ESE Distance Teaching
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

What Triggers Climate Action: The Impact of a Climate Change Education Program on Students’ Climate Literacy and Their Willingness to Act

1
Department of Environmental Studies, Faculty of Environment, Jan Evangelista Purkyně University in Ústí nad Labem, 40096 Ústí nad Labem, Czech Republic
2
Department of Preschool & Primary Education, Faculty of Education, Jan Evangelista Purkyně University in Ústí nad Labem, 40096 Ústí nad Labem, Czech Republic
3
Department of Environmental Studies, Masaryk University, Joštova 10, 60200 Brno, Czech Republic
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(16), 10365; https://doi.org/10.3390/su141610365
Submission received: 15 July 2022 / Revised: 12 August 2022 / Accepted: 18 August 2022 / Published: 20 August 2022

Abstract

:
There has been an intensive debate in the field of climate change education about what predictors influence youth’s climate-related behavior and what educational strategies and practices stimulate such behavior. This study investigated the impact of the ‘CO2 League’ program which involved 47 schools (N = 123). For the analyses, we used pre-/-post quasi-experimental design which combined quantitative and qualitative methods: an extensive pre-/-post survey for analyzing several components of students’ climate literacy (system/action/effectiveness knowledge, climate change concern, self-efficacy, willingness for climate-protective behavior) and focus group interviews. The analyses revealed a significant impact of sufficient climate change knowledge on climate change concern which subsequently positively influenced participants’ self-efficacy and their willingness to act. The findings of this study suggest that knowledge is a key initial driver for climate action, especially for young people, and confirm the conclusion of previous studies that willingness to adopt pro-climatic behavior presupposes a clear and explicit understanding of climate dynamics and its causal relations. The focus group interviews also revealed that the reported increased willingness to act often translated into actual climate action and that learning about the concept of carbon footprint and the process of calculating and decreasing it proved to be a very accessible and fast path to participants’ engagement in personal climate action.

1. Introduction

Climate change (CC) is the principal issue of our times with environmental, social, economic, and also educational consequences [1,2], and many researchers [3,4,5,6,7,8,9] have emphasized the importance of education as one of the key mitigation strategies. To become a mitigation driver, CCE should incorporate a variety of disciplinary perspectives, translate and frame climate science to be understandable and believable, develop climate literacy, and empower educators and learners, as addressing the climate crisis will require climate literate citizens and students in all segments of the global society [10,11,12,13,14,15,16]. While trying to fulfill the complex role described above, CCE research and implementation face several key challenges, concerning the content of CCE, how to best communicate it, and what educational strategies to use. These areas will be crucial for this study, especially the concept of climate literacy, the role of climate change knowledge and attitudes in motivating pro-climatic behavior, and the effectiveness of CCE educational strategies. Our study should bring a contribution to the ongoing CCE discussions by analyzing the impact of a CCE program called the ‘CO2 League’ on climate literacy of its participants. The following sections will summarize the major issues of climate literacy conceptualization and its development.

1.1. Climate Literacy

In recent years, several climate literacy concepts have been proposed [4,17,18] and climate literacy is usually viewed as an intersection of climate science and environmental education approaches and strategies [17,19], as CCE is based on CC scientific concepts and its goal is commonly defined as promoting, stimulating, and cultivating pro-environmental values, attitudes, and behavior [14,19]. In connection with environmental education concepts, climate literacy has been conceptualized in three dimensions–knowledge, competencies (skills), and attitudes or values [4,6,20,21]. However, climate literacy is a relatively new term and its meaning, scope, and content have not been defined and agreed upon worldwide [17]. Most studies dealing with climate literacy have focused primarily on CC knowledge and there is a lack of authoritative definitions of what climate literacy means in all three dimensions.
In the context of the Czech Republic, Miléř and Sládek [17] proposed the system for incorporation of climate literacy (mostly CC knowledge dimension) into Czech school curricula and the Ministry of Environment’s panel of experts has recently prepared and published a CCE guide “Klima se mění–a co my?” (The Climate is Changing—What about Us?) [22], which includes brief general definitions of climate literacy for elementary, secondary, and higher education structured in three categories: knowledge, skills, and values/attitudes/behavior.

1.2. CC Knowledge

Within CCE, climate change knowledge has been recently viewed as a complex, multidimensional, and dynamic system, rather than a bulk of climate science facts and concepts [11,23]. This trend is again in accordance with recent environmental education concepts of environmental knowledge [24,25]. Jensen [25], for example, argued that ‘environmental knowledge’ should refer not only to knowledge about ‘effects’, but should also include knowledge about ‘root causes’, ‘strategies for change’, and ‘alternatives and visions’. Similarly, elaborating on Frick et al.’s knowledge structure model [24], Bofferding and Kloser [11] determine and define three domains of declarative CC knowledge—‘system knowledge’ (mechanistic understanding of climatic system and drivers and impacts of CC), ‘action knowledge’ (understanding of mitigation actions and behaviors), and ‘effectiveness knowledge’ (understanding and weighing the potential of particular mitigation activities). According to DeWaters et al. [6] climate science literacy includes ‘a broad understanding of climate science, as well as affective (attitudes, values, and self-efficacy) and behavioral attributes related to climate change’ [6] (p. 469). Hung [20] adapted Krathwohl’s taxonomy of factual, conceptual, procedural, and meta-cognitive knowledge [26] and proposed that they should be realized in three knowledge domains, ‘climate change causes’, ‘climate change impact’, and ‘climate change management’. Using a slightly different perspective, Azevedo and Marques [4] in their review study utilized three levels of climate literacy knowledge, ‘content knowledge’ (the facts, concepts, and explanatory theories), ‘procedural knowledge’ (knowledge of how such ideas are produced), and ‘epistemic knowledge’ (understanding of the rationale for these procedures and the justification for their use).

1.3. CC Attitudes, Pro-Climatic Behavior, and Knowledge–Action Gap

Many authors stress the importance of climate change attitudes which can strongly influence the willingness to engage in climate action [27,28,29,30]. Climate change concern is often cited as one of the driving forces [29,31,32,33,34] and there have been large-scale studies that classified students or adults into CC concern categories ranging from alarmed to disengaged or dismissive and explored how the level of CC concern influenced pro-climatic behavior [16,35,36,37]. Perceived self-efficacy connected to CC mitigation and adaptation is also known as a key determinant, especially for younger people, as the sense of being able to personally contribute to combating the climate crisis helps them overcome feelings of powerlessness, paralysis, and information overload, and find their own way to personal or community climate action engagement [27,29,38,39]. Finally, constructive hope is considered crucial, most importantly positive hope, based on constructive forms of coping with the threat of climate crisis, as it can provide respite from the harsh reality and give people the strength needed to face the threat, overcome grave emotions, and search for solutions [40,41,42,43,44].
Another key debate in the field of CCE is about what paths lead from CC knowledge to CC concern and climate action, what predictors influence youth’s climate-related behavior, and the issue of the knowledge–action gap. Early ‘information-deficit’ models assumed that if people were well-informed about the causes and consequences of environmental problems, they would adopt pro-environmental behavior [45,46]. However, many subsequent analyses and studies have found the relationship between environmental knowledge and behavior to be less direct and often weak [47], and they have argued that there is a ‘knowledge–action gap’ [48] and that pro-environmental behavior is shaped through complex interactions between many different factors, such as attitudes, beliefs, social and personal norms, situational and demographic factors, and the influence of social groups and authorities, with knowledge playing only a background role [49,50]. However, in the case of CC, the relationship between variables influencing pro-climatic behavior and the role of knowledge seem to be even more complex and multi-faceted. Some analyses confirm that there is a weak or no correlation between CC awareness/knowledge and the willingness to act in favor of climate protection [51], but other studies have found the link between climate knowledge and behavior to be significant [3,52,53]. Leiserowitz and Smith [36], Stoutenborough and Vedlitz [54], and Guy et al. [55] have found a correlation between higher levels of climate knowledge and concern about CC. Moreover, when climate change knowledge is analyzed in its complexity and different dimensions (as described above), its relationship to pro-climate behavior is shown to be substantial and multi-layered. The impact of mere CC awareness or belief that anthropogenic CC is happening is different from the impact of CC conceptual understanding and understanding of personal actions influence [56]. Action knowledge and effectiveness knowledge have been found to mediate the effect of system knowledge on behavior and are thus considered more directly related to behavior [24]. Action knowledge has been considered to have a greater impact on pro-climate behavior than system knowledge since action knowledge can stimulate behaviors that can be enacted without a full mechanistic understanding of CC and the climatic system. Lack of action knowledge (activities leading to mitigating CC) has been cited by participants of surveys as a major barrier to engaging in mitigating behavior [57,58,59]. However, Bofferding and Kloser [11] argue that although system knowledge has been shown to have a smaller impact on behavior, the models of a climate literate person still suggest that individuals need to understand foundational concepts of climate science. Analyzing environmental knowledge and behavior, Frick et al. [24] confirmed that system knowledge provides a necessary foundation for action-related and effectiveness knowledge. The interconnection of knowledge dimensions and their impact on pro-climatic behavior seem to get more tangled when we focus on the specific group of teenagers [53].

1.4. Youth’s Climate Knowledge and Attitudes to CC

There have been attempts to investigate and analyze youth’s climate knowledge and attitudes to CC on a larger scale. In Germany, Kuthe et al. [16] investigated 760 teenagers and identified four groups according to their level of CC awareness (Charitables, Paralyzed, Concerned Activists, Disengaged) which differ in cognitive, affective, and conative aspects of CC. This indicates that young people are not a homogenous group regarding their attitudes to CC. In the US, Leiserowitz, Smith, and Marlon [37] and Roser–Renouf, Maibach, and Myers [60] in their surveys revealed substantial climate change knowledge gaps and misconceptions, and the latter study (1257 teenagers) also analyzed sources of CC information and reported high levels of CC anxiety and only average levels of CC hope and self-efficacy. In their review study, Corner et al. [61] conclude that today’s youth tend to have fairly poor knowledge of CC mechanisms and concepts. However, the levels of climate change concern are generally high among the younger age groups (in some cases higher than in older age groups), and climate concern is usually accompanied by feelings of anxiety, stress, and despair. There also appears to be a lack of self-efficacy among younger people with regard to climate protection.
Similar results have been brought by large-scale studies in the Czech Republic. According to Krajhanzl et al. [62], Czech teenagers see the climate issue as sketchy and haphazard, but also hopeless and frustrating; their self-efficacy with regard to participating in climate protection is very low. Czech teenagers were also—in comparison to other age segments—less willing to adopt everyday domestic pro-climate behavior, but on the other hand more willing to communicate about climate protection. They also declared their willingness to change their lifestyle to help combat CC [62].

1.5. Theory and Practice of CCE

There have been many studies that investigated and proposed effective CCE teaching methods [5,13,14,43,63] and there seem to be several interlinked trends emerging as perspective CCE educational strategies.
Firstly, CCE should be holistic and inter- or transdisciplinary [14,64]. As Kagawa and Selby state [65], CCE should enable learners to view and understand CC from multiple perspectives and help them ‘apply cultural, social, economic, ethical, political, and spiritual intelligence to understandings of causes, implications, and proposed ways forward’ [65] (p. 241). Regarding school curricula, the CC topic should not be limited to science education and presented as a separate, stand-alone subject area, but it should be integrated across subjects such as science, citizenship education, geography, history, languages, drama, and the arts [66,67].
In addition, CCE strategies and approaches should surpass classroom environment and traditional content delivery, and they should be up-to-date and flexible, student-centered, participative, action and community-based, and enable learners to activate their full potential for climate mitigation and adaptation in a rapidly changing world. Many authors argue that CC, as a complex and multi-disciplinary topic, requires a long-term and multi-layered educational response and they call for utilizing inquiry-based, problem-based, or project-based learning approaches combined with activities stimulating student collaborations, discussions, peer-to-peer interaction, students’ autonomy, and non-hierarchical communication, as well as their critical analysis skills for assessing available data and content [5,13,14,65,68,69,70,71,72].
Furthermore, CCE should include both local and global perspectives, interconnecting global processes and context with local consequences, everyday life, and personalized situations [65,73,74,75]. As Kagawa and Selby [65] argue, climate change education requires a process that embeds learning with action within local community contexts. This can be fulfilled by linking CCE and place-based education which focuses on strengthening place attachment. As results from the study of Khadka et al. [73] show, place-based engagement, situated in a familiar and meaningful context, inspires CC involvement and mitigation. Khadka et al. suggest that ‘a hands-on, real-world learning experience, could also help students develop stronger ties to their community, appreciation for the natural world, and heightened commitment to become active citizens’ [73] (p. 11).
CCE should also aim at societal and political changes and the solutions to the climate crisis. Therefore, it should move from transmissive towards transformative learning [76] and emphasize learners’ empowerment and pro-climate action. Many authors stress the importance of CCE as a driver of societal, economic, and cultural transformations-CCE should focus on strengthening learners’ political empowerment and motivating them to participate in pro-climate action, both individual and communal/political [14,77,78,79]. As noted by Trott and Weinberg [80] (p. 4), it is essential to support learners’ ability ‘to imagine alternative futures and the kinds of decisions and actions necessary to realize them’.
Finally, CCE should be fully aware that CC and its impacts stimulate a range of strong emotions (especially in young people), which can be very disturbing and overwhelming, e.g., depression, anxiety, sadness, guilt, or denial [42,81]. Thus, one of the key tasks of CCE is overcoming these grave emotions by promoting hope, self-efficacy, and resilience [82,83,84]. Research suggests that young people feel more hopeful about climate change when they know there are things that they can do personally to address the issue [40,41,42,43,44]. Ojala’s studies describe the role of different coping strategies in CCE programs and in order to build self-efficacy and hope they recommend inviting different actors, such as scientists and politicians, into the classroom [40,42,43,44].
There have been attempts to design and apply multi-layered, action-based and transformative CCE programs-these are long-term programs (often covering the entire school year) aimed at increasing participants’ climate literacy such as the ‘Youth Climate Challenge‘ in the USA, ‘kidZ21′ in Austria [14], or ‘Climate Change Before the Court’ [85] in Germany. In the Czech Republic, one of the most relevant and successful CCE programs is the ‘CO2 League’.

2. Methods

2.1. The ’CO2 League’ Program Description

The aim of this study was to evaluate the impact of a year-long CCE program ‘CO2 League’ on several components of participants’ climate literacy in the knowledge and attitudes/values dimensions (system/action/effectiveness knowledge, CC concern, CC hope, and CC self-efficacy) and also their willingness for climate-protective behavior. The investigated constructs were chosen in accord with the program’s content, structure, expected outputs, and educational goals which state the pursuit of developing or changing particular climate literacy components. The latest CCE research trends mentioned above were also considered.
The ‘CO2 League’ program was created by the Ecological Institute Veronica (a Czech environmental organization that specializes in environmental education) in 2015 and its implementation has been funded by the Ministry of Environment of the Czech Republic. It is a well-known after-school CCE program that has involved hundreds of elementary and high schools. The ‘CO2 League’ follows the CCE trends mentioned above in many ways. It is an action-based program that aims at developing students’ CC knowledge, strengthening their empowerment and self-efficacy, and stimulating students’ climate action and participation. The program is based on the moderate constructivist approach [64,86,87]. It employs project and inquiry-based methods [88,89,90], and involves place-based and community action activities, autonomous students’ teamwork, collaboration and participation, and non-hierarchical interaction of different stakeholders (students, teachers, school management, municipalities, and state administration). Every participating school forms one or more teams of 3–6 students and one teacher tutor (both students and teachers join the teams on a voluntary basis). Each year the program covers a whole school year and includes four missions with several after-school assignments to be completed (the instructions, links, and downloadable materials are shared via the program’s website and sent by email). The content of the program’s missions is shown in the Table 1.
For the evaluation of the ‘CO2 League’ program, the appropriate extent of climate literacy was discussed by the program’s authors, climatologists, and educational experts and defined according to the program’s content, structure, expected outputs and educational goals. Within the ‘CO2 League’ context, a teenage climate literate person (program’s participant) was defined as someone who:
Understands the basic principles of anthropogenic CC and the greenhouse effect;
Knows the impacts of CC and is able to provide examples of local impacts;
Knows the major drivers of anthropogenic CC and is able to provide examples of personal everyday activities which contribute to it;
Knows how effective various ways to combat CC are;
Understands the principle of carbon footprint;
Is aware of urgency of implementing solutions to climate crises;
Believes in his or her own ability to participate in combating CC and succeed in it (self-efficacy);
Is willing to participate in activities which will most likely help to combat CC (on the personal, community and political level).
This study presents findings from in-depth analyses of the ‘CO2 League’ program and it explores the following research questions:
  • What was the impact of the ‘CO2 League’ program on participants’ climate literacy components (investigated constructs) and also their willingness to engage in climate action?
  • Are any of the investigated constructs (system/action/effectiveness knowledge, CC concern, self-efficacy) significantly related to participants’ willingness to act?
  • Do other predictors (gender, age, elementary/secondary interface) have a significant relation to participants’ willingness to act?

2.2. Data Collection

The investigation of ‘CO2 League’ utilized a quasi-experimental research design [91,92] and combined quantitative and qualitative methods within a mixed method approach [91,92,93]. Quantitative data were collected through pre-/post-test in the form of an online survey. The survey included 43 multiple-choice items (offering responses on the Likert scale) and two open-response items. It was divided into 5 sections which investigated different constructs:
  • What is global warming/CC? (5 items, system and action knowledge);
  • How much will the following activities help us mitigate CC? (10 items, effectiveness knowledge);
  • Is CC a serious problem? (8 items, CC concern);
  • What do you think about the following statements? (7 items, CC mitigation self-efficacy);
  • Are you willing to adopt the following actions to help mitigate CC? (8 items, willingness to act)
The structure of the survey was designed according to the program’s climate literacy definition and the research questions. The wording of some survey items was loosely based on several previous studies [11,13,42,52,94,95] and it was validated through several rounds of revising and consulting with the program’s authors, education experts, and climatologists. The survey’s reliability was verified by Cronbach’s alpha tests (see Table 2 below), and it was pilot tested on two pilot groups (N = 45), which led to final adjustments (for full wording of the survey’s items see Supplementary Materials). The collection of quantitative data was fully anonymous.
The qualitative data were collected after the program’s conclusion through interviews with 6 student focus groups (N = 27) and 6 teachers [91,92]. Focus group participants were randomly selected from ‘CO2 League’ participants who completed all four assigned missions. The interviews with focus groups and teachers were conducted online, and they were recorded, transcribed, and coded. Transcriptions were analyzed according to thematic analysis [96]. The interview design involved ten questions concerning students’ and teachers’ perceptions of the program, and also students’ evaluation of their climate literacy and climate action development (for full wording of the interview items see Supplementary Materials). The collection of qualitative data was fully anonymous. The participants had the opportunity to refuse to participate in the research, and in the case of student focus groups, parental consent was required.

2.3. Data Analyses

Quantitative data from the online survey were analyzed using SPSS Statistics (IBM SPSS Statistics for Windows, version 28.0. IBM Corp.: Armonk, NY, USA). Hypotheses were tested against a 5% significance level, α = 0.05. The t-test was used to compare two groups, with effect size calculated using Cohen’s d. Correlations were determined by calculating Pearson’s correlation coefficient. Open-ended items were analyzed according to thematic analysis [96].
Theoretically-based models were developed to test the relationships between the observed dimensions. Building on previous studies [11,24,52,97,98,99] and considering the data analyses results, we determined system, action, and effectiveness knowledge as the exogenous variables and CC concern, CC self-efficacy, and willingness to act as endogenous variables. We based our models on the climate change behavior model proposed by Stevenson [52], which we modified and expanded, using Bofferding and Kloser’s [11] three-dimensional CC knowledge concept. We hypothesized that all knowledge dimensions would predict CC concern and action knowledge would additionally predict self-efficacy and willingness to act. CC concern and self-efficacy were proposed as intervening variables for willingness to act.
The validity of the models was verified using structural equation modeling in SPSS Amos 27 Graphics. The indices for model fit recommended by Hu and Bentler [100] were observed. A summary of these follows, with the ideal cutoff values for a good model in parentheses [100]: χ2, the comparative fit index (CFI, >0.95), Tucker–Levis index (TLI, >0.95), goodness of fit index (GFI, >0.95), adjusted goodness of fit index (AGFI, >0.95), root mean square error of approximation (RMSEA, <0.06), and standardized root mean squared residual (SRMR, <0.08). The strength of the relationship between model elements is represented by standardized regression weights and interpreted as follows: <0.1 small effect, 0.11–0.25 medium effect, >0.25 large effect.

2.4. Participants

This study investigated participants of the 2020/2021 year of ‘CO2 League’. The pre-test was completed by all participating teams—47 teams from schools from the Czech Republic (N = 429, seventh–ninth graders from elementary schools and secondary school students, 12–17 years old), of which 21 teams (N = 188) finished all four assigned missions and completed the post-test. Pre- and post-test responses were matched according to anonymous students’ personal codes. Due to missing or mismatching personal codes, the final sample size was reduced to N = 123. The participating schools were from various parts of the Czech Republic and included schools in rural areas, small towns, and big cities, see Table 3 below.

3. Results

The result section is structured according to the research questions stated above. The results of the survey data analysis are followed by qualitative data findings (focus group interviews), which often expand on the survey results.

3.1. RQ1: The Impact of ‘CO2 League’ Program on Participants’ Climate Literacy Components and Their Willingness to Engage in Climate Action

The results from the quantitative data analyses show statistically significant mean increases between the pre-test and post-test for all of the investigated variables. The mean increases for the knowledge dimensions were considerably more significant than increases for CC concern, self-efficacy, and willingness to act (see Table 4).
These findings were consistent with data obtained from focus groups. During the interviews, students (and teachers) unanimously confirmed the positive impact of the program and reported numerous ways the program increased their climate literacy, apart from generally contributing to their life (improving teamwork, communication, and interpersonal skills).
The respondents accentuated substantial improvement of CC system knowledge—many of them claimed no or very poor conceptual understanding of CC. They appreciated having the chance to grasp CC in their own way through project-based activities and autonomous teamwork, to clear up their misconceptions, and to become fully aware of the CC human dimensions and the extent of the problem. This led to their heightened CC concern and awareness of the importance of human action to address climate change.
The main thing is that we learned about how to solve these problems and what they originated from.
(Student 2, team F)
Now, for example, we talk about it more at school, we are concerned about it more than ever before.
(Student 3, team F)
Both the students and teachers especially acknowledged learning about the concept of carbon footprint and various ways of decreasing one’s footprint (action and effectiveness knowledge). Prior to the program, few participants had heard about a ‘carbon footprint’ or thought about the impact of their behaviors and everyday decisions. Due to the participation in the program, they felt well-informed and motivated to make a difference (and to decrease their personal carbon footprint).
I think it was great that they had the chance to think for the first time about what carbon footprint is and how they can reduce it, to present it to the whole class. Later the boys told me that they had talked to their parents at home about whether it was necessary to use two cars and other similar things.
(Teacher A)
Calculating the carbon footprint was something new for the students and also very surprising.
(Teacher D)
Furthermore, the respondents confirmed that the program motivated them to engage in various pro-climatic action. Following the program, many participants reported that their daily routines had changed. Common themes were saving energy, minimizing or recycling waste, sustainable shopping, or preferring walking, cycling, and using public transport over using cars.
After we did the mission with the CO2 calculator, I started to try harder and take public transport and also eat homemade food. We also try not to throw away food at home and not to use disposable plastic packaging.
(Student 3, team A)
Our whole family has become more environmentally friendly-for example, we have started eating less meat or driving less.
(Student 2, team C)
I try to recycle more waste, or buy second-hand things, or reduce eating beef and eat more chicken meat, for example.
(Student 4, team D)
Beyond engaging in personal pro-climatic behaviors, students declared sharing knowledge acquired during the program with their class and schoolmates. This was supported by the design of the program’s assignments which included presenting their results to class or schoolmates through posters, leaflets, presentations in front of class, or team websites/Instagram channels. Sharing knowledge with schoolmates was often perceived as one of the most enjoyable activities of the program. Students also mentioned engaging family and community members and confirmed the “ripple effect” of the program beyond the school context and into family and community settings. Most commonly, students advocated behaviors that save energy, decrease consumption, minimize waste, or decrease burning fossil fuels.
I also really enjoyed presenting some things from ‘CO2 League’ to the others in the class. We tried to tell them what ‘CO2 League’ was about, what was important-a lot of our classmates then told us that they started thinking about it, at least a little bit.
(Student 2, team A)
I liked that I could do something that would affect others, I could inform the whole high school about something important.
(Student 2, team E)
I am glad that I persuaded my family to save more at home, for example save electricity or water.
(Student 3, team A)
Finally, the students also appreciated that the program introduced them to larger-scale CC mitigation and adaptation measures, motivated them to extend their climate action engagement beyond personal actions and enabled them to participate in school or municipal planning. Presenting students’ proposals and interacting with school and municipality officials were viewed by many students as very stimulating and influential.
The last mission, when we wrote to the Minister of Environment, I rewrote the email two or three times before I was satisfied, it was definitely interesting.
(Student 1, team A)
The meeting with the mayor was very stimulating.
(Student 1, team B)
I learned that there are not only solutions for individuals, but that much more can be done at the community level.
(Student 2, team D)
Before the program, they didn’t communicate much, so the benefit was the development of communication, they learned to search for data, they found out how newspapers were edited, they walked around, took pictures, they became interested in their surroundings.
(Teacher B)

3.2. RQ2: The Relation of the Investigated Constructs to Participants’ Willingness to Act

3.2.1. Correlation Analyses

The results of correlation analysis are presented in Table 5. Participants’ system, effectiveness and action knowledge dimensions are only weakly or moderately correlated to self-efficacy and willingness to act (rs range from 0.15 to 0.27, respectively, from 0.14 to 0.26). It is worth noticing that when the three knowledge dimensions are compared, it is action knowledge which has the strongest correlation to self-efficacy and willingness to act.
On the other hand, there is a significantly much stronger positive relationship between knowledge dimensions and CC concern (rs range from 0.24 to 0.40, p < 0.01), indicating that an increasing level of system, effectiveness, and action knowledge about CC may be associated with an increasing level in CC concern.
The correlation analyses also show that there was a very strong positive correlation between increasing concern and self-efficacy, and similarly between increasing concern and willingness to act, suggesting that increasing participants’ concern about CC (reinforced by improved CC knowledge) may lead to participants’ heightened self-efficacy and willingness to act. As the results in Table 5 show, there is also a very strong correlation between increasing self-efficacy and willingness to act.

3.2.2. Structural Model Building

Structural equation modeling method was used for further exploration of the CC knowledge–concern–self-efficacy–willingness to act interrelationships and multiple models of various complexity were fitted to estimate the magnitude and relationship among the variables. All model modifications were theory-guided and considered the CCE literature review conclusions discussed above and the survey/focus group interviews analyses results.
Model 1, presented in Figure 1, was obtained with χ2 = 8.15, p = 0.148, DF = 5; GFI = 0.98; AGFI = 0.91; TLI = 0.97; CFI = 0.99; RMSEA = 0.072; SRMR = 0.033 fit indices values.
Although Model 1 fitted the data adequately and supported most hypothesized prediction paths, action knowledge was not found to be a significant predictor of self-efficacy (β = 0.05) and system knowledge was not proved as a positive predictor of CC concern (β = −0.05). The testing of proposed models indicated that willingness to act is not affected directly by CC knowledge; therefore, this path was omitted from the model. As was hypothesized in correspondence with previous studies, data analysis results, and calculated correlations, we found that CC concern was a quite strong predictor of self-efficacy (β = 0.65) and both CC concern and self-efficacy were significant predictors of willingness to act (β = 0.46, respectively β = 0.32).
After testing further modifications, we also proposed Model 2, presented in Figure 2, which was obtained with χ2 = 1.722, p = 0.89, DF = 5; GFI = 0.99; AGFI = 0.98; TLI = 1.04; CFI = 1; RMSEA < 0.0001, SRMR = 0.019 fit indices values.
In Model 2, we proposed a direct prediction path from system knowledge to self-efficacy and it proved significant (β = 0.18). Effectiveness and action knowledge were found to be significant positive predictors of CC concern (β = 0.26, respectively β = 0.23), but effectiveness knowledge was actually proved as a significant negative predictor of self-efficacy (β = −0.18). CC concern again predicted self-efficacy (β = 0.65) and both self-efficacy and CC concern remained significant predictors of willingness to act (β = 0.46, respectively β = 0.32), as in Model 1.
The results of the structural equation modeling suggest that there was a significant but rather complex causal link between participants’ CC knowledge gains and higher CC concern and self-efficacy, and subsequently higher CC concern and self-efficacy stimulated their willingness to act.

3.3. RQ2: The Relation of Other Predictors (Gender, Age, Elementary/Secondary Interface) to Participants’ Willingness to Act

The analyses of survey data show that girls exhibited significantly higher levels of CC concern and willingness to act than boys (in both pre-test and post-test), but there was no significant difference between girls and boys with regard to CC knowledge and self-efficacy (see Table 6). This corresponds with many previous studies which report females’ higher level of environmental attitudes [3,101,102,103,104,105,106,107]. Regarding CC concern, the ‘CO2 League’ program very likely impacted girls more than boys and heightened girls’ CC concern more significantly, and the p-value changed from 0.024 (pre-test) to 0.009 (post-test).
No significant correlation between age and the investigated constructs was found (see Table 5). It can be assumed that if the sample was larger (e.g., thousands of participants), participants’ CC attitudes and their willingness to act would decrease with increasing age, as has been confirmed by studies investigating environmental attitudes of adolescents [108,109,110].
Additionally, no significant differences between upper-elementary and secondary students within their CC concern, self-efficacy, or willingness to act were found (see Table 7). However, we found out that upper-elementary students were significantly less knowledgeable about CC in the pre-test than secondary students. Younger students lacked mainly CC system knowledge, which means they were less sure about the mechanisms of climate change in the pre-test. However, the difference in knowledge was much smaller and not statistically significant in the post-test, which indicates that participation in the ‘CO2 League’ program most likely enabled upper elementary students to gain important CC (mainly system) knowledge and erased the knowledge difference occurring in the pre-test (see Table 7).

4. Discussion

This study was designed to test the impact of the ‘CO2 League’ program on participants’ CC knowledge, CC concern, CC self-efficacy, and their willingness to engage in pro-climatic behaviors. The results show that the program most likely improved their CC understanding, increased their CC concern and self-efficacy and motivated them to engage in climate action. The results also strengthen evidence that well-planned and well-conducted CCE programs, which follow modern CCE trends described in the Introduction section, improve climate change literacy of their participants. This is consistent with other studies that evaluated impact of similar long-term CCE programs, such as ‘kidZ21′ [14] or ‘Climate Change before the Court’ [85].

4.1. ‘CO2 League’ Strengths

The analyses of quantitative data and focus group interviews reveal several effective strategies employed by the ‘CO2 League’ program which correspond with the contemporary CCE trends mentioned above and most likely contributed to the positive impact of the program on the participants.
Firstly, the program covers a whole school year which gives participants enough time to grasp the complex CC topic [5], improve their CC knowledge, develop their CC attitudes, and engage in climate action, while employing the ‘head, hands, and heart‘ principle introduced by Sipos, Battisti, and Grimm [21]. Secondly, the program is embedded in the school environment, which provides necessary equipment and enables participants to get together, plan and organize activities. But the program also motivates participants to go beyond this environment, engage with their communities and experience climate action in real-life situations. The student-centeredness of the program is another of its strengths. As noted by Trott and Weinberg [80], CCE programs can cultivate a sense of agency that combats climate change anxiety and withdrawal, when they engage young people using participatory approaches and treat them as decision-makers and collaborators throughout the process of learning and action. The program also effectively employs the carbon footprint concept which provides an accessible and fast path to participants’ engagement in personal climate action. The program purposefully motivates participants to share knowledge and experience acquired during ‘CO2 League’, contributing to the ‘ripple effect’ of the program. As the participants confirmed during focus group interviews, shifting from being recipients of CC content to becoming CC communicators strengthened their self-efficacy and their empowerment. Besides that, sharing knowledge was very often felt as enjoyable and stimulating. Finally, the program enables participants to interact with various stakeholders (school management, municipal, and state administration officers) and participate in community projects, local climate action, and municipal planning. As many previous studies confirm, such interaction and engagement contribute to the cultivation of the youths’ political voice and their political empowerment, they help them overcome climate change anxiety and other grave feelings and prepare them to become ‘future leaders’ of climate crisis solutions [14,42,43,44,77,78,79]. However, children and young people are still under-engaged in climate change dialogue and action and overlooked as agents of change within their families and communities [84].

4.2. The Role of CC Knowledge and CC Concern in CCE

In correspondence with Czech and foreign surveys and studies [61,62,111], this study implies that young people have a very low and sketchy CC knowledge. They lack knowledge of causal relations within the climate system, and they are not aware of their role as ‘causal agents’ within climate change and its mitigation [111]. As the results show, the ‘CO2 League’ program helped its participants to correct this deficiency and gain sufficient understanding of climate mechanisms and their own personal role in them. This seems to be crucial for building climate action potential. The results of this study supports previous studies [11,111] which argue that the willingness to adopt pro-climatic behavior presupposes a clear and explicit understanding of climate dynamics and its causal relations and that there is a certain threshold level of CC knowledge that needs to be reached to trigger a behavioral response. Taquier and Pongiglione [111] call for knowledge where individual causality is clear and explicit, and that acquiring some practical knowledge on the impact of daily actions on the environment may allow people to help prevent climate change. Although our proposed model did not show a direct causal link between CC knowledge and willingness to act, in consistency with previous studies [24,52,66] sufficient CC knowledge proved to be a key initial driver which enhances CC concern. CC concern subsequently mediated knowledge–self–efficacy and knowledge–willingness to action relationships. This confirms what recent studies and models suggest: sufficient knowledge leads one to feel concerned, and subsequently being concerned leads one to feel more self-efficacious [29,31,33]. Corresponding with previous studies [29,31,32,33,34], our results and their analysis also show the crucial role of CC concern and the causal link which leads from heightened CC concern to enhancing CC self-efficacy and willingness to engage in climate action.

4.3. Models of Paths to Pro-Climatic Behavior

As the proposed models show, this study adds a new perspective to developing a theoretical model of climate change behavior among adolescents that links knowledge, concern, self-efficacy, and behavior, and highlights a need to accommodate this framework within climate change education [52]. Our study also confirms the conclusion of previous studies [11,24] that CC knowledge is a complex and multi-faceted construct and a three-dimensional CC knowledge concept (system, action, effectiveness knowledge dimensions) represents CC knowledge significantly better than a general knowledge construct. The three-dimensional concept should be applied when CC knowledge is analyzed as a predictor of CC attitudes and pro-climatic behavior, as it enables more detailed and accurate analyses. Previous studies confirm that action knowledge and effectiveness knowledge have been found to mediate the effect of system knowledge on behavior and are considered more directly related to behavior [24] and action knowledge has been considered to have a greater impact on pro-climate behavior than system knowledge. However, in contrast to the mentioned studies and to what we expected, the models proposed by this study imply a different role of system knowledge, which proved to be significantly related to self-efficacy. We also found that action and effectiveness knowledge were not significantly linked to CC self-efficacy, but they significantly predicted CC concern. This might be caused by the particular knowledge content of the program and the definition of what system, action, and effectiveness knowledge actually contain. In the case of the ‘CO2 League’ program, system knowledge included learning about the concept of carbon footprint. As the focus group interviews revealed, only a few participants had heard about a ‘carbon footprint’ prior to the program and they really appreciated learning about it. They reported that it enabled them to think about the impact of their behaviors and to realize that they can make a difference. Moreover, focus group interviews showed that acquiring system knowledge about their individual role in the causal mechanisms of CC often translated into engaging in climate action. The second reason might be that ‘CO2 League’ content and assignments interlinked system knowledge with personal and local contexts and enabled participants to learn about the causes and effects of CC in their surroundings. The importance of providing personal and local perspectives in CCE programs is supported by many previous studies [65,71,73,74,75]. On the other hand, action and effectiveness knowledge included general information about human activities which help mitigate CC, and it was presented at the early stage of the program from a global perspective. This might have enhanced the contribution of action and effectiveness knowledge to increasing CC concern.

4.4. Implications for CCE and Future Studies

This study raises a few interesting questions for future studies. The findings presented above suggest that sufficient CC knowledge is one of the key initial drivers for climate action (crucial for increasing CC concern and self-efficacy), especially for young people, whose CC knowledge is very sketchy and who need to grasp an understanding of climate dynamics and its causal relations. This means there is a certain information deficit and it needs to be overcome. This does not mean that enabling young people to understand the mechanisms of CC and their role in it is enough—learning about CC mechanisms must be accompanied by activities strengthening youth’s self-efficacy, building constructive hope, and providing opportunities to engage successfully in personal and community climate action. Further research should investigate how the model of climate change behavior among adolescents that links knowledge, concern, self-efficacy, and behavior can be translated into effective formal and non-formal CCE programs. Our study also suggests that more research with larger and more representative samples should be focused on the nuanced interrelations and roles of system, effectiveness, and action CC knowledge and their complex relationships to CC concern, CC self-efficacy, and willingness to engage in climate action. Furthermore, the question of what system, action, and effectiveness knowledge should actually contain to help design effective CCE programs requires more investigation, as well as utilizing the concept of carbon footprint in CCE as an effective means to engage young people in climate action.

4.5. Limitations

Some limitations of this study have to be mentioned. First, there was no control group to compare the results of the intervention with students who did not participate in the ‘CO2 League’. Secondly, our analyses included only a limited set of variables and did not cover other important factors which might influence willingness to participate in pro-climate actions, such as social and personal norms, worldview, situational factors, and the influence of social groups and authorities. As the survey applied in this study did not control for these additional influencing factors, the significant mean increases in participants’ CC knowledge and CC attitudes cannot be unambiguously attributed to the ‘CO2 League’ intervention. Another limitation of this study is that the participants joined the’ CO2 league’ program on a voluntary basis, which means they do not represent a random sample because it is likely that they arrived with a certain amount of interest in the program’s content and motivation to engage in climate action. This raises doubts about the external validity of the presented findings. Whether the findings will replicate outside the program and whether students without initial interest and motivation will also experience the program’s positive effects, is a question for future research. However, the mixed-methods approach enabled measuring the program’s impacts in multiple ways, and focus group interviews served to clarify and elaborate on survey findings, while allowing participants to specify behavioral changes motivated by their participation in the program. An additional limitation is that post-program focus group interviews took place soon after the program ended, so the long-term impacts of the program are unknown, including whether and to what extent participants’ behavioral shifts were sustained over time. Finally, within the statistical analysis of quantitative data, it is necessary to interpret the results in the light of the lower reliability of some of the knowledge scales, mainly due to the small number of items.

5. Conclusions

This study explored the multi-level impacts of the ‘CO2 League’ program on its participants’ CC knowledge, CC concern, CC self-efficacy, and their willingness to engage in climate action. One important conclusion is that the program significantly improved their CC understanding, increased their CC concern and self-efficacy and motivated them to engage in climate action. Another important result is that the statistical analysis of the quantitative data revealed the crucial and complex role of CC knowledge which needs to reach a certain threshold level to become a key driver for enhancing CC concern and CC self-efficacy (mediated by CC concern). We also found out that the ‘CO2 League’ participants were inspiring action and sharing knowledge with others around them, including friends and family as well as in school and community settings.
The results also strengthen evidence that well-planned and well-conducted CCE programs, which follow modern CCE trends, improve climate change literacy of their participants, and develop their potential to make well-informed decisions, take relevant climate action, and be future leaders of finding solutions to climate crisis.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/su141610365/s1, S1: Online survey and Focus group interview (full wording).

Author Contributions

Conceptualization, M.K.; methodology, M.K, R.K. and J.Č.; validation, M.K, R.K. and J.Č.; formal analysis, M.K.; investigation, M.K.; data curation, R.K.; writing—original draft preparation, M.K.; writing—review and editing, M.K., R.K. and J.Č. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study, because the research was anonymous and did not monitor sensitive data. The approval of the Commission for Ethics in Research was not required for its implementation. There was no risk for research participants.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. IPCC. Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change; Cambridge University Press: Cambridge, UK, 2021. [Google Scholar]
  2. IPCC. Climate Change 2022: Impacts, Adaptation, and Vulnerability. Contribution of Working Group II to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change; Cambridge University Press: Cambridge, UK, 2022. [Google Scholar]
  3. Lehnert, M.; Fiedor, D.; Frajer, J.; Hercik, J.; Jurek, M. Czech Students and Mitigation of Global Warming: Beliefs and Willingness to Take Action. Environ. Educ. Res. 2020, 26, 864–889. [Google Scholar] [CrossRef]
  4. Azevedo, J.; Marques, M. Climate Literacy: A Systematic Review and Model Integration. Int. J. Glob. Warm. 2017, 12, 414–430. [Google Scholar] [CrossRef]
  5. McNeal, K.S.; St John, K.; Sullivan, S.B. Introduction to the Theme: Outcomes of Climate Literacy Efforts (Part 1). J. Geosci. Educ. 2014, 62, 291–295. [Google Scholar] [CrossRef]
  6. DeWaters, J.E.; Andersen, C.; Calderwood, A.; Powers, S.E. Improving Climate Literacy with Project-Based Modules Rich in Educational Rigor and Relevance. J. Geosci. Educ. 2014, 62, 469–484. [Google Scholar] [CrossRef]
  7. Bodzin, A.M.; Anastasio, D.; Sahagian, D.; Peffer, T.; Dempsey, C.; Steelman, R. Investigating Climate Change Understandings of Urban Middle-Level Students. J. Geosci. Educ. 2014, 62, 417–430. [Google Scholar] [CrossRef]
  8. Bangay, C.; Blum, N. Education Responses to Climate Change and Quality: Two Parts of the Same Agenda? Int. J. Educ. Dev. 2010, 30, 359–368. [Google Scholar] [CrossRef] [Green Version]
  9. Busch, K.C.; Henderson, J.A.; Stevenson, K.T. Broadening Epistemologies and Methodologies in Climate Change Education Research. Environ. Educ. Res. 2019, 25, 955–971. [Google Scholar] [CrossRef]
  10. Buhr Sullivan, S.M.; St. John, K. Continuation of the Theme: Outcomes of Climate Literacy Efforts (Part 2). J. Geosci. Educ. 2014, 62, 535–537. [Google Scholar] [CrossRef]
  11. Bofferding, L.; Kloser, M. Middle and High School Students’ Conceptions of Climate Change Mitigation and Adaptation Strategies. Environ. Educ. Res. 2015, 21, 275–294. [Google Scholar] [CrossRef]
  12. Bedford, D. Does Climate Literacy Matter? A Case Study of U.S. Students’ Level of Concern about Anthropogenic Global Warming. J. Geogr. 2016, 115, 187–197. [Google Scholar] [CrossRef]
  13. Cordero, E.C.; Centeno, D.; Todd, A.M. The Role of Climate Change Education on Individual Lifetime Carbon Emissions. PLoS ONE 2020, 15, e0206266. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Deisenrieder, V.; Kubisch, S.; Keller, L.; Stötter, J. Bridging the Action Gap by Democratizing Climate Change Education-The Case of k.i.d.Z.21 in the Context of Fridays for Future. Sustainability 2020, 12, 1748. [Google Scholar] [CrossRef] [Green Version]
  15. Christensen, R.; Knezek, G. The Climate Change Attitude Survey: Measuring Middle School Student Beliefs and Intentions to Enact Positive Environmental Change. Int. J. Environ. Sci. Educ. 2015, 10, 773–788. [Google Scholar] [CrossRef]
  16. Kuthe, A.; Keller, L.; Körfgen, A.; Stötter, H.; Oberrauch, A.; Höferl, K.M. How Many Young Generations Are There? –A Typology of Teenagers’ Climate Change Awareness in Germany and Austria. J. Environ. Educ. 2019, 50, 172–182. [Google Scholar] [CrossRef] [Green Version]
  17. Miléř, T.; Sládek, P. The Climate Literacy Challenge. Procedia-Soc. Behav. Sci. 2011, 12, 150–156. [Google Scholar] [CrossRef] [Green Version]
  18. Niepold, F.; Herring, D.; McConville, D. The Case for Climate Literacy in the 21st Century. In Proceedings of the 5th International Symposium on Digital Earth, University of California, Berkeley, CA, USA, 5–9 June 2007. [Google Scholar]
  19. Park, N.-E.; Choe, S.-U.; Kim, C.-J. Analysis of Climate Change Education (CCE) Programs: Focusing on Cultivating Citizen Activists to Respond to Climate Change. Asia-Pacific Sci. Educ. 2020, 6, 15–40. [Google Scholar] [CrossRef]
  20. Hung, C.C. Climate Change Education: Knowing, Doing and Being; Routledge: New York, NY, USA, 2014; pp. 20–132. [Google Scholar]
  21. Sipos, Y.; Battisti, B.; Grimm, K. Achieving Transformative Sustainability Learning: Engaging Head, Hands and Heart. Int. J. Sustain. High. Educ. 2008, 9, 68–86. [Google Scholar] [CrossRef]
  22. Daniš, P.; Březovská, R.; Činčera, J.; Kolenatý, M.; Krajhanzl, J.; Kulich, J.; Medek, M.; Svobodová, R.; Žďárský, T. Klima Se Mění. A Co My? Ministry of Environment: Prague, Czech Republic, 2021; p. 15. [Google Scholar]
  23. Boyes, E.; Skamp, K.; Stanisstreet, M. Australian Secondary Students’ Views about Global Warming: Beliefs about Actions, and Willingness to Act. Res. Sci. Educ. 2009, 39, 661–680. [Google Scholar] [CrossRef]
  24. Frick, J.; Kaiser, F.G.; Wilson, M. Environmental Knowledge and Conservation Behavior: Exploring Prevalence and Structure in a Representative Sample. Pers. Individ. Dif. 2004, 37, 1597–1613. [Google Scholar] [CrossRef]
  25. Jensen, B.B. Knowledge, Action and Pro- Environmental Behaviour. Environ. Educ. Res. 2002, 8, 325–334. [Google Scholar] [CrossRef]
  26. Krathwohl, D.R. A Revision of Bloom’s Taxonomy: An Overview. Theory Pract. 2002, 41, 212–218. [Google Scholar] [CrossRef]
  27. Meinhold, J.L.; Malkus, A.J. Adolescent Environmental Behaviors: Can Knowledge, Attitudes and Self-Efficacy Make a Difference? Environ. Behav. 2005, 37, 511–532. [Google Scholar] [CrossRef]
  28. Ajzen, I. Perceived Behavioral Control, Self-Efficacy, Locus of Control, and the Theory of Planned Behavior. J. Appl. Soc. Psychol. 2002, 32, 665–683. [Google Scholar] [CrossRef]
  29. Devine-Wright, P.; Devine-Wright, H.; Fleming, P. Situational Influences upon Children’s Beliefs about Global Warming and Energy. Environ. Educ. Res. 2004, 10, 493–506. [Google Scholar] [CrossRef]
  30. Corner, A.; Roberts, O. Young Voices; Climate Outreach: Oxford, UK, 2014; pp. 3–29. [Google Scholar]
  31. Milfont, T.L. The Interplay Between Knowledge, Perceived Efficacy, and Concern About Global Warming and Climate Change: A One-Year Longitudinal Study. Risk Anal. 2012, 32, 1003–1020. [Google Scholar] [CrossRef]
  32. Minelgaitė, A.; Liobikienė, G. Changes in Pro-Environmental Behaviour and Its Determinants during Long-Term Period in a Transition Country as Lithuania. Environ. Dev. Sustain. 2021, 23, 16083–16099. [Google Scholar] [CrossRef]
  33. Busch, K.C.; Ayala Chávez, R. Adolescent Framings of Climate Change, Psychological Distancing, and Implications for Climate Change Concern and Behavior. Clim. Chang. 2022, 171, 21. [Google Scholar] [CrossRef]
  34. Jakučionytė-Skodienė, M.; Liobikienė, G. Climate Change Concern, Personal Responsibility and Actions Related to Climate Change Mitigation in EU Countries: Cross-Cultural Analysis. J. Clean. Prod. 2021, 281, 125189. [Google Scholar] [CrossRef]
  35. Leiserowitz, A.; Maibach, E.; Rosenthal, S.; Kotcher, J.; Bergquist, P.; Ballew, M.T.; Goldberg, M.; Gustafson, A.; Wang, X. Climate Change in the American Mind; Yale University and George Mason University: New Haven, CT, USA, 2020; pp. 4–34. [Google Scholar]
  36. Leiserowitz, A.; Smith, N. Knowledge of Climate Change across Global Warming’s Six Americas; Yale University: New Haven, CT, USA, 2010; pp. 2–6. [Google Scholar]
  37. Leiserowitz, A.; Smith, N.; Marlon, J. American Teens’ Knowledge of Climate Change; Yale University: New Haven, CT, USA, 2011; pp. 2–49. [Google Scholar]
  38. Mead, E.; Roser-Renouf, C.; Rimal, R.N.; Flora, J.A.; Maibach, E.W.; Leiserowitz, A. Information Seeking About Global Climate Change Among Adolescents: The Role of Risk Perceptions, Efficacy Beliefs, and Parental Influences. Atl. J. Commun. 2012, 20, 31–52. [Google Scholar] [CrossRef] [Green Version]
  39. Bandura, A. Self-Efficacy: Toward a Unifying Theory of Behavioral Change. Psychol. Rev. 1977, 84, 191–215. [Google Scholar] [CrossRef]
  40. Ojala, M. Hope and Climate Change: The Importance of Hope for Environmental Engagement among Young People. Environ. Educ. Res. 2012, 18, 625–642. [Google Scholar] [CrossRef]
  41. Ratinen, I.; Uusiautti, S. Finnish Students’ Knowledge of Climate Change Mitigation and Its Connection to Hope. Sustainability 2020, 12, 2181. [Google Scholar] [CrossRef] [Green Version]
  42. Ojala, M. How Do Children Cope with Global Climate Change? Coping Strategies, Engagement, and Well-Being. J. Environ. Psychol. 2012, 32, 225–233. [Google Scholar] [CrossRef]
  43. Ojala, M. Coping with Climate Change among Adolescents: Implications for Subjective Well-Being and Environmental Engagement. Sustainability 2013, 5, 2191–2209. [Google Scholar] [CrossRef] [Green Version]
  44. Ojala, M. Regulating Worry, Promoting Hope: How Do Children, Adolescents, and Young Adults Cope with Climate Change? Int. J. Environ. Sci. Educ. 2012, 7, 537–561. [Google Scholar]
  45. Burgess, J.; Harrison, C.M.; Filius, P. Environmental Communication and the Cultural Politics of Environmental Citizenship. Environ. Plan. A 1998, 30, 1445–1460. [Google Scholar] [CrossRef] [Green Version]
  46. Hines, J.M.; Hungerford, H.R.; Tomera, A.N. Analysis and Synthesis of Research on Responsible Environmental Behavior: A Meta-Analysis. J. Environ. Educ. 1987, 18, 1–8. [Google Scholar] [CrossRef]
  47. Bamberg, S.; Möser, G. Twenty Years after Hines, Hungerford, and Tomera: A New Meta-Analysis of Psycho-Social Determinants of pro-Environmental Behaviour. J. Environ. Psychol. 2007, 27, 14–25. [Google Scholar] [CrossRef]
  48. Kollmuss, A.; Agyeman, J. Mind the Gap: Why Do People Act Environmentally and What Are the Barriers to pro-Environmental Behavior? Environ. Educ. Res. 2002, 8, 239–260. [Google Scholar] [CrossRef] [Green Version]
  49. Ajzen, I. The Theory of Planned Behavior. Organ. Behav. Hum. Decis. Process. 1991, 50, 179–211. [Google Scholar] [CrossRef]
  50. Stern, P.C. Toward a Coherent Theory of Environmentally Significant Behavior. J. Soc. Issues 2000, 56, 407–424. [Google Scholar] [CrossRef]
  51. Dijkstra, E.M.; Goedhart, M.J. Development and Validation of the ACSI: Measuring Students’ Science Attitudes, pro-Environmental Behaviour, Climate Change Attitudes and Knowledge. Environ. Educ. Res. 2012, 18, 733–749. [Google Scholar] [CrossRef]
  52. Stevenson, K.T.; Nils Peterson, M.; Bondell, H.D. Developing a Model of Climate Change Behavior among Adolescents. Clim. Chang. 2018, 151, 589–603. [Google Scholar] [CrossRef]
  53. Fien, J.; Yencken, D.; Sykes, H. Environment, Education and Society in the Asia-Pacific; Routledge: New York, NY, USA, 2000; pp. 189–220. [Google Scholar]
  54. Stoutenborough, J.W.; Vedlitz, A. The Effect of Perceived and Assessed Knowledge of Climate Change on Public Policy Concerns: An Empirical Comparison. Environ. Sci. Policy 2014, 37, 23–33. [Google Scholar] [CrossRef]
  55. Guy, S.; Kashima, Y.; Walker, I.; O’Neill, S. Investigating the Effects of Knowledge and Ideology on Climate Change Beliefs. Eur. J. Soc. Psychol. 2014, 44, 421–429. [Google Scholar] [CrossRef]
  56. McNeill, K.L.; Vaughn, M.H. Urban High School Students’ Critical Science Agency: Conceptual Understandings and Environmental Actions Around Climate Change. Res. Sci. Educ. 2012, 42, 373–399. [Google Scholar] [CrossRef]
  57. Aitken, C.; Chapman, R.; McClure, J. Climate Change, Powerlessness and the Commons Dilemma: Assessing New Zealanders’ Preparedness to Act. Glob. Environ. Chang. 2011, 21, 752–760. [Google Scholar] [CrossRef]
  58. Lorenzoni, I.; Nicholson-Cole, S.; Whitmarsh, L. Barriers Perceived to Engaging with Climate Change among the UK Public and Their Policy Implications. Glob. Environ. Chang. 2007, 17, 445–459. [Google Scholar] [CrossRef]
  59. Truelove, H.B.; Parks, C. Perceptions of Behaviors That Cause and Mitigate Global Warming and Intentions to Perform These Behaviors. J. Environ. Psychol. 2012, 32, 246–259. [Google Scholar] [CrossRef]
  60. Roser-Renouf, C.; Maibach, E.; Myers, T. American Adolescents’ Knowledge, Attitudes and Sources of Information on Climate Change; George Mason University: Fairfax, CA, USA, 2020; pp. 8–26. [Google Scholar]
  61. Corner, A.; Roberts, O.; Chiari, S.; Völler, S.; Mayrhuber, E.S.; Mandl, S.; Monson, K. How Do Young People Engage with Climate Change? The Role of Knowledge, Values, Message Framing, and Trusted Communicators. Wiley Interdiscip. Rev. Clim. Chang. 2015, 6, 523–534. [Google Scholar] [CrossRef]
  62. Krajhanzl, J.; Chabada, T.; Svobodová, R. České Klima 2021; Masaryk University: Brno, Czech Republic, 2021; pp. 5–92. [Google Scholar]
  63. Clary, B.R.M.; Wandersee, J.H. Mandatory Climate Change Discussions in Online Classrooms: Promoting Students’ Climate Literacy and Understanding of the Nature of Science. J. Coll. Sci. Teach. 2012, 41, 70–79. [Google Scholar]
  64. Keller, L.; Stötter, J.; Oberauch, A.; Kuthe, A.; Körfgen, A.; Hüfner, K. Changing Climate Change Education. GAIA 2019, 28, 35–43. [Google Scholar] [CrossRef]
  65. Kagawa, F.; Selby, D. Education and Climate Change, 1st ed.; Kagawa, F., Selby, D., Eds.; Routledge: New York, NY, USA, 2010; pp. 241–245. [Google Scholar]
  66. Wise, S.B. Climate Change in the Classroom: Patterns, Motivations, and Barriers to Instruction among Colorado Science Teachers. J. Geosci. Educ. 2010, 58, 297–309. [Google Scholar] [CrossRef]
  67. Anderson, A. Climate Change Education for Mitigation and Adaptation. J. Educ. Sustain. Dev. 2012, 6, 191–206. [Google Scholar] [CrossRef]
  68. Stevenson, R.B.; Nicholls, J.; Whitehouse, H. What Is Climate Change Education? Curric. Perspect. 2017, 37, 67–71. [Google Scholar] [CrossRef]
  69. Hayden, M.; Houwer, R. Pedagogies of Empowerment in the Face of Climate Change Uncertainty. J. Act. Sci. Technol. Educ. 2011, 3, 118–130. [Google Scholar]
  70. Fahey, S.J.; Labadie, J.R.; Meyers, N. Turning the Titanic: Inertia and the Drivers of Climate Change Education. Eletronic Libr. 2018, 34, 1–5. [Google Scholar]
  71. Monroe, M.C.; Plate, R.R.; Oxarart, A.; Bowers, A.; Chaves, W.A. Identifying Effective Climate Change Education Strategies: A Systematic Review of the Research. Environ. Educ. Res. 2017, 25, 791–812. [Google Scholar] [CrossRef]
  72. Rousell, D.; Cutter-Mackenzie-Knowles, A. A Systematic Review of Climate Change Education: Giving Children and Young People a ‘Voice’ and a ‘Hand’ in Redressing Climate Change. Child. Geogr. 2020, 18, 191–208. [Google Scholar] [CrossRef]
  73. Khadka, A.; Li, C.J.; Stanis, S.W.; Morgan, M. Unpacking the Power of Place-Based Education in Climate Change Communication. Appl. Environ. Educ. Commun. 2021, 20, 77–91. [Google Scholar] [CrossRef]
  74. Bardsley, D.K.; Bardsley, A.M. A Constructivist Approach to Climate Change Teaching and Learning. Geogr. Res. 2007, 45, 329–339. [Google Scholar] [CrossRef]
  75. Hallar, A.G.; McCubbin, I.B.; Wright, J.M. Change: A Place-Based Curriculum for Understanding Climate Change at Storm Peak Laboratory, Colorado. Bull. Am. Meteorol. Soc. 2011, 92, 909–918. [Google Scholar] [CrossRef]
  76. Sterling, S. Sustainable Education—Re-Visioning Learning and Change; Green Books: Dartington, UK, 2001; pp. 5–90. [Google Scholar]
  77. Lehtonen, A.; Salonen, A.O.; Cantell, H. Climate Change Education: A New Approach for a World of Wicked Problems; Springer: Cham, Switzerland, 2018; ISBN 9783319785806. [Google Scholar]
  78. Cantell, H.; Tolppanen, S.; Aarnio-Linnanvuori, E.; Lehtonen, A. Bicycle Model on Climate Change Education: Presenting and Evaluating a Model. Environ. Educ. Res. 2019, 25, 717–731. [Google Scholar] [CrossRef]
  79. Cutter-Mackenzie, A.; Rousell, D. Education for What? Shaping the Field of Climate Change Education with Children and Young People as Co-Researchers. Child. Geogr. 2019, 17, 90–104. [Google Scholar] [CrossRef]
  80. Trott, C.; Weinberg, A.E. Science Education for Sustainability: Strengthening Children’s Science Engagement through Climate Change Learning and Action Article. Sustainability 2020, 12, 6400. [Google Scholar] [CrossRef]
  81. Hicks, D. The Long Transition: Educating for Optimism and Hope in Troubled Times. In Proceedings of the 3rd Annual Conference of the UK Teacher Education Network for Education for Sustainable Development/Global Citizenship, London, UK, 15 July 2010. [Google Scholar]
  82. Li, C.; Monroe, M.C. Development and Validation of the Climate Change Hope Scale for High School Students. Environ. Behav. 2018, 50, 454–479. [Google Scholar] [CrossRef] [Green Version]
  83. Li, C.J.; Monroe, M.C. Exploring the Essential Psychological Factors in Fostering Hope Concerning Climate Change. Environ. Educ. Res. 2019, 25, 936–954. [Google Scholar] [CrossRef]
  84. Trott, C.D. Reshaping Our World: Collaborating with Children for Community-Based Climate Change Action. Action Res. 2019, 17, 42–62. [Google Scholar] [CrossRef]
  85. Feierabend, T.; Eilks, I. Innovating Science Teaching by Participatory Action Research–Reflections from an Interdisciplinary Project of Curriculum Innovation on Teaching about Climate Change. Cent. Educ. Policy Stud. J. 2011, 1, 93–112. [Google Scholar] [CrossRef]
  86. Tobias, S.; Duffy, T.M. Constructivist Instruction: Success or Failure? Routledge: New York, NY, USA, 2009; pp. 158–179. [Google Scholar]
  87. Fosnot, C.T. Constructivism: Theory, Perspectives, and Practice; Teachers College Press: New York, NY, USA, 2005; pp. 30–62. [Google Scholar]
  88. Leat, D.; Lofthouse, R.; Thomas, U. Implementing Enquiry and Project-Based Learning–Revolution or Evolution? Educ. Today 2015, 65, 12–17. [Google Scholar]
  89. Littleton, K.; Scanlon, E.; Sharples, M. (Eds.) Orchestrating Inquiry Learning, 1st ed.; Routledge: London, UK, 2012; pp. 47–68. [Google Scholar]
  90. Garrison, D.R. Thinking Collaboratively: Learning in a Community of Inquiry, 1st ed.; Routledge: New York, NY, USA, 2015; pp. 86–100. [Google Scholar]
  91. Patton, M.Q. Qualitative Research and Evaluation Methods: Theory and Practice, 4th ed.; SAGE Publications: Thousand Oaks, CA, USA, 2015; pp. 621–700. [Google Scholar]
  92. Neuman, W.L. Social Research Methods: Qualitative and Quantitative Approaches, 7th ed.; Pearson: Harlow, UK, 2014; pp. 431–476. [Google Scholar]
  93. Kaplan, D. The Sage Handbook of Quantitative Methodology for the Social Sciences; SAGE Publications: Thousand Oaks, CA, USA, 1999; pp. 317–334. [Google Scholar]
  94. Özdem, Y.; Dal, B.; Öztürk, N.; Sönmez, D.; Alper, U. What is That Thing Called Climate Change? An Investigation into the Understanding of Climate Change by Seventh-Grade Students. Int. Res. Geogr. Environ. Educ. 2014, 23, 294–313. [Google Scholar] [CrossRef]
  95. Chhokar, K.; Dua, S.; Taylor, N.; Boyes, E.; Stanisstreet, M. Indian Secondary Students’ Views about Global Warming: Beliefs about the Usefulness of Actions and Willingness to Act. Int. J. Sci. Math. Educ. 2011, 9, 1167–1188. [Google Scholar] [CrossRef]
  96. Braun, V.; Clarke, V. Using Thematic Analysis in Psychology. Appl. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef] [Green Version]
  97. Teksoz, G.; Sahin, E.; Tekkaya-Oztekin, C. Modeling Environmental Literacy of University Students. J. Sci. Educ. Technol. 2012, 21, 157–166. [Google Scholar] [CrossRef]
  98. Busch, K.C.; Ardoin, N.; Gruehn, D.; Stevenson, K. Exploring a Theoretical Model of Climate Change Action for Youth. Int. J. Sci. Educ. 2019, 41, 2389–2409. [Google Scholar] [CrossRef]
  99. Wang, C.; Geng, L.; Rodríguez-Casallas, J.D. How and When Higher Climate Change Risk Perception Promotes Less Climate Change Inaction. J. Clean. Prod. 2021, 321, 128952. [Google Scholar] [CrossRef]
  100. Hu, L.T.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  101. McCright, A.M. The Effects of Gender on Climate Change Knowledge and Concern in the American Public. Popul. Environ. 2010, 32, 66–87. [Google Scholar] [CrossRef]
  102. Knight, K.W. Explaining Cross-National Variation in the Climate Change Concern Gender Gap: A Research Note. Soc. Sci. J. 2019, 56, 627–632. [Google Scholar] [CrossRef]
  103. Gökmen, A. The Effect of Gender on Environmental Attitude: A Meta-Analysis Study. J. Pedagog. Res. 2021, 5, 243–257. [Google Scholar] [CrossRef]
  104. Dietz, T.; Dan, A.; Shwom, R. Support for Climate Change Policy: Social Psychological and Social Structural Influences. Rural Sociol. 2007, 72, 185–214. [Google Scholar] [CrossRef] [Green Version]
  105. Ergas, C.; York, R. Women’s Status and Carbon Dioxide Emissions: A Quantitative Cross-National Analysis. Soc. Sci. Res. 2012, 41, 965–976. [Google Scholar] [CrossRef] [PubMed]
  106. Theodori, G.L.; Luloff, A.E. Position on Environmental Issues and Engagement in Proenvironmental Behaviors. Soc. Nat. Resour. 2002, 15, 471–482. [Google Scholar] [CrossRef]
  107. Xiao, C.; McCright, A.M. Explaining Gender Differences in Concern about Environmental Problems in the United States. Soc. Nat. Resour. 2012, 25, 1067–1084. [Google Scholar] [CrossRef]
  108. Voza, D.; Milošević, I.; Vuković, M. Comparative Analysis of Environmental Attitudes of Youth from EU Member and Candidate States: Case Study Central and Eastern Europe. TEME 2022, 46, 175–194. [Google Scholar] [CrossRef]
  109. Liefländer, A.K.; Fröhlich, G.; Bogner, F.X.; Schultz, P.W. Promoting Connectedness with Nature through Environmental Education. Environ. Educ. Res. 2013, 19, 370–384. [Google Scholar] [CrossRef]
  110. Liefländer, A.K.; Bogner, F.X. The Effects of Children’s Age and Sex on Acquiring pro-Environmental Attitudes through Environmental Education. J. Environ. Educ. 2014, 45, 105–117. [Google Scholar] [CrossRef]
  111. Tasquier, G.; Pongiglione, F. The Influence of Causal Knowledge on the Willingness to Change Attitude towards Climate Change: Results from an Empirical Study. Int. J. Sci. Educ. 2017, 39, 1846–1868. [Google Scholar] [CrossRef]
Figure 1. Model 1.
Figure 1. Model 1.
Sustainability 14 10365 g001
Figure 2. Model 2.
Figure 2. Model 2.
Sustainability 14 10365 g002
Table 1. Overview of ‘CO2 League’ missions.
Table 1. Overview of ‘CO2 League’ missions.
MissionTargeted Climate Literacy ComponentActivities
1CC system knowledge, CC concernwatching videos, reading texts, brainstorming activities, depicting CC through mind maps and art-based activities,
sharing results with schoolmates (posters, videos, presenting in front of class, website creation)
2CC action and effectiveness knowledge (mitigation), self-efficacy, personal climate actioncalculating and discussing personal/school carbon footprint, implementing students’ ideas to decrease their carbon footprint, sharing results with schoolmates (posters, leaflets, presenting in front of class, team website)
3CC action and effectiveness knowledge (adaptation), self-efficacy, community climate actioncreating an urban ’feeling map’ of local areas threatened by drought, heat waves and floods, preparing proposals for adaptation measures
4CC self-efficacy, CC hope and empowerment, community climate actioninteracting with local and national stakeholders,
presenting students’ mitigation and adaptation proposals to municipality officers, writing to relevant government officials, participation
Table 2. Survey structure and Cronbach’s alpha test results.
Table 2. Survey structure and Cronbach’s alpha test results.
Survey DimensionNumber of ItemsCronbach’s Alpha
System knowledge30.57
Action knowledge20.55
Effectiveness knowledge100.67
Knowledge (aggregate)150.79
Concern80.80
Self-efficacy70.79
Willingness to act80.73
Table 3. Socio-demographic characteristics of participants (N = 123).
Table 3. Socio-demographic characteristics of participants (N = 123).
CharacteristicsGroupN%
Gendergirls7056.9%
boys5343.1%
Age12 years75.7%
13 years2117.1%
14 years2621.1%
15 years2822.8%
16 years3125.2%
17 years108.1%
School type (nth grade)elementary school (7.)2621.1%
elementary school (8.)2318.7%
elementary school (9.)2822.8%
secondary school (1.)3427.6%
secondary school (2.)108.1%
secondary school (3.)21.6%
Rural area/Town/Cityrural area3226%
town5141.5%
city4032.5%
Table 4. Summary of paired-samples t-tests for investigated scales.
Table 4. Summary of paired-samples t-tests for investigated scales.
VariableMpreSDpreMpostSDposttCohen’s d
System knowledge1.160.631.480.65−5.31 **0.48
Action knowledge0.700.450.870.45−4.06 **0.37
Effectiv. Knowledge6.541.146.980.128−3.64 **0.33
Knowledge (aggregate)8.401.289.322.01−5.43 **0.49
Concern4.000.634.130.63−2.84 *0.26
Self-efficacy3.480.703.610.74−2.38 *0.22
Willingness to act3.690.743.780.67−2.05 *0.19
Note: * p < 0.05; ** p < 0.001.
Table 5. Correlations between scales.
Table 5. Correlations between scales.
AgeSystem KnowledgeAction KnowledgeEffectiveness KnowledgeKnowledge (Aggregate)ConcernSelf-Efficacy
Age
System knowledge0.12
Action knowledge0.140.63 **
Effectiveness knowledge0.090.47 **0.52 **
Knowledge (aggregate)0.130.77 **0.76 **0.91 **
Concern−0.070.24 **0.36 **0.38 **0.40 **
Self-efficacy−0.020.25 **0.27 **0.150.24 **0.63 **
Willingness to act−0.060.140.26 **0.18 *0.22 *0.66 **0.61 **
Note: * p < 0.05; ** p < 0.01.
Table 6. Gender differences.
Table 6. Gender differences.
VariablesMgirlSDgirlMboySDboytCohen’s d
System knowledge PRE1.080.631.260.61−1.590.289
System knowledge POST1.480.651.480.67−0.050.010
Action knowledge PRE0.670.440.760.46−1.110.202
Action knowledge POST0.900.480.820.401.040.190
Effectiveness knowledge PRE6.401.166.721.09−1.580.287
Effectiveness knowledge POST7.001.186.941.410.2420.044
Knowledge (aggregate) PRE8.141.898.731.73−1.7960.327
Knowledge (aggregate) POST9.381.949.252.100.370.067
Concern PRE4.110.543.860.702.28 *0.415
Concern POST4.270.503.950.742.67 *0.512
Self-efficacy PRE3.580.693.350.691.830.334
Self-efficacy POST3.710.723.480.751.700.310
Willingness to act PRE3.940.623.370.764.55 **0.829
Willingness to act POST3.980.633.510.634.05 **0.737
Note: * p < 0.05; ** p < 0.001.
Table 7. Elementary (ES) and secondary school (SS) differences.
Table 7. Elementary (ES) and secondary school (SS) differences.
VariablesMESSDESMSSSDSStCohen’s d
System knowledge PRE1.040.571.340.67−2.65 *−0.495
System knowledge POST1.470.681.500.62−0.216−0.040
Action knowledge PRE0.660.450.780.44−1.525−0.284
Action knowledge POST0.870.430.870.47−0.0010.000
Effectiveness knowledge PRE6.421.156.731.11−1.492−0.278
Effectiveness knowledge POST6.911.157.081.48−0.708−0.132
Knowledge (aggregate) PRE8.121.838.861.78−2.208 *−0.411
Knowledge (aggregate) POST9.251.939.452.15−0.522−0.097
Concern PRE3.970.544.060.75−0.824−0.154
Concern POST4.180.504.050.810.9170.191
Self-efficacy PRE3.520.693.420.720.7290.136
Self-efficacy POST3.680.713.490.771.3780.25
Willingness to act PRE3.750.703.600.791.1410.213
Willingness to act POST3.820.653.710.700.9130.170
Note: * p < 0.05
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kolenatý, M.; Kroufek, R.; Činčera, J. What Triggers Climate Action: The Impact of a Climate Change Education Program on Students’ Climate Literacy and Their Willingness to Act. Sustainability 2022, 14, 10365. https://doi.org/10.3390/su141610365

AMA Style

Kolenatý M, Kroufek R, Činčera J. What Triggers Climate Action: The Impact of a Climate Change Education Program on Students’ Climate Literacy and Their Willingness to Act. Sustainability. 2022; 14(16):10365. https://doi.org/10.3390/su141610365

Chicago/Turabian Style

Kolenatý, Miloslav, Roman Kroufek, and Jan Činčera. 2022. "What Triggers Climate Action: The Impact of a Climate Change Education Program on Students’ Climate Literacy and Their Willingness to Act" Sustainability 14, no. 16: 10365. https://doi.org/10.3390/su141610365

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop