3.1. Final Ranking of Cities and Students’ Performance in Using the Available Evidence
Regarding the ranking of cities, all groups are hesitant when evaluating their options (feeling uncertain about making a decision), which is common when dealing with SSIs [
38]. However, all groups except H conform to the expected ranking in the reference response. Group H wrongly considers Qarth to be more exposed to pesticides than Sun Lance and King’s Landing as it is closer to farmland (criterion of proximity).
Considering the groups’ performance in integrating evidence into their justifications and formulating causal explanations (
Table 4), all groups except D spend most of their discourses relating causes to effects (codes IV–VII), instead of merely interpreting data and/or detecting patterns (codes I–III). In 16/74 situations, they link a cause to a cellular effect (code VI). Even in 4/74 situations, students manage to connect several causes and effects (code VII). The remaining causal explanations are not considered in the reference response (20/74) (code IV), or do not reach the cellular scale (code V, 13/74). Specifically, the groups with the highest performance are A and H (ratio 0.67), whose discourses are dominated by valid monocausal and multicausal relationships between the data. The lowest performance is that of group I (ratio 0.00), which does not formulate any valid causal explanation to solve the task, followed by group D (ratio 0.20), in which justifications integrating isolated data predominate. The remaining groups show an intermediate level of performance.
Below, to help understand the discourse analysis of each group that has been carried out to determine their levels of performance, the reasoning followed by group F in ranking the cities is detailed. This serves as an example to understand the reasons why groups move from one level of evidence use to another. In addition, similarities and differences with the other groups are discussed. In group F, students start discussing the Facebook news without considering whether it is reliable or whether its content is sufficient to solve the task (no group shows scepticism). This could be because students do not usually doubt the rigour/adequacy of the information provided by teachers or researchers [
40]. Through teamwork, all members eventually establish a link between “pesticide use” (cause) and “meiotic errors” (effect) (U8) (
Table 5). It should be noted that, in addition to group F, only Group A discusses the possible effect of pesticides on meiosis, causing reproductive problems. Gaby (Group C), although not specifying meiosis, mentions a possible mutation from consuming polluted products that prevents species from reproducing. The remaining groups are unable to relate macroscopic consequences to microscopic causes.
When the teacher distributes the report, group F establishes a new causal relationship between “proximity to the pollution source” (cause) and “miscarriages and reproductive problems” (effects, without reaching the cellular level) (U9-12,
Table 6).
Then Archie refutes Elisa by pointing out that the people of Volantis must be the most affected by pesticide exposure (effect) because they are vegans (cause) and ‘
only eat polluted food from farmland, while in the other cities people also eat meat’. This is a relationship not considered in the reference response (code IV). He is ignoring both the table legend (
Figure 3b), which specifies that the inhabitants of Volantis feed on unpolluted vegetables, and the text about their home gardens. Difficulties in considering all available data are common in argumentative environments [
41], in this case, because students do not check all information sources before attempting to solve the task.
After placing Volantis first, Archie (U13) considers the river direction to rank the remaining cities [the closer to the farmland (cause), the more reproductive problems (effect)] (
Table 7). In U15, Archie also introduces the idea of pollutant accumulation, as the river carries pesticides to cities near the estuary. Coraline realises that this idea contradicts the first criterion, highlighting its limitations: if downstream cities are more polluted, Volantis cannot be the first in the ranking. Archie decides to ignore it (U17). This often occurs when students (and even teachers) try to ‘fit’ evidence to their claims, using only the information that supports their hypothesis [
10,
41,
42].
Coraline turns to the report for clarification and, after re-reading that the inhabitants of Volantis are vegan (textual data) and checking their location (visual data), she states that Volantis may not be the population most affected by pesticide use, integrating this information into the discourse (U18,
Table 8). This highlights the relevance of each learner individually examining the available data to correct their own and their peers’ misconceptions or intuitions during the co-construction of arguments. It also shows that the moments of discourse in which data are interpreted and integrated into justifications (codes I-III) are also necessary. In this way, the causal relationships subsequently established between them are more likely to be in line with expectations, thus improving the overall groups’ performance.
When Ms. Irina asks the students which population suffers the greatest consequences (effect) from pesticide pollution, they answer Volantis due to veganism (cause) (
Table 9). She advises them to check the data table in the report (U25), as Archie claims that they have not consulted it. At this point, it is worth noting that teachers hardly intervene during the activity until the final sharing, leaving the working groups free to solve the tasks autonomously. However, scaffolding in this type of situation is essential, using thought-provoking questions to encourage students to reflect and rethink their answers [
27].
At Ms. Irina’s suggestion, students look at the table and change Volantis to Meereen, as it has “
higher numbers in almost everything” (
Table 10). However, after assuming that Volantis is less exposed to pesticides, learners do not understand why it has the highest percentage of miscarriages (U27), and even wonder if it is related to the viable eggs number, as it is also higher (U29-30).
Therefore, students have not realised that miscarriage rates are irrelevant data. No group does, although group C hints at it (example of code II in
Figure 5). Failure to discern relevant data from irrelevant data influences the way the problem is interpreted, and the final conclusion drawn [
43]. In fact, all groups consider miscarriages to be another effect of pesticide use. When some groups (e.g., D, G) use miscarriage rates as a criterion for ranking cities and try to integrate the other evidence into their justifications, contradictions arise. However, unlike the findings of [
41], instead of ignoring the inconsistencies, they overcome the “my-side bias” by addressing the weaknesses of their first position [
44] and looking at the available evidence for another possible cause of miscarriages in Volantis: veganism, which “
leads to a lack of nutrients and defences” (example of code IV in
Figure 5).
In terms of handling and relating new concepts, group F is unable to connect the data on “micronuclei” and “viable eggs”. Although students identify differences and/or patterns among the numbers in the columns (
Figure 3b), they show difficulties in interpreting the table meaning due to a lack of theoretical knowledge. Therefore, to address such activities, it is not enough to deal with discrete concepts, but learners need to connect them in a functional way [
35,
42], which is challenging (U32).
Finally, Archie misunderstands the definition of a sentinel organism and believes that harlequin flies are responsible for the high miscarriage rate in Volantis (code IV): “
The report states that harlequin flies provide early warning of danger to humans. As there are more of these insects dangerous to humans in Volantis because no pesticides are used there (cause),
there are more miscarriages (effect)”. This diminishes the quality of the argument, as aligning data with a proper theoretical framework is essential for sound reasoning [
38].
It is striking that despite having doubts about some data, students do not check all the information. Findings show that they prefer visual and synthesised data (map, table) rather than abstract/technical text (code II predominates over code I in
Table 4). Moreover, when they need to consult the text to interpret numbers and images (code III), they only read some fragments, skipping relevant information. This could be because students seek to make decisions quickly [
23], but considering all available data are essential to truly understand the problem and make a quality decision [
12].
However, some students manage to integrate the newly concepts (e.g., micronuclei, sentinel organism) into their justifications and even explain them to their peers. For instance, when George (Group B) interprets: “
micronuclei open holes in the fly eggs cutting the spermatozoa”, Eve corrects him, sharing her interpretation of the micronuclei definition and relating micronuclei to pesticide pollution (example of code VI in
Figure 5). Therefore, she overcomes the epistemological obstacle posed by such abstract concepts [
43]. Furthermore, when Martha (Group J) says: “
I do not understand about the flies”, Pauline uses a self-generated analogy to clarify it: “
Sentinel organisms are like an earpiece that warns humans of danger”, which is a useful peer facilitation technique during collaborative reasoning [
45]. Hence, students should be encouraged not to use evidence thoughtlessly [
46] and to interrelate data on human, animal, and environmental health, which is one of the main objectives of the activity, within the framework of developing environmental citizenship [
24,
47].
The example above also shows how the codes of group F evolve over time. When compared to the evolution of the codes of the other groups (codelines),
Figure 7 shows that all groups except B, D, and E establish causal relationships between the data provided from the beginning (codes IV–VI). Later in their discourses, they look for other relevant data to rank the cities (codes I–III). This allows the learners to evaluate their previous causal explanations (keeping or discarding them) and to formulate new ones (codes IV–VII).
It is worth noting that some of the intermediate codes are higher than the final ones since in a natural conversation it is not necessary to justify many statements if learners assume that they share knowledge [
38]; but if one needs to convince or refute a peer, it is when more data are related [
44]. Furthermore, although only four groups (A, B, C, G) reach code VII, code VI appears in all groups except I, as it is easier to relate an effect to a cause than to explain multivariate causality, with multiple contributors to the same outcome(s) [
46].
Finally, groups G and I are a good example to show that the level of performance is not determined by the conclusion drawn (ranking of cities), but by the underlying reasoning expressed by the students, as both groups rank cities correctly, but their performances are very different. The discourse of group G is dominated by situations in which students relate data (9/10 codes). Five of them match the reference response (codes VI–VII). At the end of the session, they manage to relate several causes (pesticide use, proximity of cities to farmland, transport of pollutants by river) to the formation of micronuclei in harlequin flies (cellular effect) (code VII). In contrast, group I starts by relating pollution (cause) to the occurrence of malformations or the transmission of viruses (HIV) and parasites (Anisakis) (code IV). After reading the report, they rank the cities based solely on food sources and the percentage of reproductive problems in humans (code III), since learners, for the sake of simplicity, tend to use evidence in isolation rather than linking data [
44].
3.2. Students’ Performance in Proposing Reasoned Solutions
Table 11 shows the solutions proposed by each group. Although they were asked to think about actions to end the toxic risk in Támara, in most situations (28/42), learners focus on decontamination rather than non-recontamination, mainly by proposing unsustainable actions (e.g., importing non-polluted products, decontaminating Támara).
In terms of groups’ performance, only group H proposes more preventive than palliative solutions, showing a better performance (ratio > 0.5). In groups D and G only two solutions are proposed, one of each type (ratio = 0.5). The remaining groups (A, B, C, E, F, I, J) are dominated by solutions aimed at mitigation rather than prevention (ratio < 0.5). Therefore, it seems that students find it easier to reflect on how to restore a situation than on how to ensure that it does not happen again, although the SDG approach calls for educating for the future, thinking about long-term solutions [
8]. Global society has shown a similar attitude during the COVID-19 pandemic, considering vaccination as the main short-term solution. However, it does not prevent the emergence of new pandemics. To achieve this, it would be necessary to avoid the anthropogenic impact on nature that cause them (e.g., deforestation, increased wildlife-human contacts, illegal species trade) [
7]. However, people’s willingness to act tends to decrease if the actions require great personal or social sacrifice [
21].
According to [
48], the opposite is true in media reports, i.e., preventive solutions predominate over palliative ones. They also state that there are more news items that (briefly) expose the consequences of environmental problems than their causes. Hence, it is not surprising that students find it difficult to relate one piece of news to another, seeing them as unconnected, and tend to wait for others (experts) to tell them how to solve problems, rather than coming up with their own ideas.
Other frequent ideas (
Table 11) such as crop relocation or human migration would not solve the problem, but only displace it. Even unrealistic actions are proposed. For instance, group A suggests “
chlorinate the river to remove pesticides… okay, it is impossible”, being aware that it is not plausible. Group J proposes “
throwing pesticides in the rubbish bin instead of the river”, showing a lack of knowledge about pesticides and considering only the direct route of arrival of pollutants in the water. Strikingly, something similar happens when thinking about how plastic waste ends up polluting the sea [
4]. Therefore, a threshold value of content knowledge is also necessary to make a sound argument for the proposed solutions [
9].
In short, although all groups follow the same instructions, they behave differently. This could be due to the scenario they face [
16] and/or to their intellectual baggage (prior knowledge, values, and past experiences) [
23]. In this sense, information on the risk to human health seems to be decisive for most groups (values). Furthermore, some learners propose actions based on their prior knowledge of historical events (Chernobyl disaster). Finally, past experiences do not seem to have influenced the proposed solutions, as students do not relate the problem to their personal lives.
In other studies (e.g., [
9]), the SEE-SEP model is used to determine which aspects students focus on when arguing about SSIs. However, in this study, the model is only considered if students, in addition to proposing solutions to solve the pollution problem, evaluate the impact of their implementation (a non-explicit demand of the activity). In this sense, the groups propose solutions on 42 occasions. The impact of implementing them is only assessed on 11/42 occasions. When doing so, students only apply three perspectives of the SEE-SEP model: economic, environmental, and scientific-health (
Table 12). Specifically, the performance of group E is the highest, considering three perspectives, followed by groups B and H that only apply two. Finally, groups A, C, G, and J only assess the plausibility of solutions from a single perspective. The remaining groups (D, F, I) do not evaluate the consequences of their proposed actions (lowest performance).
Hence, it seems that embracing all perspectives is not easy, and that the ability to “evaluate proposals” is not spontaneous in students’ reasoning. In this regard, [
49] argues that only if students are encouraged to do so is their performance likely to improve. However, in the case of “using evidence when arguing” (a skill related to the first phase of the activity), [
42] found a similar level of performance between groups that were prompted to use all available evidence and those that were not. Therefore, we believe that rather than making the requirement explicit, the key is to train students to deal appropriately with such tasks and teachers to use thought-provoking questions to guide students’ reasoning.
Regarding the scientific-health perspective, Eve (Group B) understands that if a dam is built at Sun Lance (this proposal shows an ignorance of the water cycle), people living upstream would continue to drink unhealthy water. When group G proposes to relocate the affected population to safe areas, they wonder whether this decision could result in the displaced people “infecting” healthy people. This highlights an alternative idea, the confusion between “pesticide exposure” and “microbial infection”. Earlier in the speech, learners argue the following: “If people drink contaminated water, they could become infected with bacteria. This would cause reproductive problems when they urinate because the bacteria would get into their reproductive organs. And if they have sex, they could infect other people”. Again, the proposed solutions and their assessments are conditioned by the failed attempt to align the data provided in the activity with the students’ prior knowledge, in some cases alternative conceptions (e.g., confusion between reproductive and excretory apparatus).
Groups E and J value the positive impact of their proposals on humans’ reproductive health, applying the concept of “sentinel organism” acquired in the first phase of the activity, and linking human health with that of other animals in the same environment (One Health). For instance, Gunter (group E) recommends “
testing different pesticides on flies to see if they affect their reproduction and consequently also that of humans, choosing the least harmful ones”. Moreover, Pauline (group J) suggests “
breeding more flies to know if something is wrong because they die (she misinterprets the information)
before humans”. In both cases, students only consider the flies’ usefulness as an early danger warning, apparently placing less value on their lives than on human lives. This attitude would be far from the emotional reasoning pattern of [
50], characterised by considering the consequences of decisions for other people and species, being responsible for them and desiring their well-being (empathy and sympathy).
Regarding the economic perspective, when Anne (Group A) suggests bringing fish from safe areas, Lucy raises importation as a problem, probably associated with a higher economic cost and/or effort (although not considered, transport would also have an environmental impact, hence the importance of consuming local products). In group C, Gaby also refutes Denisse’s proposal to limit the pesticide use: “If you do not use pesticides, there would be a plague of aphids that would eat everything”. He seems to be concerned about the economic losses that the solution would bring to the region, prioritising economic interests over environmental and human health (the same reflection is raised by groups E and H).
Considering the environmental perspective, Hans (Group B) proposes relocating crops near the estuary to reduce damage, but pollutants dilution in the sea is not the solution [
51]. George agrees with Hans: “
Right, so the water in upstream cities would be pesticide-free”. However, Eve realises that Hans’ proposal would only displace the problem by affecting others: “
If you do that, instead of polluting the river, you pollute the sea. That is fine for you because you eat healthy, but you still pollute”. Alex (Group E) reflects similarly when assessing Gunter’s proposal to move crops to Volantis: “
Although Volantis is not polluted now, if pesticides are used there, it will be”. In group H, when Nico rejects the idea of stop using pesticides because it would lead to the emergence of bugs (“
Nobody wants to eat bugs”), Nelly defends the need for bugs (“
They are natural and must be there”). Nico prioritises his own interests, showing an anthropocentric perspective (nature at the service of humans, to the detriment of the biocentric view), which is a widespread attitude among students [
52].
In summary, the results show that most students simply complete the task, without assessing the consequences of their proposed actions, taking responsibility for them, and understanding that some of them are unreasonable. When they do so, it is mainly to refute the solutions proposed by their peers, applying the scientific-health and economic perspectives, followed by the environmental one. Thus, as with the establishment of relationships between data (first phase of the activity), counter-argumentation could be associated with better student performance in proposing solutions. In fact, counter-argumentation involves applying critical thinking to explore different dimensions of a given issue [
11]. However, neither group assesses the sociological, ethical, or political implications of their actions. These results are consistent with other studies [
9,
17], in which students discuss the use of the hydrogen fuel bus and reject or support a ban on fishing for economic, environmental, and scientific reasons, but rarely for ethical, political, or sociological reasons. Therefore, it seems that not all aspects of the SEE-SEP model are equally relevant for students when making and evaluating decisions. Nevertheless, by the design of the task, it is not considered better for students to focus on one factor or another. The expected outcome is the consideration of multiple perspectives when arguing for the solutions they propose, something that groups B, E, and H achieve (
Table 12).