Next Article in Journal
Correlation of Two Biodegradability Indices of PLA-Based Polymers under Thermophilic Aerobic Laboratory Conditions
Next Article in Special Issue
Learning in Citizen Science: The Effects of Different Participation Opportunities on Students’ Knowledge and Attitudes
Previous Article in Journal
The Interplay of Migrant Workers’ Working Hours, Income, and Well-Being in China
Previous Article in Special Issue
Citizen Science and The University of Queensland Seismograph Stations (UQSS)—A Study of Seismic T Waves in S-W Pacific Ocean
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Concept Paper

The Role of Citizen Science in Promoting Ocean and Water Literacy in School Communities: The ProBleu Methodology

1
Earthwatch Europe, Oxford OX2 7DE, UK
2
Faculty of Social Sciences, Arts and Humanities, Kaunas University of Technology, 44249 Kaunas, Lithuania
3
INOVA + Innovation Services, 4450-309 Matosinhos, Portugal
4
Plymouth Marine Laboratory, Plymouth PL1 3DH, UK
5
EMBIMOS Group, Institute of Marine Sciences—Spanish Research Council (ICM-CSIC), 08003 Barcelona, Spain
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(14), 11410; https://doi.org/10.3390/su151411410
Submission received: 2 June 2023 / Revised: 13 July 2023 / Accepted: 18 July 2023 / Published: 23 July 2023
(This article belongs to the Special Issue Citizen Science and Its Role in Education for Sustainable Development)

Abstract

:
Human activities continue to degrade oceanic, coastal and inland waters. The generational change in the role of society in actively looking after the health of water resources can be achieved through the expansion of ocean and water literacy in schools. The Network of European Blue Schools established under the EU4Ocean Coalition for Ocean Literacy has improved ocean and water literacy; however, this Network needs to grow and be supported. Here, we present ProBleu, a recently funded EU project that will expand and support the Network, partly through the use of citizen science. The core of the proposed methodology is facilitating school activities related to ocean and water literacy through funding calls to sustain and enrich current school activities, and kick-start and support new activities. The outcomes of the project are anticipated to have widespread and long-term impacts across society, and oceanic, coastal and inland water environments.

1. Introduction

Worldwide, progress in reaching a good environmental status in inland and marine waters is slow. For example, the 2020 targets of the European Union (EU) (in the Marine Strategy Framework Directive [1] and the Water Framework Directive [2]) have not been met. Oceanic, coastal and inland waters continue to degrade due to human activities, including unsustainable exploitation of resources, chemical and plastic pollution and destruction of habitats. In the EU, half of the coastal and freshwater habitats are assessed as threatened (in the categories critically endangered, endangered and vulnerable) according to the European Red List of Habitats [3].
Several United Nations’ Sustainable Development Goals (SDGs) aim to reverse this scenario: SDG6, clean water and sanitation, aims to protect and restore ecosystems, prevent and eliminate pollution and make the blue economy circular; SDG14, life below water, aims to conserve and sustainably use the oceans, seas and marine resources, and the education aims of SDG4, quality education, target oceanic, coastal and inland waters. However, the SDGs are insufficient, and the world is not on track to achieve either SDG6 [4] or SDG14 [5].
A generational change in the role of society in actively looking after the health of water resources is needed: a change that allows to achieve national and global environmental policy agendas, and the SDGs. A significant part of this change is in the environmental education needed to foster broad societal responsibility towards oceans and waters [6] and to achieve related policy change [7].
One way to make this change and address the urgent question: “Why are we not making progress on environmental crises, particularly on restoring aquatic ecosystems and biodiversity?” is to expand ocean and water literacy in schools, cutting across cultural and socio-economical barriers.
Ocean-literate individuals understand fundamental concepts about ocean functioning, can meaningfully discuss ocean issues and can make informed and responsible decisions regarding the ocean and its resources [8]. Current ocean literacy frameworks primarily focus on educational programs for children and youth in formal school settings. However, additional guidance is needed to address the needs of all socio-demographics, across developed and developing countries and in marine and landlocked regions [9].
The Network of European Blue Schools (the Network) [10], established under the EU4Ocean Coalition for Ocean Literacy [11], has improved ocean and water literacy: as of May 2022, 150 schools and teachers committed to bringing the ocean into classrooms. However, this Network needs to grow and be supported.
ProBleu is a 2023–2026 EU project that will expand and support the Network. The ProBleu-CS methodology—partly based on the use of citizen science—is designed to attract a wide diversity of new members, improve ocean and water literacy across school communities and contribute to the SDGs; in particular, to protect marine and freshwater ecosystems and biodiversity, and to prevent and eliminate pollution.
The vision behind ProBleu-CS is the achievement of societal stewardship of a healthy and sustainable aquatic environment by improving water and ocean literacy from a young age, and its mission is to make a paradigm shift—starting from children and youth in primary and secondary schools—to improve policies on the management of oceans and waters. Implementing green and blue agendas to sustain and enhance the health and biodiversity of oceans and inland waters currently encounters resistance from various actors [12]. Today’s children and youth are the decision makers of tomorrow, and their understanding and appreciation of the environment will pave the way towards its long-term sustainable and resilient future [13].
ProBleu-CS helps make the protection of oceans and waters an integral part of education and promote the understanding of the close connection between humans and environments among children and youth. ProBleu-CS helps promote and grow the Network, increasing the positive impact of ocean and water education by providing interactions with scientists and research centres across a range of scientific disciplines which underpin the understanding of sustainable and equitable exploitation of ocean and water resources.
ProBleu-CS includes a pool of innovative, practical resources based on methodologies of open schooling (the combination of online and place-based activities) [14]. These resources will be complemented by stimulating the connection between people and the places where they live. Besides several actions to promote, encourage participation in and increase the diversity of the Network, one resource, currently lacking from the majority of school curricula, is explored in ProBleu-CS: what is collectively known as ‘citizen science’, defined as work undertaken by educators together with communities to advance science, foster a broad scientific mentality or encourage democratic engagement, which allows society to rationally deal with complex modern problems [15]. Collecting and analysing data through citizen science [16] ensures that student activities directly contribute to fostering their ocean and water literacy. By fostering relationships between the school communities and their local waters, ProBleu-CS assists schools in developing project activities related to the SDGs, particularly SDG6 and 14. Most importantly, ProBleu-CS supports and helps grow the Network and aims to achieve four objectives (OBJs).
Firstly, OBJ1: to mobilise and engage students and school communities, in relation to SDG6 and 14. ProBleu-CS helps mobilise and engage children, youth, teachers and school communities in implementing SDG6 and 14. Encouraging open schooling, ProBleu-CS also helps engage parents, carers, professionals from enterprises and civil society to increase ocean and water literacy, and to implement SDG6 and 14 through environmental education projects and other activities, including citizen science activities, such as the use of FreshWater Watch kits to monitor water quality [17]. The key performance indicators are: the number of schools, students and educators using ProBleu-CS resources.
Secondly, OBJ2: to improve the understanding of and enhance the sense of stewardship towards the value and challenges of oceans and waters among children, youth and teachers. ProBleu-CS supports schools in developing and implementing innovative projects through shared teaching and learning methods, such as challenge-based learning, design thinking and science shops, to improve the understanding of oceans and waters. The key performance indicators are: assessment of improved understanding through standardised interviews (following the methods proposed by Young et al., for example [18], with children, youth and teachers across countries and teaching backgrounds), evaluation of enhanced sense of stewardship through standardised surveys (using local languages) with children, youth and teachers in participating schools, uptake of practical teaching aids (schools performing local environmental observations) and the number of school projects using challenge-based learning, design thinking or science shops.
Thirdly, OBJ3: to grow the Network of European Blue Schools, bringing ocean and water literacy into the classroom. ProBleu-CS helps ramp-up the accreditation of schools in the Network established under the EU4Ocean Coalition for Ocean Literacy, and the engagement in their related activities—including citizen science activities—based on methodologies of open schooling. The key performance indicators are: growth of the Network of European Blue Schools, the number of calls for student and school projects, projects funded and the development of the Network through twinned applications.
Finally, OBJ4: to mobilise and engage the broader community with the Network of European Blue Schools activities, and communicate the results of actions towards SDG6 and 14, sustaining the Network’s growth. ProBleu-CS helps engage the broader community with the activities of the Network through targeted dissemination and communication actions, increasing awareness and further expanding the Network. The key performance indicators are: catalogue of new teaching materials (courses, websites, multimedia items and text documents), following the FAIR principles [19], shared by their creators, and diversity and inclusivity measured through geographic coverage, languages and functional diversity (teaching material and activities accessible to any kind of special need), supported by ProBleu-CS.

2. Proposed Research

The ProBleu-CS methodology is constructed as a pipeline (Figure 1) which guides schools through the process of designing and running a Blue School project. Support offered to schools through the pipeline includes funding calls, adaptation of existing education resources and (co-)development of new tools (including citizen science tools).

2.1. Funding Calls

The core of the ProBleu-CS methodology is facilitating school activities related to ocean and water literacy. This facilitation is mainly achieved through funding calls to sustain and enrich current school activities, and kick-start and support new activities. The core support provided by ProBleu-CS is the facilitation of youth and school mobilisation and engagement, and of ocean and water literacy activities with clearly defined goals and focused on concrete actions and projects. The interplay between public and private funding and management has been shown to promote quality research, combining new general knowledge with societal relevance [20]. Funding is awarded based on the following:
  • The needs and aims of individual projects.
  • The potential to be shared across the educational sector.
  • Environmental themes and issues addressed.
  • Types of participation involved.
  • The innovation potential of the impacts across society.
Grant categories and conditions for participation capture the full range of related school activities, recognise their achievements across several domains (society, science, economy, governance, environment) and consider the potential impact on all types of target groups involved.

2.2. Adaptation of Resources

Another level of support provided by ProBleu-CS is the adaptation of existing educational methods and resources—including those related to citizen science—to support, strengthen and sustain school activities. School activities are supported by adapting and utilising existing tools and materials, developed through previous school projects and activities [21], and through AI large language models such as LaMDA or GPT [22]. Best-practice guidance ensures that school activities maximise their potential in bridging the gap between scientific research and children’s ocean literacy, and at the same time, inspire the co-creation of ideas within the Network.
The scientific underpinning and the sharing of the scientific experience in teaching materials add relevance to the curriculum, help draw new schools and educators to join the Network and provide wider avenues for Network promotion, considering their significance to the global environmental agenda. Information sharing is a two-way process, capturing feedback from school actors on the benefits of and improvements from the guidance provided, allowing the gathering of information about factors that support or hinder the sustainability of school activities. This process also helps reduce the chances of project failure, ensures sustainability so that the funding processes receive a strong return on investment and opens avenues for continued investment, building on the outcomes of applying the methodology. Considerations across the areas of impact, education, inclusivity, responsible research and innovation (RRI), policy, interoperability and societal measures are included, as learning from existing methodologies (e.g., EU-Citizen.Science, ECS and Science-with-and-for-Society project results, citizen observatories, communities of practice, bio- and water-blitzes, SDG monitoring), with tools and resources available in a range of formats (including school policy briefs, training and educational resources, videos and interviews, open-source software and equipment repositories). This information will always be shared openly and widely.

2.3. Development of Tools

A further level of support is the creation of tools—including citizen science tools—to facilitate the sustained growth of the Network of European Blue Schools. ProBleu-CS aims to pave the way for ensuring the long-term sustainability of school activities and accreditations. The methodology helps to develop a detailed exploitation model for educational results and will link it to the UNESCO Ocean Literacy Portal [23], the EU-Citizen.Science platform [24] and the European Open-Science Cloud (EOSC) portal [25]. To achieve long-lasting change, the ProBleu-CS methodology supports schools to create a plan to maintain the changes made beyond their first Blue School activities; otherwise, ocean and water literacy is likely to start decreasing. Once schools have achieved their initial ocean and water literacy goals, they will retain access to the tools used to continue their learning journey and to renew their accreditation in the Network. Within an open-science setting, ProBleu-CS helps liaise with existing, related projects worldwide that may benefit from timely exchanges of environmental education methodologies, literacy data, behaviour-change approaches and evaluation data, immediately as they become available. Finally, ProBleu-CS helps establish a reciprocal relationship among ocean and water literacy support systems worldwide, especially in Europe, the US and Australia, where these systems are well-developed in the context of citizen science (see ECSA [26], CSA [27] and ACSA [28]).

2.4. Key Methodological Processes

To recognise, invest in and support school activities in fully realising their potential to bridge the gap between science and society, five key methodological processes—detailed below and summarized in Figure 1—are essential to achieving success.
(i) Supporting open schooling and innovative teaching and learning methods, such as challenge-based learning, design thinking and science shops. ProBleu-CS allows to analyse how science-based open schooling affects the target groups’ ocean literacy and engagement in ocean and water issues, their interest in pursuing a related career and whether socio-geographical aspects of their school influence this. Additionally, ProBleu-CS supports using student-centred and practice-oriented teaching/learning methods, as follows. The challenge-based learning methodology applies a multidisciplinary approach which encourages students to develop a deeper understanding of real-world problems, work in teams and use creativity to reach the solution, for it to be based on their prior knowledge and be innovative at the same time [29]. Similarly, the design thinking methodology employs a student-centred and practice-oriented approach by encouraging students’ out-of-the-box thinking, creativity, brainstorming of innovative ideas and creation of prototypes [30]. Science shops ensure closer cooperation between scientists and students by introducing experimentation and real-life problem-solving. These methods effectively engage students in practice-oriented learning, encouraging curiosity, critical thinking and creativity, while increasing learning motivation. Previous research shows that challenge-based learning is highly effective in secondary schools, helping students most at risk of dropping out [31].
(ii) Adopting a user-centred approach, incorporating co-design principles when appropriate. Key to implementing ProBleu-CS is developing funding criteria and support tools applicable and representative of the broad range of school initiatives and the issues they address. The risk of failure in this respect would be maintaining a status quo of insufficient support for ocean and water literacy, resulting in a lack of school engagement in the discipline. Without the proper support, school projects and activities would ultimately become unsustainable over the long term. ProBleu-CS includes a user-centred approach to prevent this, incorporating the relevant end-users at all stages of the recognition, investment and support activities. Resources and methodologies are co-designed, where possible, with the involvement of various target groups, as students who participate in co-design may show better learning or increased agency or engagement [32]. For instance, tools and best-practice guidance are developed with teachers who have already benefited from the Network of European Blue Schools accreditation.
(iii) Putting ethics and inclusivity at the heart of every activity and process. Educational activities have long had an issue in terms of becoming truly inclusive, with existing programmes often offering only an illusion of support for all students. This forms a significant barrier when attempting to realise the full potential of environmental education in bridging the gap between science and society [33]. To ensure ProBleu-CS activities are inclusive in terms of geography, gender, ethnicity, functional diversity, age and socio-economic situation, an external, independent ethics advisor is appointed. Additional guidance is followed, such as that provided by the COST Action CA15212 [34] regarding inclusiveness and diversity, by projects such as DITOs (funded within the Horizon 2020 programme) and through an ‘inclusive citizen science’ practice, which encourages engagement from all members of society, whatever their social status, sociocultural origin, gender, religious affiliation, literacy level or age [35]. Funding criteria recognise projects that address inclusivity, with tools and best-practice guidance available to provide evidence. More broadly, ProBleu-CS includes ethical, transparent practices across all activities and funding reviewers enlisted from beyond the geographical scope of deployment to reduce the chance of bias and a clash of interest, with a broad representation of ethnicity, gender and expertise. Ethical, legal, socio-economic, cultural and gender considerations—concerning transparency, privacy and data protection, and the involvement of minors and vulnerable populations—are also addressed in the methodology.
(iv) Ensuring the involvement of all target groups throughout all activities. The following target groups are involved throughout the ProBleu-CS methodology to ensure the success of the recognition, investment and support mechanisms.
  • Primary school children, secondary school youth, teachers, school administration and the Network of European Blue Schools. Children, youth and teachers are the lifeblood of school projects. Different school actors can be applicants for funding, as the coordinators of student- or school-led initiatives.
  • Wider school community, including parents, NGOs and other social partners. The wider school community involvement takes several forms. As well as being a target of extended actions to improve ocean and water literacy, it is engaged as a potential sponsor of events, helping to communicate activities as widely as possible. Social partners are also part of the user-centred design process, helping to ensure that support tools assist environmental education in fully realising its potential to bridge the gap between science and society. Some social partners can further engage participants with learning outside the school environment (e.g., educational activities in aquaria).
  • Academia. Not only are academics involved as part of a user-centred design approach, but existing networks (e.g., EU-Citizen.Science, ECS, ECSA, MICS, current and past Science-with-and-for-Society projects) are also used to communicate activities and disseminate outputs and results.
  • Policymakers. A key aim of ProBleu-CS is to implement innovative systems to support environmental education. Policymakers are critical in ensuring that future research-and-innovation systems learn from applying ProBleu-CS and that societal impacts from environmental education actions are fully realised.
  • Journalists and media, including scientific and educational publications. Journalists are key in widely communicating the funding opportunities related to ProBleu-CS and enhancing the recognition of successful practices through publicising the best school projects.
  • Large-scale initiatives and programmes. To ensure sustained growth of the Network, as well as project sustainability, large-scale initiatives and programmes with potential partners for school projects and activities—including, for example, The European Marine Science Educators Association (EMSEA)—are a key target group.
(v) Establishing a learning, ocean-literate community, ensuring best practices and knowledge are fully shared. Due to the broad types of environmental education covered, and the large number of projects supported through ProBleu-CS actions, there is a risk that project support and communication will become inefficient. To prevent this, the help and guidance offered by ProBleu-CS are designed not only to be top-down, but also peer-to-peer in nature. A learning community is formed in participating schools through community events, resources and guidance, allowing existing and new projects to learn from each other. The culmination of these communities is to contribute to the packaged outputs of ProBleu-CS, which are disseminated widely and openly and used to inform future research-and-innovation approaches.

3. Anticipated Results

The ProBleu-CS methodology is related to four expected outcomes and other broader impacts through the pathways, expected results and key performance indicators (KPIs) described in Table 1.
Beyond the engagement increase caused by the direct investment in kick-starting and sustaining environmental education activities, the implementation of ProBleu-CS will also have a long-term impact. Through the activities, tools and guidance supplied, supported schools can develop sustainable engagement strategies by diversifying their methods of teaching/learning and participation in scientific activities, and realising their societal impact beyond the initial school projects’ scope. A dedicated methodology task helps evaluate behavioural change regarding engagement and public trust. This change refers to the behaviour of grantees, participants and citizens involved in activities oriented to the broader community.
A vital element of the ProBleu-CS methodology is to support environmental education in realising its potential to bridge the gap between science and society. In doing this, environmental education activities, through the resources provided, help address societal needs, expectations and values. The knowledge gathered during this process can be used to create policy recommendations and guidance for specific interested parties and actors to inform future research and education strategies.
Through the grants made available for kick-starting and sustaining environmental-education projects, in parallel with the tools and resources made public, the educational value of understanding the importance of oceans and waters is realised and increased. The longer-term impact will be an increased understanding of the scientific method and its processes by the citizens involved in activities foreseen in ProBleu-CS. The ProBleu-CS user-centred methodology also helps increase this understanding by involving all interested parties and actors, including citizens, in the design and implementation process.
The citizen science facets of the ProBleu-CS methodology already complement an open-science approach. Therefore, the actions included in ProBleu-CS related to kick-starting, sustaining and recognising environmental education activities and the resulting knowledge learnt can only increase the research-and-innovation system in its capacity to conduct open science. The resources provided include guidance on co-design and co-creation processes and data-sharing practices, to further increase the synergy between environmental education and open science.
The inclusivity at the core of the ProBleu-CS methodology helps ensure special consideration is given to ethnicity, gender, geography, functional diversity, age and socio-economic background. Eligibility criteria reward school project activities with coherent pathways for achieving inclusivity. The benefits and barriers of the pathways taken are reported back to interested parties and actors via policy briefs and reports, informing future research-and-innovation systems towards an open and inclusive structure.

4. Discussion

4.1. Impact

The ProBleu-CS methodology is anticipated to achieve scientific, economic, technological and societal impacts.

4.1.1. Scientific Impacts

One critical expected impact to be achieved through ProBleu-CS results is the direct and indirect improvement of inland and marine waters. The ProBleu-CS methodology helps assess ocean and water literacy. The methodology is available for all interested parties and actors in an open-access format. In addition, by assessing the change in ocean and water literacy and in the understanding of the value of oceans and waters, ProBleu-CS helps generate scientific knowledge on: (1) ocean and water literacy at primary and secondary school education levels and (2) perceptions of the value of oceans and waters by the youth and teachers. ProBleu-CS helps generate qualitative data from interviews (interviewing five different target groups: children in primary education, youth in secondary education, teachers, school administrations and the wider community (e.g., parents)) and quantitative data from surveys, which are published in open-access repositories (such as Zenodo) and freely available for other scholars and other interested individuals for secondary use and analysis. The team, using ProBleu-CS, analyses the empirical data generated and can develop publications discussing the impact of the intervention of ProBleu-CS on the learning outcomes and changing perceptions of the oceans and waters. The data generated also allow cross-cultural comparative analysis, especially if the geographical coverage is significant.

4.1.2. Economic and Technological Impacts

Another critical expected impact to be achieved is that disadvantaged schools are facilitated to join the Network thanks to ProBleu-CS resources. Additionally, ProBleu-CS helps improve the local blue economy through contributions to SDG6 and 14. Moreover, ProBleu-CS supports innovative student and school projects that can strengthen schools’ economic opportunities and competitive capacity in the education sector. The economic impact of ProBleu-CS is then indirect. For example, a better understanding of ocean and water value, and accessibility to new educational resources, allow schools to improve their learning programs, which may lead to economic and financial benefits for schools by attracting more students and more experienced personnel. Participating teachers can gain new competencies regarding teaching methods and will be more competitive in the labour market, and ProBleu-CS offers new technological solutions for environmental education by developing a platform for educational resources.

4.1.3. Societal Impacts

ProBleu-CS helps increase ocean and water literacy in the population, with individuals and communities behaving more responsibly towards aquatic environments. ProBleu-CS also helps enhance the sense of responsibility among the youth and teachers towards oceans and waters by engaging schools in student-centred, practice-oriented innovative learning and teaching processes. By developing student and school projects, schools can facilitate addressing local environmental issues; thus, ProBleu-CS contributes to bridging the gap between science and society by enhancing the understanding among the youth, teachers and broader school communities of the importance of building scientific knowledge through experimentation and practice-orientated learning. ProBleu-CS activities also contribute to the achievement of SDGs. Schools include low-cost observation kits, which are popular in citizen science projects, in their teaching. Citizen science has been touted as a methodology that can address the SDGs. It has contributed to several SDG indicators, potentially addressing many more [37]. Still, a significant barrier exists due to the lack of expertise of educators to realise this connection, and a lack of sustainable funding to consider the longer-term impact. Through more suitable funding systems, coupled with the tools and resources provided to help support gaps in expertise, ProBleu-CS supports school activities in fully realising their potential to contribute to the SDG framework. Finally, ProBleu-CS helps address the policy priorities in research and innovation by accelerating the cooperation between science and society. The methodology will also include policy recommendations and guidance for specific interested parties and actors, in order to inform future research and education strategies.

4.2. Scale and Significance

To approximate the scale and significance of the proposed methodology, the expected uses of ProBleu-CS resources are as follows:
  • At least 400 schools, 30,000 students and 1300 educators mobilised to use ProBleu-CS resources.
  • At least 300 projects using challenge-based learning, design thinking or science shops.
  • Catalogue of new co-created teaching materials, such as courses, websites, multimedia items and text documents, shared by at least 300 creators.
  • At least 10% of teaching material and activities accessible to any kind of special need.
The funding for school projects to be provided in a typical deployment of ProBleu-CS is EUR 750,000, and this would achieve impacts as follow:
  • Financing of at least 100 projects.
  • At least 300 twinned applications submitted.
  • Documentation of the management, reviewing, monitoring, reporting and marketing processes of funding calls publicly available.

4.3. Requirements and Potential Barriers

ProBleu-CS builds on previous knowledge from education networks and projects supported by the European Commission’s FP6 (Science and Society), FP7 (Science in Society) and Horizon 2020 (Science with and for Society) programmes. This knowledge includes the successes and limitations discovered (i.e., obstacles, barriers and potential threats). In providing tools and best-practice resources regarding engagement, training, data quality and interoperability to support associated school activities, ProBleu considers requirements and potential barriers across neutrality, equitability and transparency, scale, unfair advantages, languages, functional diversity and sustainability.

4.3.1. Neutrality

School projects are required to make efforts to ensure their diversity and consider broader societal impacts, enlarging the focus from ocean and water issues approached using ‘in-the-field’ participatory models to covering a multitude of related domains, including health, chemistry, meteorology and biology, supported through a range of types of participation, including ‘live’, in situ observations, remote sensing observations and ubiquitous data collection of behaviour and health through apps and digital technology. ProBleu-CS aims to be neutral across all types of school activity regarding the eligibility criteria for funding, and the support tools and resources provided. To assist in this goal, an advisory board representing a wide range of disciplines and expertise is required to guide the methodology and help prevent bias toward a particular field or method.

4.3.2. Equitability and Transparency

Many education projects, networks and platforms have already taken shape and established themselves. Networks such as the European Citizen Science Association and its associated conference, platforms such as EU-Citizen.Science, EU COST Actions and various supporting projects and tools have created a close-knit community to engage schools. Whilst such a community has apparent advantages in communication, dissemination and exploitation of knowledge and learning, it carries a risk of bias, conflict of interest and transparency when selecting grantees for the funded activities through peer review [38]. The risk of bias increases when the reviewer pool is relatively small and closely connected. To mitigate this potential issue, in recruiting advisory board members, ProBleu-CS recommends reaching out to networks and communities beyond the geographical scope of deployment, thus reducing the chances of a connection with applicants.
This approach will further contribute to the long-term goal of establishing a reciprocal relationship with other ocean and water literacy support systems beyond the geographical scope of deployment. In doing this, a broader network of knowledge and expertise can be established, with research-and-innovation systems and support resources able to draw on the experiences of other geographical areas with unique and different societal issues.

4.3.3. Scale

To scale activities, ProBleu-CS recommends organising a dissemination campaign inviting teachers to share the learning scenarios and activities prepared, to enhance the catalogue of ProBleu-CS teaching materials on ocean and water literacy (target: >500 teachers participating, reaching over 6000 pupils).

4.3.4. Unfair Advantages

ProBleu-CS has the potential to raise standards in science education, which ironically risks further divergence of beneficiary schools from underprivileged communities that may be less likely to engage. To ensure that funding effectively removes barriers, allowing educators and schools from all backgrounds to benefit from funded efforts to engage with SDG6 and 14, ProBleu-CS aims to account for the socio-economic factors of schools engaging with the methodology, so that funds can be equitably distributed where they are likely to be most impactful. This criterion does not preclude schools with more financial freedom from engaging, and emphasis is placed on co-creating high-quality resources (which are subsequently shared), as well as more direct engagement mechanisms, such as twinning schools in different areas or from diverse backgrounds.

4.3.5. Languages

Language is a potentially difficult barrier when reaching schools using a variety of languages different from English. ProBleu-CS recommends having a dedicated budget for technical support to ensure diversity and inclusivity in geographic coverage and languages.

4.3.6. Functional Diversity

Functional diversity is always a potential barrier, and ProBleu-CS recommends having a dedicated budget for technical support to ensure that at least 10% of teaching materials and activities are accessible to any kind of special need. For example, material can be produced for children with visual functional diversity, and school project activities could be available (thanks to specific selection criteria) for children with mobility functional diversity.

4.3.7. Sustainability

To ensure sustained growth of the Network and that ProBleu resources and findings are available in the long term, a concrete sustainability plan is required, especially to identify suitable large-scale initiatives and programmes with potential partners for school projects and activities, and to raise awareness of the ProBleu-CS approach.

4.3.8. Limitations to the ProBleu-CS Approach

The previous sections have highlighted a number of issues that historically have related to educational activities and the citizen science methodology. Whilst in response many efforts have been made to tackle issues surrounding inclusion [39], diversity [40], engagement [41], motivation [42], language [43] and stewardship [44], there is still a long way to go to achieve balanced representation in environmental actions. This is especially relevant to the ProBleu-CS approach, in attempting to represent schools and students from over 40 countries across a range of socio-economic, cultural and geographical backgrounds. In an attempt to combat this issue, the ProBleu-CS approach will, through its co-design principles [45], create funding, tools and resources that are relevant and relatable to the communities it is attempting to represent. Likewise, through a user-centred approach, ProBleu-CS will attempt to highlight the links between the Network of European Blue Schools membership, the EU mission: Restore our Ocean and Waters by 2030, and the potential of project actions to empower communities to take action.
However, even with these mitigation factors in place, many previous actions have failed to achieve the representation they aimed for. The ProBleu-CS approach has the same risk, as any number of interventions cannot guarantee the uptake of under-represented audiences. Therefore, the response to ProBleu-CS funding calls, the use of resources and tools and the growth of the Network of European Blue Schools will be closely monitored, in order to iteratively target under-presented groups, regions and countries.

5. Conclusions

Implementing green agendas targeted at sustaining and improving the health and biodiversity of oceans and inland waters currently encounters resistance from various actors. Today’s children and youth are the decision makers of tomorrow, and their understanding and appreciation of the environment will pave the way towards its long-term sustainable and resilient future. However, the challenge lies in ensuring that this understanding and appreciation is representative across different cultural, socio-economical and geographical backgrounds.
ProBleu promotes and grows the Network of European Blue Schools, increasing the positive impact of ocean and water education beyond the classroom by providing interactions with the major science disciplines underpinning the understanding of ocean and water resources. Through a user-centred approach incorporating co-creation principles, resources, tools and methodologies are developed that represent a range of communities and their educational institutions, giving a voice and consideration to all, independent of their cultural, socio-economic or geographical background.

Author Contributions

Conceptualization, L.C. and J.P.; methodology, L.C., S.M.W., E.B. (Eglė Butkevičienė), S.P., J.S., P.C., S.G.H.S., G.L., S.L., B.C., E.B. (Elisabet Bonfill) and J.P.; writing—original draft preparation, L.C.; writing—review and editing, S.M.W., E.B. (Eglė Butkevičienė), S.P., J.S., P.C., S.G.H.S., G.L., S.L., B.C., E.B. (Elisabet Bonfill) and J.P.; supervision, L.C. and J.P.; project administration, L.C. and J.P.; funding acquisition, L.C. and J.P. All authors have read and agreed to the published version of the manuscript.

Funding

ProBleu has received funding from the European Union’s Horizon Europe research and innovation programme under the grant agreement No. 101113001, and from UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee, grant number 10082336.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not yet applicable.

Data Availability Statement

No new data were created.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. European Union. Directive 2008/56/EC of the European Parliament and of the Council of 17 June 2008 establishing a framework for community action in the field of marine environmental policy (Marine Strategy Framework Directive). In Official Journal of the European Union; European Union: Maastricht, The Netherlands, 2008; L 164/19–40. [Google Scholar]
  2. European Union. Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000 establishing a framework for Community action in the field of water policy (Water Framework Directive). In Official Journal of the European Communities; European Union: Maastricht, The Netherlands, 2000; L 327/1–72. [Google Scholar]
  3. European Commission, Directorate-General for Environment; Tsiripidis, I.; Piernik, A.; Janssen, J. European Red List of Habitats Part 2, Terrestrial and Freshwater Habitats; Publications Office of the European Union: Brussels, Belgium, 2017. [Google Scholar] [CrossRef]
  4. UN-Water. 2021: Summary Progress Update 2021—SDG 6—Water and Sanitation for All; UN-Water: Geneva, Switzerland, 2021. [Google Scholar]
  5. Andriamahefazafy, M.; Touron-Gardic, G.; March, A.; Hosch, G.; Palomares, M.L.D.; Failler, P. Sustainable development goal 14: To what degree have we achieved the 2020 targets for our oceans? Ocean. Coast. Manag. 2022, 227, 106273. [Google Scholar] [CrossRef]
  6. Fisman, L. The Effects of Local Learning on Environmental Awareness in Children: An Empirical Investigation. J. Environ. Educ. 2005, 36, 39–50. [Google Scholar] [CrossRef]
  7. Hildén, M. The evolution of climate policies—The role of learning and evaluations. J. Clean. Prod. 2011, 19, 1798–1811. [Google Scholar] [CrossRef]
  8. Wichmann, C.-S.; Fischer, D.; Geiger, S.M.; Honorato-Zimmer, D.; Knickmeier, K.; Kruse, K.; Sundermann, A.; Thiel, M. Promoting pro-environmental behavior through citizen science? A case study with Chilean schoolchildren on marine plastic pollution. Mar. Policy 2022, 141, 105035. [Google Scholar] [CrossRef]
  9. Kelly, R.; Evans, K.; Evans, K.; Alexander, K.; Bettiol, S.; Corney, S.; Cullen-Knox, C.; Cvitanovic, C.; de Salas, K.; Emad, G.R.; et al. Connecting to the oceans: Supporting ocean literacy and public engagement. Rev. Fish Biol. Fish. 2022, 32, 123–143. [Google Scholar] [CrossRef]
  10. European Union. Network of European Blue Schools. Available online: https://maritime-forum.ec.europa.eu/en/frontpage/1485 (accessed on 22 July 2023).
  11. European Union. EU4Ocean Coalition. Available online: https://maritime-forum.ec.europa.eu/en/frontpage/1482 (accessed on 22 July 2023).
  12. Hadjimichael, M. A call for a blue degrowth: Unravelling the European Union’s fisheries and maritime policies. Mar. Policy 2018, 94, 158–164. [Google Scholar] [CrossRef] [Green Version]
  13. Clark, H.; Coll-Seck, A.M.; Banerjee, A.; Peterson, S.; Dalglish, S.L.; Ameratunga, S.; Balabanova, D.; Bhan, M.K.; Bhutta, Z.A.; Borrazzo, J.; et al. A future for the world’s children? A WHO-UNICEF-Lancet Commission. Lancet 2020, 395, 605–658, Erratum in Lancet 2020, 395, 1612. [Google Scholar] [CrossRef] [Green Version]
  14. Gaskell, A. Open Distance Learning. In Encyclopedia of Educational Philosophy and Theory; Peters, M.A., Ed.; Springer: Singapore, 2017. [Google Scholar] [CrossRef]
  15. Ceccaroni, L.; Bowser, A.; Brenton, P. Civic education and citizen science: Definitions, categories, knowledge representation. In Analyzing the Role of Citizen Science in Modern Research; IGI Global: Hershey, PA, USA, 2017; pp. 1–23. [Google Scholar]
  16. Mominó, J.M.; Piera, J.; Jurado, E. Citizen observatories as advanced learning environments. In Analyzing the Role of Citizen Science in Modern Research; IGI Global: Hershey, PA, USA, 2017; pp. 192–212. [Google Scholar]
  17. Available online: https://www.freshwaterwatch.org/ (accessed on 10 July 2023).
  18. Young, J.C.; Rose, D.C.; Mumby, H.S.; Benitez-Capistros, F.; Derrick, C.J.; Finch, T.; Garcia, C.; Home, C.; Marwaha, E.; Morgans, C.; et al. A methodological guide to using and reporting on interviews in conservation science research. Methods Ecol. Evol. 2018, 9, 10–19. [Google Scholar] [CrossRef] [Green Version]
  19. Wilkinson, M.D.; Dumontier, M.; Aalbersberg, I.J.; Appleton, G.; Axton, M.; Baak, A.; Blomberg, N.; Boiten, J.W.; da Silva Santos, L.B.; Bourne, P.E.; et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci. Data 2016, 3, 160018. [Google Scholar] [CrossRef] [Green Version]
  20. Rasmussen, P. Educational research—public responsibility, private funding? Nord. J. Stud. Educ. Policy 2022, 8, 65–74. [Google Scholar] [CrossRef]
  21. Copejans, E.; Besançon, M.; Lourenço, C.; Batista, V.; Soares, S.; Noronha, A.; European Commission. A wave of European Blue Schools. In Handbook for Teachers; European Commission, Directorate-General Maritime Affairs and Fisheries: Brussels, Belgium, 2020; 104p. [Google Scholar]
  22. Su, J.; Yang, W. Unlocking the Power of ChatGPT: A Framework for Applying Generative AI in Education. ECNU Rev. Educ. 2023, 20965311231168423. [Google Scholar] [CrossRef]
  23. Available online: https://oceanliteracy.unesco.org/ (accessed on 10 July 2023).
  24. Available online: https://eu-citizen.science/ (accessed on 10 July 2023).
  25. Available online: https://eosc-portal.eu/ (accessed on 10 July 2023).
  26. Available online: https://www.ecsa.ngo/ (accessed on 10 July 2023).
  27. Available online: https://citizenscience.org/ (accessed on 10 July 2023).
  28. Available online: https://citizenscience.org.au/ (accessed on 10 July 2023).
  29. Pérez-Sánchez, E.O.; Chavarro-Miranda, F.; Riano-Cruz, J.D. Challenge-based learning: A ‘entrepreneurship-oriented’ teaching experience. Manag. Educ. 2023, 37, 119–126. [Google Scholar] [CrossRef]
  30. Foster, M.K. Design Thinking: A Creative Approach to Problem Solving. Manag. Teach. Rev. 2021, 6, 123–140. [Google Scholar] [CrossRef]
  31. Johnson, L.F.; Smith, R.S.; Smythe, J.T.; Varon, R.K. Challenge-Based Learning: An Approach for Our Time; The New Media Consortium: Austin, TX, USA, 2009; Available online: https://www.learntechlib.org/p/182083/ (accessed on 10 July 2023).
  32. Wu, J.; Atit, K.; Ramey, K.E.; Flanagan-Hall, G.A.; Vondracek, M.; Jona, K.; Uttal, D.H. Investigating Students’ Learning through Co-designing with Technology. J. Sci. Educ. Technol. 2021, 30, 529–538. [Google Scholar] [CrossRef]
  33. Wam, H.K.; Goździk, A.; Aspholm, P.E.; Juńczyk, T. Democratizing education: Open schooling engaged the less privileged in environmental sciences. PLoS ONE 2021, 17, e0266655. [Google Scholar] [CrossRef]
  34. Available online: https://www.cost.eu/actions/CA15212/ (accessed on 10 July 2023).
  35. Paleco, C.; García Peter, S.; Salas Seoane, N.; Kaufmann, J.; Argyri, P. Inclusiveness and Diversity in Citizen Science. In The Science of Citizen Science; Springer: Berlin/Heidelberg, Germany, 2020; pp. 261–281. [Google Scholar]
  36. Available online: https://edu-arctic.eu/ (accessed on 10 July 2023).
  37. Fraisl, D.; Campbell, J.; See, L.; Wehn, U.; Wardlaw, J.; Gold, M.; Moorthy, I.; Arias, R.; Piera, J.; Oliver, J.L.; et al. Mapping citizen science contributions to the UN sustainable development goals. Sustain. Sci. 2020, 15, 1735–1751. [Google Scholar] [CrossRef]
  38. Souder, L. The Ethics of Scholarly Peer Review: A Review of the Literature; Learned Publishing: Hoboken, NJ, USA, 2011; Volume 24, pp. 55–72. [Google Scholar]
  39. Parrish, J.K.; Jones, T.; Burgess, H.K.; He, Y.; Fortson, L.; Cavalier, D. Hoping for optimality or designing for inclusion: Persistence, learning, and the social network of citizen science. Proc. Natl. Acad. Sci. USA 2019, 116, 1894–1901. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Pateman, R.M.; Dyke, A.; West, S.E. The Diversity of Participants in Environmental Citizen Science. Citiz. Sci. Theory Pract. 2021, 6, 9, ISSN 2057-4991. [Google Scholar] [CrossRef]
  41. Phillips, T.B.; Ballard, H., L.; Lewenstein, B.V.; Bonney, R. Engagement in science through citizen science: Moving beyond data collection. Sci. Educ. 2019, 103, 665–690. [Google Scholar] [CrossRef]
  42. Rotman, D.; Hammock, J.; Preece, J.; Boston, C.L.; Hansen, D.L.; Bowser, A.; He, Y. Does motivation in citizen science change with time and culture? In Proceedings of the Companion Publication of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, Baltimore, MD, USA, 15–19 February 2014. [Google Scholar]
  43. Pocock, M.J.O.; Roy, H.E.; August, T.; Kuria, A.; Barasa, F.; Bett, J.; Githiru, M.; Kairo, J.; Kimani, J.; Kinuthia, W.; et al. Developing the Global Potential of Citizen Science: Assessing Opportunities That Benefit People, Society and the Environment in East Africa. J. Appl. Ecol. 2019, 56, 274–281. [Google Scholar] [CrossRef] [Green Version]
  44. Toomey, A.; Domroese, M. Can citizen science lead to positive conservation attitudes and behaviors? Hum. Ecol. Rev. 2013, 20, 50–62. [Google Scholar]
  45. Hidalgo, E.S.; Perelló, J.; Becker, F.; Bonhoure, I.; Legris, M.; Cigarini, A. Participation and Co-Creation in Citizen Science; Vohland, K., Land-Zandstra, A., Ceccaroni, L., Lemmens, R., Perelló, J., Ponti, M., Samson, R., Wagenknecht, K., Eds.; The Science of Citizen Science, 199; Springer: Cham, Switzerland, 2021. [Google Scholar] [CrossRef]
Figure 1. ProBleu-CS methodology: (a) A diagram depicting the ProBleu pipeline, the process by which schools are attracted to apply for cascade funding, supported to run Blue School projects (including joining the Network of European Blue Schools) and provided with teaching resources to increase their project’s positive impacts. The pipeline also includes feedback loops based on the evaluation of Blue School projects and dissemination and communication actions to promote the successes of the projects. (b) A timeline for the ProBleu-CS methodology, including the anticipated timing of funding calls.
Figure 1. ProBleu-CS methodology: (a) A diagram depicting the ProBleu pipeline, the process by which schools are attracted to apply for cascade funding, supported to run Blue School projects (including joining the Network of European Blue Schools) and provided with teaching resources to increase their project’s positive impacts. The pipeline also includes feedback loops based on the evaluation of Blue School projects and dissemination and communication actions to promote the successes of the projects. (b) A timeline for the ProBleu-CS methodology, including the anticipated timing of funding calls.
Sustainability 15 11410 g001
Table 1. Anticipated outcomes from the ProBleu-CS methodology.
Table 1. Anticipated outcomes from the ProBleu-CS methodology.
Expected OutcomesExpected ResultsKPIs
ProBleu-CS helps mobilise and engage children, youth, teachers and school communities to implement SDG4, 6 and 14 through innovative environmental education programmes. These programmes increase (1) ocean and water literacy and (2) the understanding of their value. For example, ProBleu-CS helps make the most relevant ocean and freshwater data from biogeochemical models and satellite Earth observation accessible and understandable to the school communities. As a baseline for educators’ engagement, an H2020 project (EDU-ARCTIC) [36] enrolled 1200 teachers in an informal open-schooling course in environmental science.(OBJ1) Increased mobilisation through engagement in environmental education, directly addressing SDG4, 6 and 14.KPI#1: At least 400 schools mobilised to use resources
KPI#2: At least 30,000 students and 1300 educators using ProBleu-CS resources
ProBleu-CS helps mobilise and engage children, youth, teachers and school communities to implement SDG4, 6 and 14 through the funding of student and school projects and generating resources such as recommendations, guidance and best-practice materials. The call for student and school projects helps promote SDG6, 4 and 14, and attract new schools to apply for the Network of European Blue Schools membership. The Network’s growth is also supported by twinned applications (by a school from the Network and those aspiring to become accredited members of the Network), employing a perspective of peer-to-peer learning.(OBJ1) Schools’ engagement in student and school projects, addressing SDG4, 6 and 14. (OBJ3) Growing Network of European Blue Schools.KPI#3: At least four calls for students’ and school projects’ funding
KPI#4: At least 100 projects funded and successfully implemented
KPI#5: The Network of European Blue Schools is ten times the size it was at the beginning of the implementation of the ProBleu methodology
KPI#6: At least 300 twinned applications submitted
ProBleu-CS supports schools to implement SDG6, 14 and 4 and mobilise students, teachers and the broader community by offering innovative educational content and teaching/learning methods, such as challenge-based learning, design thinking, science shops and citizen science. For example, schools can link school projects to the evidence used in the international research community, advising on pollution and biodiversity-loss crises. This link allows participants to address school or student project questions such as, ‘Is our lake water level and quality changing?’, ‘How will subsidence in coastal areas affect my town?’, ‘What happens to the plastic pollution in our river–sea system?’ or ‘Are algal blooms becoming more widespread?’. Barriers to data uptake in the classroom are removed by coupling age-relevant data views to clear teaching and learning goals, including input from scientists and educators to suit their specific needs. (OBJ1) Increased mobilisation through engagement in environmental education, directly addressing SDG6, 14 and 4. (OBJ2) Increased ocean and water literacy among children and youth, teachers and schools. Improved understanding of the value and sense of responsibility towards ocean and waters among the youth and teachers.KPI#7: Number of students and teachers engaged in environmental education programs
KPI#8: Uptake of practical teaching aids by at least 30 schools
KPI#9: Teaching aids from the shared catalogue used by educators at least 300 times
KPI#10: At least 300 projects using challenge-based learning, design thinking or science shops
KPI#11: Assessment of the change in ocean and water literacy in at least 30 schools, by interviews
KPI#12: Assessment of the change in ocean and water value perceptions in at least 300 schools, by surveys
ProBleu-CS helps grow the Network by: (1) engaging schools in activities related to SDG6, 14 and 4 and based on an open-schooling perspective, (2) mobilising a wider community for co-creation and communication of SDG6, 14 and 4, as well as (3) raising awareness about the Network through targeted dissemination and communication actions. Adopting the informal open-schooling methodology developed by the H2020 project EDU-ARCTIC [36] for environmental science, aimed at teachers with teenage pupils, ProBleu-CS helps engage parents, carers, professionals from enterprises and civil society to identify and counter failures to reach the less privileged and to document learning. Finally, to facilitate the engagement in implementing SDG6, 14 and 4, ProBleu-CS will offer the possibility to quantitatively explore complex scientific data, and will generate ready-to-use map figures.(OBJ4) Mobilisation of the broader community through engagement in environmental education, directly addressing SDG6, 14 and 4. Increased diversity and inclusivity. (OBJ3) Growing Network of European Blue Schools. An open platform, hosting all resources generated in the context of ProBleu-CS. Fully accessible documentation of funding calls, marketing and creative materials, which can be adapted and reused by citizen science projects to support future implementation of the methodology.KPI#13: At least four calls for students’ and school projects’ funding
KPI#14: At least 100 projects funded and successfully implemented
KPI#15: The Network of European Blue Schools is ten times the size it was at the beginning of the implementation of the ProBleu methodology
KPI#16: At least 300 twinned applications submitted
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ceccaroni, L.; Woods, S.M.; Butkevičienė, E.; Parkinson, S.; Sprinks, J.; Costa, P.; Simis, S.G.H.; Lessin, G.; Liñán, S.; Companys, B.; et al. The Role of Citizen Science in Promoting Ocean and Water Literacy in School Communities: The ProBleu Methodology. Sustainability 2023, 15, 11410. https://doi.org/10.3390/su151411410

AMA Style

Ceccaroni L, Woods SM, Butkevičienė E, Parkinson S, Sprinks J, Costa P, Simis SGH, Lessin G, Liñán S, Companys B, et al. The Role of Citizen Science in Promoting Ocean and Water Literacy in School Communities: The ProBleu Methodology. Sustainability. 2023; 15(14):11410. https://doi.org/10.3390/su151411410

Chicago/Turabian Style

Ceccaroni, Luigi, Sasha M. Woods, Eglė Butkevičienė, Stephen Parkinson, James Sprinks, Pedro Costa, Stefan G. H. Simis, Gennadi Lessin, Sonia Liñán, Berta Companys, and et al. 2023. "The Role of Citizen Science in Promoting Ocean and Water Literacy in School Communities: The ProBleu Methodology" Sustainability 15, no. 14: 11410. https://doi.org/10.3390/su151411410

APA Style

Ceccaroni, L., Woods, S. M., Butkevičienė, E., Parkinson, S., Sprinks, J., Costa, P., Simis, S. G. H., Lessin, G., Liñán, S., Companys, B., Bonfill, E., & Piera, J. (2023). The Role of Citizen Science in Promoting Ocean and Water Literacy in School Communities: The ProBleu Methodology. Sustainability, 15(14), 11410. https://doi.org/10.3390/su151411410

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop