Next Article in Journal
The Impact of Compressing MBA Courses on Student Satisfaction: Empirical Results
Previous Article in Journal
Rx to Lead—Examining Pharm.D. Leadership Development Commencing during Pharmacy School through Co-Curricular Engagement
Previous Article in Special Issue
Analysis of Digital Teacher Education: Key Aspects for Bridging the Digital Divide and Improving the Teaching–Learning Process
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Examining the Science Design Skills Competency among Science Preservice Teachers in the Post-COVID-19 Pandemic Period

by
Tafirenyika Mafugu
School of Education, Durban University of Technology, Durban 4001, South Africa
Educ. Sci. 2024, 14(4), 387; https://doi.org/10.3390/educsci14040387
Submission received: 14 December 2023 / Revised: 29 January 2024 / Accepted: 4 February 2024 / Published: 7 April 2024
(This article belongs to the Special Issue Challenges and Experiences in Science Teacher Training)

Abstract

:
The study aimed to investigate the competencies of 42 preservice science teachers from a rural university in crafting scientific investigations while utilising the constructivist learning theory as its theoretical foundation. Employing an explanatory sequential design, the research initially collected quantitative data through a pre-test, followed by an intervention in the experimental group, succeeded by a post-test phase. In order to enrich the quantitative findings, qualitative data in the form of student responses were analysed, offering a more comprehensive understanding of the preservice teachers’ proficiency in experimental design. Within the control group, no statistically significant variance emerged between the pre-test and post-test rankings, Z = −1.3, p = 0.190. In contrast, the experimental group exhibited noteworthy divergence. The Wilcoxon signed-rank test unveiled a substantial upsurge in post-test rankings when juxtaposed with the pre-test standings, Z = −4, p < 0.001. The qualitative data revealed that preservice teachers manifested a lack of familiarity with comprehension of the variables, strategies for ensuring investigation validity and reliability, and a coherent approach to gauging intervention impact. Emphasising the significance of these revelations, the study suggests plausible pathways for addressing these knowledge gaps via collaborative interventions, thus striving to effectively bridge the identified disparities.

1. Introduction

The onset of the COVID-19 pandemic brought many challenges in the development of scientific competencies and skills. Most scientific skills need hands on experience in order for the skills to develop effectively. However, due to the onset of the COVID-19 pandemic, students at higher institutions were deprived of the need for hands-on exposure due to the need for social distancing that was imposed to limit the spread of COVID-19. A lack of hands-on experience could have an impact on the natural and applied sciences, which are rapidly growing occupational sectors in many countries, including the United Kingdom [1]. Hands-on practical activities are essential, as they assist in developing critical thinking skills that assist in effectively solving the multifaceted problems encountered in life [2]. Immediate solutions are often required for the problems we face, making it necessary to equip science students with scientific process skills that set them apart [3]. Hence, there is a need to compensate for losses in practical skills incurred during the COVID-19 pandemic. Science process skills encompass various abilities, such as equipment handling, observation, measurement, data collection, prediction, and hypothesis testing [4]. These skills play a vital role in developing problem-solving, critical thinking, and communication skills, which are highly valued in the future job market [5]. Possessing such skills empowers students to find solutions, interpret information, and effectively communicate their findings, all of which are key drivers of global economies [5,6]. Moreover, students proficient in science process skills contribute to generating new knowledge that is crucial for solving societal issues [5].
Engaging students in experiments to develop their scientific skills not only motivates them but also allows for first-hand experience and a deeper understanding of scientific phenomena [7]. Such experiences facilitate long-term retention of information, ensuring that learning becomes more permanent. The science curriculum has the responsibility of fostering science process skills to enhance scientific literacy among students [8,9]. These skills aid students in logical thinking and questioning.
Science process skills are fundamental in cultivating problem-solving abilities through the observation and practice of scientific phenomena [10,11]. Teachers play a crucial role in nurturing these skills among learners, making it essential for science preservice teachers to acquire the necessary scientific skills during their studies. Teachers have a significant impact on imparting scientific and problem-solving skills to students at an early stage, contributing to their social and cognitive development. Well-equipped teachers with developed science process skills are able to design appropriate investigations, even in under-resourced schools, to promote the development of these skills in students. It is essential to establish the foundation of problem-solving skills at an early age [11], as it positively impacts all areas of development, particularly the social and cognitive aspects, in children. When individuals acquire advanced problem-solving skills from a young age, they adapt more easily to society and their environment. The acquisition of such skills may have been hindered by the COVID-19 pandemic, which forced a shift to emergency remote teaching and disrupted laboratory practices worldwide. The shift to mandatory online teaching and learning posed a significant challenge for pre-service teachers, as it limited their ability to develop crucial skills through hands-on activities. It underscored the importance of digital literacy among pre-service teachers. There was a need for training and support in using various digital tools and platforms effectively. While hands-on activities were limited, pre-service teachers had to get creative with virtual alternatives. They had to share some innovative solutions and tools they used to provide interactive learning experiences, such as virtual labs, simulations, or collaborative online projects. However, the extent to which they developed resilience, flexibility, and innovative solutions to enable them to acquire crucial scientific skills is not clear. Online learning might have prevented preservice teachers from acquiring essential skills [12]. Limited information is available on students who were taught online regarding their proficiency in science process skills and whether they differ from students taught in traditional settings [13,14].
Stylinski et al. [15] underscores the fact that science skill assessment remains a significantly underutilised practice within the realm of science projects. In their literature review study, it became evident that merely a handful of respondents from the questionnaire and interview sessions, as well as a limited number of submitted articles, showcased any evidence of incorporating science skill assessment for learners. Furthermore, Burgess et al. [16] similarly identified sporadic instances of science skill assessment efforts. Moreover, the study conducted by Phillips et al. [17] indicated that the measurement of science inquiry skills ranked as the least commonly undertaken evaluation.
Multiple frameworks have been established to outline the essential competencies that higher education students should cultivate [18]. These competencies are presented in Table 1.

1.1. The Impact of Activities Based on Science Process Skills on the Development of Problem-Solving Skills

In a study conducted by Gültekin and Altun [6], it was found that activities focusing on science process skills significantly contributed to the development of problem-solving abilities. Their experimental group, which received various science process skills activities, demonstrated notable improvement compared to the control group, which did not receive such intervention. Furthermore, Artun et al. [22] emphasise the importance of science activities that are enriched with virtual reality technology, as it enables access to unobservable or dangerous phenomena. Virtual reality technology holds great potential in facilitating the acquisition of science process skills among secondary school learners and pre-service science teachers [23].
Several studies indicate that blended learning and experiment-based learning significantly improve critical and creative thinking [24]. Experiment-based learning offers numerous advantages, as highlighted by Ummah et al. [25]. These advantages include the enhancement of students’ abilities. Experiment-based learning, for instance, provides students with opportunities to showcase their higher cognitive abilities. By engaging in experimental activities that require critical thinking and problem-solving, students can demonstrate their full potential through inquiry-based approaches, whereby students actively seek solutions by asking questions. Furthermore, Ummah et al. [25] highlight that experimental activities serve as a powerful motivator for students. By connecting classroom learning to real-life situations, it creates a sense of purpose and relevance, thereby increasing student engagement and enthusiasm. Additionally, Coyne et al. [26] assert that involving experimental activities in learning accommodates the needs of students with varying skills and learning styles. It provides a flexible and adaptable learning environment that can be customised to meet the unique requirements of each student, promoting inclusivity and personalised learning experiences [26]. Moreover, it facilitates the design of plans and promotes the ability to articulate and explain the main questions of a project. This allows learners to shape their learning experiences [27]. Furthermore, experimental-based learning has additional strengths, which include enhancing critical thinking and problem-solving skills, developing personal communication skills, promoting information and media literacy, enabling teamwork and leadership abilities, encouraging creativity, and fostering innovation [27]. The outcomes of experimental-based learning implementation demonstrate that students who engage in such experiments exhibit improved collaboration, creative thinking, patience, and willingness to support and explain concepts to one another [28]. Anazifa and Djukri [29] suggest that experimental-based learning has a positive impact on students’ creativity, as it involves the process of sensing, observing problems, generating hypotheses, testing them, and delivering results. It is emphasised that the understanding of the learning process and the interconnection between learning and creativity play a crucial role in enhancing creativity. Rahardjanto and Fauzi [30] assert that project activities encourage students to apply their creativity to solving real-world problems and leveraging their knowledge and skills to produce unique and innovative outcomes. Overall, studies support the idea that experimental-based learning offers a valuable framework for promoting active learning, critical thinking, collaboration, and creativity among students. By engaging in project-based activities, students have the opportunity to develop essential skills and to apply their knowledge in practical and meaningful ways. Experimental-based learning offers an alternative approach to cultivating essential scientific skills. Students could be tasked with at-home experiments, allowing for skill development even outside the traditional classroom. Nevertheless, the viability of this method for honing experimental design skills is somewhat uncertain. This is because it often necessitates specialised equipment and chemicals—resources that are not readily available in a typical home setting.
The study is grounded in the social constructivist theory, which perceives learning as an active process of constructing scientific knowledge through the social interaction between learners and their science teachers [31]. In this study, knowledge construction occurs through interactions among teachers, students, and the learning environment, including various learning platforms. As the learning process unfolds, assessment plays a pivotal role in evaluating the effectiveness of pedagogical strategies in science and gauging students’ comprehension of the scientific content [32]. The feedback and interactions stemming from individual assessment activities facilitate the overall science learning process. Pedagogical instruction and assessment as underscored by Ghaica [33] are interdependent processes that are crucial for imparting scientific knowledge and providing support. Continuous assessment that encompasses both formative and summative approaches can furnish valuable feedback for identifying students who may be at risk by monitoring progress, adjusting pedagogical practices, and granting certification [33]. Moreover, assessment aids lecturers in reflecting upon their teaching methods, fostering student–lecturer discussions, and devising strategies to enhance teaching, learning, and academic achievement. As highlighted by Jimaa [34], it is worth noting that the choice of assessment methods significantly influences the learning process itself; learners tend to tailor their study approach based on the assessment requirements.

1.2. Study Context

The research was conducted at a rural university where the implementation of online learning was solely prompted by the emergence of the COVID-19 pandemic. Virtual laboratories had not been used to impart science process skills within the rural institution. Teachers were not familiar with the virtual laboratories, and the institution did not subscribe to any virtual laboratories because all experiments that were conducted before the pandemic were conducted through hands-on activities. The failure to make a transition to virtual laboratories could have significantly affected the acquisition of science process skills by the students, most of whom who came from underprivileged communities. The study specifically centres around fourth-year science methodology students who were introduced to scientific concepts and science process skills during the pandemic. These students should eventually possess a comprehensive understanding of all science process skills, and the science methodology lecturers are responsible for imparting science pedagogical skills to them.
The onset of the COVID-19 pandemic presented unprecedented challenges to the development of science process skills. With face-to-face lessons suspended to minimise the spread of the virus, the traditional practical activities conducted in laboratories, which are essential for skill development, were no longer available. This absence of hands-on learning might have had a significant impact on the development of science process skills, which can lead to various challenges in the learning process. To address these challenges, this study aimed to investigate the development of science process design skills and proposed an intervention strategy. By focusing on students who were particularly affected by the shift to virtual learning, the study sought to provide practical recommendations to educators and practitioners on how to help these students catch up with their peers in terms of skill development. In conclusion, the disruption caused by the pandemic necessitated a deeper understanding of the impact on science education, especially regarding the acquisition of crucial science process skills. Through this research, we hoped to offer valuable insights and guidance to educators that might ensure that students can continue to develop these essential skills despite the challenges posed by virtual learning. The study sought to answer the following research question:
What are the preservice science teachers’ experimental design competencies in the post-COVID-19 pandemic period?

2. Research Methodology

2.1. Objectives and Hypothesis of the Study

The study aimed to determine the impact of an intervention on preservice teachers’ experimental design competencies in the post-COVID-19 pandemic period.
Hypothesis 1.
The mean ranks for the pre-test scores for the control and experimental groups are not statistically significantly different.
Hypothesis 2.
The mean ranks for the post-test scores for the control and experimental groups are not statistically significantly different.

2.2. Research Design and Participant Selection

The study followed an explanatory sequential design where quantitative data were collected from a sample of 42 preservice science teachers from a single institution situated in South Africa. There were 24 (57%) females, all of whom were in the age group of 22 to 27 years, and 18 (43%) males in the age group of 23 to 29 years. The majority (80%) of the participants were in the age group of 23 to 25 years. The participants were divided into two groups: an experimental group and a control group, each comprising 21 members. The participants were allocated to these groups through a random assignment process. Random numbers were generated within the required range and assigned to the respective control and experimental groups by utilising a random number generator (Figure 1).

2.3. Data Collection Instruments

The two groups of students were given a pre-test where they had to answer the following question individually in 30 min in the Blackboard learning management system:
Birds and humans have similar pancreas tissues, with the same cell types contributing to exocrine and endocrine roles. Growth hormone (GH) is a peptide hormone that stimulates cell reproduction and regeneration in humans and other animals. It is produced during development to increase bone size and density.
GH can also be used in farming to enhance yields from different animals.
Design an experiment to investigate the following hypothesis:
“Varying the concentration of GH injected affects the yield of meat from farmed chickens.”
The responses were marked using the memorandum in Appendix A. An expert in the field was then given the responses to moderate the work. Following this assessment, an intervention was exclusively conducted for the experimental group. This intervention revolved around collaborative group assignments and was promptly succeeded by comprehensive classroom discussions.
The assignments encompassed three distinct tasks:
  • Formulate an experimental protocol to examine the impact of altitude variations on the quantity of red blood cells.
  • Devise an investigative approach to determine the concentration of an unidentified sample of reducing sugar.
  • Construct a comprehensive investigation to ascertain the correlation between temperature fluctuations and enzyme activity.
In the final investigation, students were equipped with essential materials such as water, potatoes, cork borers, test tubes accompanied by delivery tubes, hydrogen peroxide, and a water bath complete with a thermostat for precise temperature control. The materials were used to determine the effect of temperature on the activity of the enzyme peroxidase, which breaks down hydrogen peroxide into water and oxygen. In groups of five students each, the groups had to devise their own methodology. They demonstrated their methodology to the class, and the demonstrations were followed by class discussions. The discussions were conducted in weekly sessions of 1.5 h each over a period of three weeks. After three weeks, the post-test was administered. The post-test was similar to the pre-test question but was slightly modified. The post-test question is presented in Appendix B. The control group was then given the same treatment for the experimental group after the post-test to ensure that they were not disadvantaged. All the data collection process and investigations were carried out during extra time and not during normal class time.

2.4. Quantitative Data Analysis

The quantitative data were analysed using IBM SPSS Statistics version 29, with a significance level set at 5%. For the final pre-test marks, the Shapiro–Wilk test was performed to determine whether the data were normally distributed. This was carried out to determine the type of test to use in the comparison. Subsequent to the Shapiro–Wilk test, the results were analysed using the non-parametric equivalence of the independent sample t-test, the Mann–Whitney U test, to assess the baseline proficiency of both cohorts in the realm of experimental design processes. The non-parametric test was used since the data were not normally distributed, as was revealed by the Shapiro–Wilk test. The post-test results were compared with the pre-test results using the Wilcoxon test. The results are presented in tables and texts.

2.5. Qualitative Data Analysis

The qualitative data in the form of the answers presented by each student were collected and analysed thematically to diagnose the specific deficiencies of the answers provided by various students. The qualitative data generated from the students’ answers were analysed manually using thematic analysis where themes were generated from the existing data (inductive). Coding and recoding were completed several times using the data from students’ responses until the researcher came up with the final codes. Three themes emerged from the student’s responses: lack of awareness regarding variables, lack of knowledge on how to ensure validity and reliability in the design, and failure to indicate the method and instrument to measure the impact. Trustworthiness in the qualitative data was ensured by analysing all responses provided until data saturation was reached, determined as being when no new themes emerged from the data set.

3. Results

Both quantitative and qualitative data are presented in this section.

3.1. Pre-Test SPSS Output Comparing the Control and Experimental Groups

The first section presents the pre-test data comparing the scores for the experimental and control groups. This section involved tested the following hypotheses:
Hypothesis 1.
The pre-test scores for the control group are normally distributed.
Hypothesis 2.
The pre-test scores for the experimental group are normally distributed.
Hypothesis 3.
The post-test scores for the control group are normally distributed.
Hypothesis 4.
The post-test scores for the experimental group are normally distributed.
The Shapiro–Wilk test was carried out to assist in determining whether the data were normally distributed. This stage is important, as it helps determine whether to use parametric or non-parametric tests. All Shapiro–Wilk test values were below 0.05, indicating that the data did not follow a normal distribution (Table 2). Therefore, the non-parametric Mann–Whitney and Wilcoxon tests were used in the comparisons.

3.2. Pre-Test Results for the Control and Experimental Group

The Mann–Whitney U Test was used to compare the mean (mean ranks) score for the control and the experimental group to determine whether the initial conditions for the two groups were the same. It was anticipated that the initial conditions would need to be almost the same to enable one to determine the impact of the intervention in the experimental group.
The pre-test scores for the experimental group were higher than the pre-test scores for the control group (Table 3).
From these data, it can be concluded that the mean scores for the control group and the experimental group were not statistically significantly different (U = 153, p = 0.074) (Table 4).

3.3. The Pre- and Post-Test SPSS Outputs Comparing the Pre-Test and Post-Test Scores for Both the Experimental Group and the Control Group

In this section, the pre- and post-test results for both the control and the experimental group were compared. This was done to determine whether the intervention had any impact on the experimental group. Table 5 shows the mean and standard deviation of the scores.
In the control group, three post-test scores showed a decrease compared to the corresponding pre-test scores, whereas six post-test scores exhibited an increase (Table 6). The remaining 12 post-test scores in the control group remained unchanged from the pre-test scores. Conversely, in the experimental group, only 1 post-test score was lower than the pre-test score, with a notable 20 post-test scores displaying an improvement over the pre-test scores.
In the control group, there was no statistically significant difference observed between the pre-test and post-test ranks, as evidenced by the Z score of −1.3 and p-value of 0.190 (Table 7). Conversely, within the experimental group, the Wilcoxon signed-rank test revealed a significant increase in post-test ranks compared to pre-test ranks, with a Z score of −4.01 and a p-value of < 0.001.

4. Qualitative Data (Pre-Intervention)

This section presents the qualitative data to enrich the quantitative data that were collected. The data were collected through the analysis of the answers provided by students to identify the specific issues with which the learners needed more assistance. The data from all students were analysed manually using thematic analysis, with themes generated from the existing data (inductive) and data saturation reached when there were no new themes emerging from the data. Representative answers for students were selected purposefully by choosing representative answers that best represented the theme under consideration.
  • Theme 1: Lack of Awareness Regarding Variables
In various scenarios, the absence of awareness concerning pertinent variables was observed in various responses provided by the participants. The lack of understanding of the independent and controlled variables was reflected in the responses provided by some participants. One participant presented the following responses to the question:
Participant ST1 incorrectly stated time as the independent variable and GH concentration as the controlled variable, clearly indicating a lack of awareness regarding variables (Figure 2). The lack of knowledge of the variables was also evident in the response provided by ST2 (Figure 3) in the following response to the question:
In addition to the lack of independent and controlled variables reflected in STI, ST2 also failed to identify the dependent variable (Figure 3). The student identified “concentration” as the dependent variable instead of “yield of chicken.”

5. Lack of Validity and Reliability in the Design

The lack of knowledge on how to ensure validity and reliability in the investigation was reflected in the above responses from ST1 and ST2. The participants were unable to list all controlled variables that were to be considered in the investigation. Furthermore, the issue of ensuring reliability was not mentioned at all. The student failed to indicate the need to use more than one chicken for each concentration of growth hormone and to determine the change by finding the average weight for the number of chickens in each group. This lack of knowledge was further seen in the response given by ST3 (Figure 4):

6. Failure to Indicate the Method and Instrument to Measure the Impact

The responses given by ST1, ST2, and ST3 also reflected the ignorance of the criteria to measure the impact on the concentration of the growth hormone. Although STI indicated that chickens with higher concentrations of growth hormone would grow faster, they did not indicate how the growth was to be measured in the investigation. Additionally, ST4 indicated that the measurement would be completed but did not mention the need to measure the growth at certain time intervals (Figure 5). Participant ST4 did not justify the need to slaughter the chickens and measure the weight eventually, or that the measurement would initially be taken in live chickens.

7. Qualitative Data (Post-Intervention)

A great improvement was observed in the responses given by the students in the experimental group three weeks after the intervention. The control group’s response remained substandard after three weeks. Most of the issues that were lacking in the responses provided before the intervention were eliminated by the gain of knowledge during the intervention process. This improvement was evident in the responses given by ST2 after the intervention (Figure 6):
A similar trend of improved understanding of concepts was also observed in the responses of ST4 after intervention (Figure 7). The responses from participant preservice teacher ST4 indicate a clear understanding of variables, issues of validity and reliability, and the need to measure weight. However, it was not necessary to kill the animal before measurement since all other measurements were taken using the live animal.

8. Discussion

In various scenarios, the absence of awareness concerning pertinent variables can lead to significant challenges. When students lack understanding about the variables at play, it becomes difficult to make informed decisions or devise effective design strategies. Unawareness of variables can have adverse consequences across diverse domains. For instance, overlooking key variables in scientific research can undermine the validity of experimental results and hinder the progress of knowledge. To address this issue, it is crucial to emphasise a thorough analysis of the different variables in different experimental designs. By diligently identifying and assessing relevant variables in the different experimental designs and engaging students in group designs and class discussions, one can achieve a clearer understanding of the different variables to consider in the experimental design. In summary, recognising the pivotal role that variables play in any experimental design is essential. By actively seeking out, understanding, and incorporating these variables in design processes, students can enhance their overall effectiveness in the experimental design process. Valls-Bautista et al. [35] and Garcıa-Carmona et al. [36] also found that students had shortcomings in identifying variables and in planning the complete development of a guided scientific inquiry.
The study reflected that students lacked knowledge of how to ensure validity and reliability when planning practical investigations. They lacked understanding of the need to keep other variables constant to ensure that the dependent variable is only affected by one variable at a time. This had the impact of hindering their ability to plan and design investigations in under-resourced rural environments, where most of them are often deployed after completing their studies. The study findings indicate inadequate knowledge of variables and issues of validity and reliability and concur with the findings of Ozer and Sarıbaş [37], which indicated that preservice teachers had an inadequate understanding of inquiry in some aspects, even after the treatment.
However, engaging students in collaborative hands-on activities and group work was observed to greatly improve the post-test scores of the experimental group, whereas the pre-and post-test scores of the control group were not significantly different. This significant improvement was also observed in the post-test answers presented by students. In Burke et al.’s [38] study, preservice teachers placed more importance on “collaboration with fellow teachers” and “student collaborative in science learning.” The importance of collaboration seems to be confirmed in this study. Additionally, this study’s findings are in line with the findings in Yustina et al.’s [24], and Valls-Bautista et al.’s [35] studies, which indicate that intervention strategies improve students’ inquiry-based skills. However, Ozer and Sarıbaş [37] indicate that intervention strategies only improve some of the students’ inquiry-based skills, especially if the intervention is administered over a short period of time. For greater skill development, several interventions need to be implemented. The existing literature highlights that the understanding of scientific inquiry (SI) and science practices (SPs) does not seamlessly transition into practical teaching methods [39,40]. This underscores the need for a comprehensive understanding of these elements throughout teacher training. Achieving this understanding could be facilitated through explicit inquiry-based instructional activities and active involvement in pedagogical inquiry pursuits [27,41], which were hindered during the COVID-19 pandemic. In the study by Burke et al. [38], both pre- and post-service teachers ranked investigation-based science through hands-on activities as being among the most critical topics for professional development in preservice teachers, as they could assist them to develop skills they could use in their classrooms.
Although this study had the strength of using both quantitative and qualitative data, the results were limited to only one institution with a small sample size of 42 students. It only focused on assessing the design skills. Future studies need to focus on multiple science skills in international studies with large sample sizes to yield more generalisable results.

9. Implications of the Study

The study underscores the presence of knowledge gaps in science process skills that have arisen due to reduced engagement in hands-on inquiry-based activities—a consequence of the COVID-19 pandemic. This research also emphasises the urgency of developing diverse interventions tailored to address this issue across all impacted student cohorts, spanning both tertiary and high school levels. Importantly, the study proposes potential avenues for mitigating these knowledge gaps through collaborative interventions, thereby aiming to bridge the identified disparities.

Funding

The research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the University of the Free State (UFS-HSD2021/0351/22).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The author declares no conflicts of interest.

Appendix A. Memorandum

  • Independent variable: concentration of growth hormone/reject GH/reject hormone (1 mark for the correct independent variable)
  • Dependent variable: mass of chicken/increase in weight/growth of chicken/reject chicken/weight (1 mark for the correct dependent variable)
  • Controlled variables: the amount of food/type of food/day-old chick/same breed/same space/same amount of water/same feeding time/same person to feed/same time of measurement/measurement taken by the same person using the same scale; accept any other reasonable answers (1 mark for any two correct answers, maximum points 3 marks)
  • A reasonable number of chickens injected for each concentration (1 mark) and average weight for the group (1 mark) over a long period/a month or more (1 mark)
  • Good sentence construction and coherence (2 marks)
  • An instrument for measurement mentioned (1 mark)
  • Frequency of measurement (1 mark)
  • Method of hormone administration mentioned (1 mark)
  • Any other reasonable answers

Appendix B. Post-Intervention Question

  • Mammals and humans have similar pancreas tissues, with the same cell types contributing to exocrine and endocrine roles. Growth hormone (GH) is a peptide hormone that stimulates cell reproduction and regeneration in humans and other animals. It is produced during development to increase bone size and density.
  • GH can also be used in farming to enhance yields from different animals.
  • You are provided with 1%, 2%, 3%, 4%, and 5% GH. Design an experiment to investigate the following hypothesis:
“Varying the concentration of GH injected affects the yield of meat from farmed rabbits.”

References

  1. Taylor, A.; Nelson, J.; O’Donnell, S.; Davies, E.; Hillary, J. The Skills Imperative 2035: What Does the Literature Tell Us about Essential Skills Most Needed for Work? Working Paper 1; National Foundation for Educational Research: Slough, UK, 2022. [Google Scholar]
  2. Bertello, A.; Bogers, M.L.; De Bernardi, P. Open innovation in the face of the COVID-19 grand challenge: Insights from the Pan-European hackathon ‘EUvsVirus’. RD Manag. 2022, 52, 178–192. [Google Scholar] [CrossRef]
  3. Cunningham, C.M.; Kelly, G.J. Epistemic practices of engineering for education. Sci. Educ. 2017, 101, 486–505. [Google Scholar] [CrossRef]
  4. Ekici, M.; Erdem, M. Developing science process skills through mobile scientific inquiry. Think. Ski. Creat. 2020, 36, 100658. [Google Scholar] [CrossRef]
  5. Vázquez-Villegas, P.; Mejía-Manzano, L.A.; Sánchez-Rangel, J.C.; Membrillo-Hernández, J. Scientific Method’s Application Contexts for the Development and Evaluation of Research Skills in Higher-Education Learners. Educ. Sci. 2023, 13, 62. [Google Scholar] [CrossRef]
  6. Gültekin, S.B.; Altun, T. Investigating the Impact of Activities Based on Scientific Process Skills on 4th Grade Students’ Problem-Solving Skills. Int. Electron. J. Elem. Educ. 2022, 14, 491–500. [Google Scholar] [CrossRef]
  7. Cai, S.; Liu, C.; Wang, T.; Liu, E.; Liang, J.C. Effects of learning physics using Augmented Reality on students’ self-efficacy and conceptions of learning. Br. J. Educ. Technol. 2021, 52, 235–251. [Google Scholar] [CrossRef]
  8. Dragoş, V.; Mih, V. Scientific literacy in school. Procedia-Soc. Behav. Sci. 2015, 209, 167–172. [Google Scholar] [CrossRef]
  9. Derilo, R.C. Basic and integrated science process skills acquisition and science achievement of seventh-grade learners. Eur. J. Educ. Stud. 2019, 6, 281–294. [Google Scholar]
  10. Karayol, S.; Temel, Z.F. An Examination of 5-Year-Old Children’s Problem-Solving Skills Through Play-Based Activities. Cumhur. Int. J. Educ. 2018, 7, 143–174. [Google Scholar]
  11. Yilmaz, E.; Ozana, U.R.A.L.; Guven, G. The Development and Analysis of Reliability-Validity of Social Problem-Solving Skills Scale for 48-72-Month-old Children. Kastamonu Educ. J. 2018, 26, 641–652. [Google Scholar]
  12. Philpott, M.; O’Reilly, K.; Bermudez, L.; de Morais, H.; Filtz, T.M. Professional Student Education and Training during the COVID-19 Pandemic. Appl. Biosaf. 2022, 27, 144–152. [Google Scholar] [CrossRef] [PubMed]
  13. Fabriz, S.; Mendzheritskaya, J.; Stehle, S. Impact of synchronous and asynchronous settings of online teaching and learning in higher education on students’ learning experience during COVID-19. Front. Psychol. 2021, 12, 4544. [Google Scholar] [CrossRef] [PubMed]
  14. Divjak, B.; Rienties, B.; Iniesto, F.; Vondra, P.; Žižak, M. Flipped classrooms in higher education during the COVID-19 pandemic: Findings and future research recommendations. Int. J. Educ. Technol. High. Educ. 2022, 19, 1–24. [Google Scholar] [CrossRef] [PubMed]
  15. Stylinski, C.D.; Peterman, K.; Phillips, T.; Linhart, J.; Becker-Klein, R. Assessing science inquiry skills of citizen science volunteers: A snapshot of the field. Int. J. Sci. Educ. Part B 2020, 10, 77–92. [Google Scholar] [CrossRef]
  16. Burgess, H.; DeBey, L.; Froehlich, H.; Schmidt, N.; Theobald, E.; Ettinger, A.; Parrish, J. The science of citizen science: Exploring barriers to use as a primary research tool. Biol. Conserv. 2017, 208, 113–120. [Google Scholar] [CrossRef]
  17. Phillips, T.; Porticella, N.; Constas, M.; Bonney, R. A framework for articulating and measuring individual learning outcomes from participation in citizen science. Citiz. Sci. Theory Pract. 2018, 3, 3. [Google Scholar] [CrossRef]
  18. Vieno, K.; Rogers, K.A.; Campbell, N. Broadening the definition of ‘research skills’ to enhance students’ competence across undergraduate and master’s programs. Educ. Sci. 2022, 12, 642. [Google Scholar] [CrossRef]
  19. National Research Council Framework (USA). Available online: https://www.cgcs.org/domain/125 (accessed on 3 July 2023).
  20. United Nations Educational, Scientific, and Cultural Organisation (UNESCO). Available online: https://unesdoc.unesco.org (accessed on 3 July 2023).
  21. Next Generation Science Standards (USA). Available online: https://www.nextgenscience.org/framework-k-12-science-education (accessed on 3 July 2023).
  22. Artun, H.; Durukan, A.; Temur, A. Effects of virtual reality enriched science laboratory activities on pre-service science teachers’ science process skills. Educ. Inf. Technol. 2020, 25, 5477–5498. [Google Scholar] [CrossRef]
  23. Oberdörfer, S.; Birnstiel, S.; Latoschik, M.E.; Grafe, S. Mutual benefits: Interdisciplinary education of pre-service teachers and hci students in vr/ar learning environment design. Front. Educ. 2021, 6, 693012. [Google Scholar] [CrossRef]
  24. Yustina, Y.; Syafii, W.; Vebrianto, R. The Effects of Blended Learning and Project-Based Learning on Pre-Service Biology Teachers’ Creative Thinking through Online Learning in the Covid-19 Pandemic. J. Pendidik. IPA Indones. 2020, 9, 408–420. [Google Scholar]
  25. Ummah, S.K.; In’am, A.; Azmi, R.D. Creating Manipulatives: Improving Students’ Creativity through Project-Based Learning. J. Math. Educ. 2019, 10, 93–102. [Google Scholar] [CrossRef]
  26. Coyne, J.; Hollas, T.; Potter, J.P. Jumping in: Redefining teaching and learning in physical education through project-based learning. Strategies 2016, 29, 43–46. [Google Scholar] [CrossRef]
  27. Choi, A.; Seung, E.; Kim, D. Science teachers’ views of argument in scientific inquiry and argument-based science instruction. Res. Sci. Educ. 2019, 51, 251–268. [Google Scholar] [CrossRef]
  28. Tsybulsky, D.; Muchnik-Rozanov, Y. The development of student-teachers’ professional identity while team-teaching science classes using a project-based learning approach: A multi-level analysis. Teach Teach Educ. 2019, 79, 48–59. [Google Scholar] [CrossRef]
  29. Anazifa, R.D.; Djukri, D. Project-based learning and problem-based learning: Are they effective to improve student’s thinking skills? J. Pendidik. IPA Indones. 2017, 6, 346–355. [Google Scholar] [CrossRef]
  30. Rahardjanto, A.; Fauzi, A. Hybrid-PjBL: Learning Outcomes, Creative Thinking Skills, and Learning Motivation of Preservice Teacher. Int. J. Instr. 2019, 12, 179–192. [Google Scholar] [CrossRef]
  31. Kay, D.; Kibble, J. Learning theories 101: Application to everyday teaching and scholarship. Adv. Physiol. Educ. 2016, 40, 17–25. [Google Scholar] [CrossRef] [PubMed]
  32. Murray, A. The role of practical assessment in the delivery of successful enterprise education. Educ. Train. 2019, 61, 413–431. [Google Scholar] [CrossRef]
  33. Ghaicha, A. Theoretical Framework for Educational Assessment: A Synoptic Review. J. Educ. Pract. 2016, 7, 212–231. [Google Scholar]
  34. Jimaa, S. The impact of assessment on students learning. Procedia-Soc. Behav. Sci. 2011, 28, 718–721. [Google Scholar] [CrossRef]
  35. Valls-Bautista, C.; Solé-LLussà, A.; Casanoves, M. Pre-service teachers’ acquisition of scientific knowledge and scientific skills through inquiry-based laboratory activity. High. Educ. Ski. Work-Based Learn. 2021, 11, 1160–1179. [Google Scholar] [CrossRef]
  36. Garcıa-Carmona, A.; Criado, A.M.; Cruz-Guzman, M. Primary pre-service teachers’ skills in planning a guided scientific inquiry. Res. Sci. Educ. 2017, 47, 989–1010. [Google Scholar] [CrossRef]
  37. Ozer, F.; Sarıbaş, D. Exploring Pre-service Science Teachers’ Understanding of Scientific Inquiry and Scientific Practices Through a Laboratory Course. Sci. Educ. 2023, 32, 787–820. [Google Scholar] [CrossRef]
  38. Burke, P.F.; Palmer, T.-A.; Pressick-Kilborn, K. Preferences for Professional Development in Science Among Pre- and In-service Primary Teachers: A Best–Worst Scaling Approach. Res. Sci. Educ. 2022, 52, 1791–1806. [Google Scholar] [CrossRef]
  39. Bjonness, B.; Knain, E. A science teacher’s complex beliefs about nature of scientific inquiry. Nord. Stud. Sci. Educ. 2018, 14, 54–67. [Google Scholar] [CrossRef]
  40. Lederman, J.S.; Lederman, N.G. Teaching and learning nature of scientific knowledge and scientific inquiry: Building capacity through systematic research-based professional development. J. Sci. Teach. Educ. 2019, 30, 737–762. [Google Scholar] [CrossRef]
  41. Cigdemoglu, C.; Koseoglu, F. Improving science teachers’ views about scientific inquiry. Sci. Educ. 2020, 28, 439–469. [Google Scholar] [CrossRef]
Figure 1. Flow diagram of the sampled participants.
Figure 1. Flow diagram of the sampled participants.
Education 14 00387 g001
Figure 2. Reflecting the lack of awareness regarding variables (ST1).
Figure 2. Reflecting the lack of awareness regarding variables (ST1).
Education 14 00387 g002
Figure 3. Reflecting the lack of awareness regarding variables (ST2).
Figure 3. Reflecting the lack of awareness regarding variables (ST2).
Education 14 00387 g003
Figure 4. Lack of knowledge of validity in the design (ST3).
Figure 4. Lack of knowledge of validity in the design (ST3).
Education 14 00387 g004
Figure 5. Failure to indicate the method and instrument to measure the impact (ST4).
Figure 5. Failure to indicate the method and instrument to measure the impact (ST4).
Education 14 00387 g005
Figure 6. Response of ST2 after the intervention.
Figure 6. Response of ST2 after the intervention.
Education 14 00387 g006
Figure 7. Responses of ST4 after the intervention.
Figure 7. Responses of ST4 after the intervention.
Education 14 00387 g007
Table 1. Definition of competencies by national and international organisations (adapted from Vazquez-Villegas et al., [5]).
Table 1. Definition of competencies by national and international organisations (adapted from Vazquez-Villegas et al., [5]).
OrganisationCompetencies
National Research Council Framework (USA) [19]Asking questions and defining problems
Developing and using models
Planning and carrying out investigations
Analysing and interpreting data
Using mathematics
Computational thinking
Constructing explanations
Designing solutions
Engaging in arguments from evidence
Obtaining, evaluating, and communicating
Information
United Nations Educational, Scientific, and Cultural Organisation (UNESCO)
[20]
Cognitive
Information processing (data interpretation and analysis)
Problem-solving
Engineering thinking
Scientific investigation
Computational thinking
Design thinking, creativity, and innovation
Next Generation Science Standards (USA)
[21]
Asking questions and defining problems
Developing and using models
Planning and carrying out investigations
Analysing and interpreting data using mathematical and computational thinking
Constructing explanations and designing solutions
Engaging in arguments using evidence
Obtaining, evaluating, and communicating
Information
Table 2. Shapiro–Wilk test for normality results.
Table 2. Shapiro–Wilk test for normality results.
StatisticdfSig.
Pre-test control group0.844200.004
Pre-test experimental group0.76720<0.001
Post-test control group0.836200.003
Post-test experimental group0.878200.017
Table 3. Mann–Whitney U-test mean and sum of ranks.
Table 3. Mann–Whitney U-test mean and sum of ranks.
GroupingsnMean RankSum of Ranks
Marks obtainedPre-test control group2118.31384.50
Pre-test experimental group2124.69518.50
Total42
Table 4. Mann–Whitney U-test statistics comparing pre-test results for the control and experimental groups.
Table 4. Mann–Whitney U-test statistics comparing pre-test results for the control and experimental groups.
Marks Obtained in the Pre-Test
Mann–Whitney U153.500
Wilcoxon W384.500
Z−1.787
Asymp. Sig. (2-tailed)0.074
Table 5. Descriptive statistics for the pre-tests and post-tests for the control and experimental groups.
Table 5. Descriptive statistics for the pre-tests and post-tests for the control and experimental groups.
nMeanStd. DeviationMinimumMaximum
Pre-test control group211.810.9280.003.00
Pre-test experimental group212.290.7840.003.00
Post-test control group212.100.9951.005.00
Post-test experimental group216.521.4702.009.00
Std. = standard.
Table 6. Mean and sum of ranks for Wilcoxon signed-rank test.
Table 6. Mean and sum of ranks for Wilcoxon signed-rank test.
nMean RankSum of Ranks
Post-test—pre-test control groupsNegative ranks3 a4.0012.00
Positive ranks6 b5.5033.00
Ties12 c
Total21
Post-test—pre-test experimental groupsNegative ranks1 d1.001.00
Positive ranks20 e11.50230.00
Ties0 f
Total21
a Post-test control < pre-test control. b Post-test control > pre-test control. c Post-test control = pre-test control. d Post-test experimental < pre-test experimental. e Post-test experimental > pre-test experimental. f Post-test experimental = pre-test experimental.
Table 7. Test statistics for the Wilcoxon signed-rank tests.
Table 7. Test statistics for the Wilcoxon signed-rank tests.
Post-Test Control Group—Pre-Test Control GroupPost-Test Experimental Group—Pre-Test Experimental Group
Z−1.310 b−4.012 b
Asymp. Sig. (2-tailed)0.190<0.001
b Based on negative ranks.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mafugu, T. Examining the Science Design Skills Competency among Science Preservice Teachers in the Post-COVID-19 Pandemic Period. Educ. Sci. 2024, 14, 387. https://doi.org/10.3390/educsci14040387

AMA Style

Mafugu T. Examining the Science Design Skills Competency among Science Preservice Teachers in the Post-COVID-19 Pandemic Period. Education Sciences. 2024; 14(4):387. https://doi.org/10.3390/educsci14040387

Chicago/Turabian Style

Mafugu, Tafirenyika. 2024. "Examining the Science Design Skills Competency among Science Preservice Teachers in the Post-COVID-19 Pandemic Period" Education Sciences 14, no. 4: 387. https://doi.org/10.3390/educsci14040387

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop