1. Introduction
For centuries, human beings have wondered about stars and whether different planets exist elsewhere in the universe other than our world. Over the past few decades, several studies were carried out on this subject, and several theories have been put forward explaining the possibility of the existence of such planets [
1]. Thanks to technological advancements over the past few decades, human beings have made significant progress in this field. Current trends in this field are topics such as touristic space travel and exploring new habitats in space [
2,
3]. This study, accordingly, dwelled on the students’ views on space exploration. Touristic space travel and researching new space habitats are hot topics in this field. Therefore, the topic of space exploration was chosen for this study.
The terms STEM, STEAM, or STEMA have come into prominence in recent years because of their integrative solutions for traditional education problems [
4]. STEM is “an educational approach that aims to identify problems with an interdisciplinary approach for students from pre-school to higher education by combining science, technology, engineering, and mathematics, and produce appropriate solutions to these problems” [
5]. STEM highlights a form of research and inquiry-based learning by revealing the sense of curiosity available to individuals [
6]. After the advent of STEM education practices, it was thought that focusing on only four disciplines was not enough to fully meet the needs of students, and additions were made to expand the scope of STEM education [
7,
8,
9]. Thus, the concept of “STEAM” emerged by adding “arts” to STEM disciplines [
10].
STEAM is an acronym that combines the original STEM term with art, allowing educators to broaden the benefits of hands-on learning and cooperation in a variety of ways while still stimulating creativity and curiosity. The distinction between STEM and STEAM is in their approaches to scientific concepts. The STEM approach emphasizes using rigorous scientific, technological, mathematical, or engineering skills to advance or create new ideas, whereas the STEAM approach to learning guides student conversation, inquiry, and critical thinking through the use of “Science, Technology, Engineering, Arts, and Mathematics” as access points [
11,
12,
13]. STEAM allows the inclusion of art-based and creative curriculum elements to enhance learning and bring real life into the classroom. This may include writing and telling stories, poetry, role-playing, and the use of design in addition to solutions, values/ethical discussions, etc. The biggest difference between STEAM and STEM is that STEAM lays out the basic aspects of the technology to create models and prototypes before building/deconstructing (engineering). All of these concepts are defined in John Dewey’s 20th-century philosophy of education [
14]. Bringing arts and mathematics into a more practical form by combining them facilitates the learning of students, especially those with low academic achievement [
15,
16]. One of the objectives of STEAM education is to motivate students about science, scientific developments, and scientific technologies by encouraging them to be self-starters and self-sustainers. In the STEAM framework, subjects are taught with an interdisciplinary approach to develop students’ creativity and problem-solving skills [
17,
18,
19]. To achieve this goal, STEAM contributes to teaching STEM disciplines, and arts in an interdisciplinary way, to students’ understanding of scientific developments, and to improving their scientific literacy levels [
20,
21]. The most important concept in this approach is to relate course subjects to real-world examples. In this manner, science, technology, engineering, mathematics, and arts should be integrated into daily life as much as possible. The more relevant the subjects and problems students face related to the world around them in the course, the more likely they are to be motivated [
22]. STEAM education is student-centered and inquiry-based and covers concepts such as project preparation, design, and innovation-oriented studies.
STEAM education contributes to the problem-solving skills and development of creative thinking skills of students [
23]. Some studies involving middle school students [
21] found that the mathematics-oriented STEAM education applied to students improved their interest in math class and had a negative-attitude-reducing effect. According to other studies [
17,
18], pupils’ academic achievements in science classes have improved as a result of STEAM exercises implemented in middle school classes. The STEAM approach is not only beneficial for the development of students but also for teachers.
In this study, a learning module refers to an organized collection of learning activities designed to help students to comprehend the learning objectives systematically. Activities in the STEAM-based space-themed learning module were developed by the researchers based on the education curriculum defined by the Ministry of National Education. The purpose of the study was to explore the effectiveness of a STEAM-based space-themed learning module in science education taught to primary school students. Specifically, the following research questions were investigated in this study:
- (1)
Are the post-test scores of students who participated in the STEAM-based space-themed learning module different from those of students who did not participate in the module?
- (2)
Does the effectiveness of the module differ by gender?
- (3)
Does the effectiveness of the module have any correlation with the level of academic success?
2. Materials and Methods
2.1. Sample
The sample of the study consisted of 274 secondary school students who continued their education in the 6th and 7th grades in the Central Anatolia Region in Turkiye (see
Table 1). The study’s experimental group was formed with 180 students. The control group consisted of 94 students. Participants were randomly selected among 544 students who volunteered to participate in the study. In this research, the student’s cognitive structure and conceptual change model about design thinking were also evaluated. The design-oriented thinking process discussed within the scope of the research was evaluated following the processes described by Hasso Plattner [
24].
2.2. Ethical Considerations
Permission was obtained from the Ethics Committee of the University before conducting the study. Written consent forms were obtained from the families. All students were informed about the purpose of the study and confidentiality of the data was ensured. They were also assured of their right to terminate participation at any time.
2.3. STEAM-Based Learning Module
While developing the module, we aimed to provide students with 21st-century skills. In the module, museum visits, environmental awareness activities, science exhibitions, and workshops were organized for the participant students. Afterward, a virtual space visit was arranged for the students with the help of information technology to uncover the solar system’s mysteries. Furthermore, it was aimed to develop the cooperation and creativity skills of the students with creative tasks to be carried out with group work. Moreover, the evaluation activities related to the topic covered in the module helped in brainstorming with the students and discussing these topics. These activities allowed students to learn from each other and enhance their thinking strategies.
STEAM allows for arts-based and creative curriculum aspects to be included to enhance learning and bring real life into the classroom. This may include story writing and telling, poetry, role plays, using the design-based aspects of technology to create models and prototypes before building/making (engineering) solutions, values/ethical discussions, etc. Accordingly, the proposed learning module aimed to contribute to the success of students in following engineering design processes to create a system, design a product or put forward an alternative solution in STEAM-based education. In addition, it is believed that this module can contribute to the development of students’ conceptual understanding of STEAM applications and their skills such as scientific creativity, cooperation, and the application of science and engineering together to solve a problem.
2.4. Evaluation
In the present study, the participants were categorized into two groups: the control group and the experimental group. The STEAM-based space-themed learning module was applied to the students in the experimental group, and the traditional lecture-based approach was applied to students in the control group. The curriculum contents are the same in the related classes where the research is conducted. A pre-test was provided to students of both groups at the beginning of the module to determine their initial grasp of the learning, and a post-test was given shortly after the completion of the module to determine what the students have learned. Körner et al. [
23] developed tests for both pre-and post-intervention evaluation. These tests were created with multiple-choice questions that measured knowledge, reasoning, and application skills. Each multiple-choice question had four possible answers including a distractor.
All students were informed that these test results would not affect their course grades and were allowed to ask questions before signing consent forms. The questions presented to students in the tests were generally aimed at measuring outcomes related to science. The test questions were prepared based on the steps in Bloom’s taxonomy of learning objectives, such as knowledge-based questions, comprehension questions, and conceptual questions (i.e., analysis, synthesis, and evaluation). Visuality was at the forefront of some questions, and students were expected to answer these questions based on their prior knowledge. In addition, the test included questions about visuality and logical reasoning.
3. Results
Students were asked 27 questions in both the pre-test and post-test. The Cronbach alpha coefficient of the pre-test was 0.78, and the Cronbach alpha coefficient of the post-test was 0.75. Within the scope of this study, students were grouped into the lower 25% group, the 50% group, and the top 25% group according to their academic achievement levels. In the group below 25% in terms of academic performance, the final test scores of the students who participated in the STEAM-based space learning module and the students who did not participate improved. On the other hand, the students who participated in the module, who were in the top 25% group in terms of academic performance, showed more improvement compared to those who did not participate. Moreover, there was a decrease in the post-test scores of the students who did not participate in the module in the top 25% groups. In all groups, students who participated in the module had higher scores on the post-test than pre-test. In addition, gender and participation in the STEAM-based space-themed learning module were other grouping criteria. Both boys and girls who participated in the module showed significant improvements at the end of the intervention.
One-way variance analysis (ANOVA) was used to determine how much learning occurred before and after the intervention and to determine the degree to which post-test scores were related to students’ academic achievement level and gender [
25]. Test scores of students who participated in the module and did not participate reveal that both groups improved their scores significantly. Examining whether students participated in the module also revealed statistically significant relationships between pre-and post-test scores and gender. In addition, a statistically significant relationship was found between pre-test and post-test scores based on whether students participated in the module and their gender.
Table 2 shows the pre-test and post-test results based on the student’s participation in the module and their gender.
Girls who did not participate in the STEAM-based space-themed learning module barely improved their post-test scores. Male students who did not participate in the module had lower pre-test scores than other groups. The standard deviation of the pre-test score for this group was higher than the post-test score, indicating that students with the lowest pre-test scores managed to reduce the difference between students who performed better in the post-test than in the pre-test. It was found that there was little difference between the levels of development shown by the boys and girls who participated in the module.
Students are divided into those with lower scores or the same (0 or Neg) and higher scores (Pos) in these two groups. The results indicated that most of the students (n = 168) improved their scores. It was found that 111 students improved their post-test scores and 25 students’ pre-and post-test scores remained the same. In addition, the results were examined for both students who participated in the STEAM-based space-themed learning module and did not participate.
Table 3 shows a comparison of the student’s test scores by gender before and after the intervention.
There was a difference between the expected scores and the obtained scores only for female students, with the expected post-test score for female students participating in the module being 7.1, while the obtained score as a result of the test was 34. When the results were examined for male students, it was found that there was not much difference between the expected scores and the obtained scores. When examined for the negativity or positivity of the pre-test and post-test scores, it seems that the female students benefited more from the module. The statistical importance of these results was shown in
Table 4.
The chi-square value for female students was found to be 5.81, and the
p-value was found to be 0.048. Thereby, it can be assumed that the STEAM-based space-themed learning module was more effective for female students. As a result of the ANOVA analysis, there was no significant differentiation in the pre- and post-test scores of the boys and girls who participated in the module. In addition, when the values of the pre-and post-test scores were examined, it was concluded that the female students who participated in the module had a higher post-test score than the male students. After evaluating the effectiveness of the module by gender, the same analysis was carried out based on the academic achievement levels of the students.
Table 5 shows a comparison of test scores according to the student’s GPA before and after the intervention.
Table 5 shows that the test scores after the intervention in the 1st and 2nd groups did not differ significantly from the expected score. Furthermore, it was found that the most benefited group from the module was the group with high academic success (the third one, which participated in the module). The expected post-test score of the group students was 47.7. The post-test score obtained after the intervention was 52. In addition, if the students did not participate in the module, their post-test scores decreased. Data from the first two groups and the sum of all groups were not considered at this stage of the analysis because they did not reveal statistically significant findings.
Table 6 shows the chi-square analysis results for the third-group students’ scores.
The chi-squared value for the third group was 5.19, and the
p-value was 0.038. Accordingly, it can be argued that the module is more useful for students with higher academic achievement levels. Note that students’ pre-test scores should be similar and students who had not improved their post-test scores should be considered. Multivariate variance analysis (MANOVA) was employed to reveal such situations. The results obtained from this analysis are introduced in
Table 7.
Table 7 indicated that students who scored lower on the post-test had slightly better scores on the pre-test (pre-test and post-test score difference; 2.39 points). In addition, in the post-test, students who increased their post-test (Pos) scores also passed the scores of students in the Neg-or-0 groups, while the average score of students in the Neg-or-0 group was close to the pre-test score of students in the Pos group. When the pre-test and post-test scores were evaluated separately, it was concluded that students who scored relatively low on the pre-test were more likely to achieve higher scores on the post-test, and students who scored higher on the pre-test were more likely to achieve lower scores on the post-test.
When examining the scores of the students from both tests, it was found that the gender and whether the students improved their scores had no significant impact on the pre-test and post-test scores. However, when these factors were evaluated together, it was found to affect both pre-test and post-test scores. Standard deviations (S.D.) and averages (Mean) are shown in
Table 8.
Based on
Table 8, it can be argued that gender has a share in students’ pre-test and post-test scores. Further, according to the GPA, the difference between the student’s pre-test and the post-test score was negative or positive, but it did not have a statistically significant effect on the pre-test or post-test scores. By evaluating the impacts of both variables on test scores individually, it was determined whether the academic achievement level affected the pre-test and post-test scores.
Table 9 indicates the mean scores and standard deviations of the pre-test and post-test for the six factors mentioned above. The difference between the scores of the top 25% and the 75% group was more pronounced than the students in the group who lowered or failed to improve their scores on the last test. There was almost no difference between the pre-test and post-test scores of the students in these groups.
In this study, students’ participation in the STEAM-based space-themed learning module can be an important factor in their test scores. For this reason, students were once again divided into two groups based on whether they increased their post-test scores or not. The positivity of the difference between the pre-test and post-test scores was statistically significant for both pre-test and post-test scores for the students who participated and did not participate in the module. In students who did not participate in the module, a negative or positive differentiation of the post-test and pre-test scores made the pre-test score more effective. In addition, the post-test scores of the students participating in the module were more predictable. In
Table 10, standard deviations of post-test and pre-test scores of module and control groups are given. Although students who did not participate in the module had wider score intervals in their pre-test results, it was observed that the given interval tends to decrease after the post-test. In contrast, students who participated in the module had closer pre-test scores and wider score intervals on their post-test results.
4. Discussion and Conclusions
In Turkiye, the evaluation of students is carried out with scores in the range of 0 to 100 points. The average GPA of all the students who participated in the study was 73.9 with a standard deviation of 0.73. Accordingly, it can be said that the students who participated in the study usually have a reasonable level of academic achievement. When the post-test scores of the control and experimental groups were examined, it was found that the achievement of the students in both groups increased. In addition, it has been determined that there are more remarkable improvements in the students who participated in the STEAM-based space-themed learning module. This indicated that the proposed module was as effective as traditional classroom education.
The results indicated that in the lower 25% groups in terms of academic performance, the students who participated or did not in the STEAM-based space-themed learning module improved their post-test scores. On the other hand, in the top 25% groups in terms of academic performance, the students who participated in the module showed better improvement than those who did not participate. Moreover, there was a decrease in the post-test scores of the students who did not participate in the module in the top 25% groups. In all groups, students who participated in the module had higher scores on the post-test than pre-test. However, the proposed module was more useful for students with higher academic achievement levels. Among the students who participated in the module, the top 25% groups in terms of academic achievement level had the most improved scores. This finding differs from the findings of Chen et al. [
26] and Ozkan et al. [
20], while it is similar to the findings of Piila et al. [
16].
When the post-test scores of the control group were examined, it was recognized that the post-test scores of the top 25% of students decreased, whereas the lower 25% group in terms of academic achievement improved their post-test scores. This can be explained by the ceiling effect. The ceiling effect is a scale attenuation effect, observed when an argument no longer affects a dependent variable or when the level above the variance in an argument is no longer measured [
27]. Students who already have a high level of academic achievement probably did not make much progress because they were already good at it.
The results indicated that both boys and girls who participated in the STEAM-based space-themed learning module showed significant improvements as a result of participation in the module. The girls who did not participate in the module slightly increased their scores, while boys who did not participate in the module highly improved their scores. Test scores of the female students who participated in the module increased the most.
Family and other environmental factors may influence the development of gender roles from childhood [
28]. For example, situations such as future attitudes and professional choices appear permanently in youth [
29]. Out-of-school learning and informal learning have been discovered to reduce the gender gap and support non-traditional career options with the help of extracurricular activities and teacher encouragement [
29]. Accordingly, this study also took possible gender differences into account, since female students and women are underrepresented in many fields related to science [
30,
31,
32]. The girls appear to have benefited more from the proposed module. When examining the learning status in this study, their improvement is remarkable, especially given the gender gap, and so is the magnitude of this learning. This can be explained by many factors. The fact is that the girls were relatively more successful in the pre-test than the boys. This may have affected the emergence of this condition. This finding is similar to the findings of Piila et al. [
16].
In conclusion, the study investigated the effectiveness of the STEAM-based space-themed learning module for primary school students. Accordingly, the STEAM-based learning module was developed and applied to randomly selected experimental and control groups for eight weeks. A comparison of the post-test and pre-test scores revealed that girls benefited more from the module than boys. Girls may have benefitted more since there was more social interaction and collaborative learning in the STEAM module. All students who participated in the STEAM-based learning module increased their scores, but the proposed module was more useful for students with higher academic achievement levels. The results implied that out-of-school learning activities may reduce gender differences both in terms of cognitive learning and motivation. These findings have implications for educational policymakers, curriculum developers, and syllabus designers.
The study has certain limitations. Some schools that participated in the experimental study were specialized schools in the field of science, and their students’ academic achievement profiles differ. Therefore, repeating this study with larger and more homogeneously distributed samples may also be useful. Another limitation of the study was that the control group students could not make up for a missed learning opportunity. Future studies can investigate the effectiveness of the STEAM-based learning module in other geographical locations to enhance the generalizability of the findings. Future studies are recommended to investigate the role of personality-related factors such as self-efficacy, innovativeness, and self-esteem on the effectiveness of the proposed learning module. Finally, recent research revealed that using novel approaches that combine classical structural equation modeling with AI-based algorithms can provide more robust results by considering both linear and non-linear relationships [
24]. Future studies are recommended to develop a predictive model to identify factors determining the educational sustainability of the proposed learning module.