Next Article in Journal
A Study on Learner Types in Online Classes by Q-Methodology
Previous Article in Journal
The Impact of Technostress on Teacher Educators’ Work–Family Conflict and Life Satisfaction While Working Remotely during COVID-19 in Pakistan
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Factors Influencing Students’ Achievements in the Content and Cognitive Domains in TIMSS 4th Grade Science and Mathematics in the United Arab Emirates

1
Emirates National Schools, Abu Dhabi 44321, United Arab Emirates
2
College of Education, Qatar University, Doha 9FFR+FC9, Qatar
3
College of Education, The British University in Dubai, Dubai 345015, United Arab Emirates
*
Author to whom correspondence should be addressed.
Educ. Sci. 2022, 12(9), 618; https://doi.org/10.3390/educsci12090618
Submission received: 23 June 2022 / Revised: 2 September 2022 / Accepted: 8 September 2022 / Published: 13 September 2022
(This article belongs to the Section STEM Education)

Abstract

:
Trends in International Mathematics and Science Study (TIMSS) is a comparative international assessment study conducted by the International Association for the Evaluation of Educational Achievement (IEA). TIMSS aims to study how educational opportunities are provided for students and what factors are associated with these opportunities. The purpose of this study was to examine the student factors in the United Arab Emirates that have an association with grade 4 students’ TIMSS 2015 results in the content and cognitive domains in the subjects of mathematics and science. The study adopted the quantitative research approach through the data analysis of TIMSS 2015 for grade 4 students in these subjects. The study sample consisted of 21,177 students enrolled in 372 UAE private schools and 186 public schools. The percentage of grade 4 girls who participated in the study was 48%, while the percentage of boys was 52%. A multiple linear regression analysis was conducted to examine the most influential student factors that impact on science and maths achievement. Structural equation modeling (SEM) was implemented to examine the relationships between student factors and the content and cognitive domains of mathematics and science in the TIMSS 2015 results. The findings showed that the student factors with a positive association with student achievement were having breakfast on school days, engaging teaching in mathematics lessons, liking learning science, and confidence in mathematics and science. There was a non-significant correlation between gender and mathematics and science achievement. A surprising finding was that “liking learning mathematics” had a negative association with student performance in that subject. There was a positive association between student engagement and mathematics achievement, while the association between the engagement in science lessons and student performance was found to be insignificant.

1. Introduction

Trends in International Mathematics and Science Study (TIMSS) is a comparative international assessment study for more than 60 countries that is conducted by the International Association for the Evaluation of Educational Achievement (IEA) [1]. TIMSS has a quasi-longitudinal design, as grade 4 student cohorts will be assessed again after four years when they are in grade 8 [1]. The countries that participate in multiple cycles of the assessment can track students’ progress, and can evaluate any changes that have been made in the country’s education system (IEA, 2019). This design provides an early warning system for required curriculum reforms for grade 4, and allows us to measure the effectiveness of these reforms during grade 8 [1].
TIMSS results are highly valued by international policymakers and also by the government of the UAE. In 2010, H.H. Sheikh Mohammed bin Rashid Al Maktoum launched the UAE’s Vision [2], which aims to make the country one of the top countries in the world when its celebrates 50 years of its union in 1971 [2,3]. One of the performance indicators of the vision is to be amongst the top fifteen performers in the TIMSS results. However, when looking at the UAE results in TIMSS 2015, it can be noted that grade 4 students need to improve by 20 ranks in both mathematics and science [4]. Therefore, the student factors that were associated with the UAE’s student results need to be investigated in order to meet this national vision.
Most of the TIMSS analysis studies in the literature were conducted on European, American, or East Asian students. No published studies focused in depth on students in the UAE. This study, therefore, focused on the TIMSS 2015 results in the UAE, and investigated the factors associated with students’ results.
Although several research studies have been conducted on student achievement based on TIMSS, most of these studies investigated the connections between student results as one variable, without taking into consideration the content and the cognitive domains. Camilli and Dossey [5] showed that investigating the content domain in TIMSS helps countries to develop a more strategic use of these test results. Looking back at the results of the TIMSS 2015 and 2011 research in the UAE, the challenges in the content and cognitive domains are similar [4]. Thus, the content and cognitive domains in TIMSS need to be investigated further, as the results have remained the same over two test cycles. In this study, the content domains in mathematics are Numbers, Geometry, and Data Display, while for science they are Life Science, Physics and Earth Science [1]. The cognitive domains of Knowing, Applying and Reasoning are the same across these subjects [1].

1.1. Student Factors

A number of researchers reported that there was a positive correlation of a healthy lifestyle and academic attainment [6,7,8,9,10]. Studies from the literature investigated the effect of a healthy diet on children’s skills, and a healthy diet was found to improve students’ cognitive functions for primary school students [6]. Burrows et al. [7] stated that balanced dietary behaviors are associated with better academic performance. For elementary students, an unhealthy lifestyle will lead to poor academic performance in English language and mathematics [11].
It is important for students to eat breakfast daily, as children who did not eat breakfast had lower scores in cognitive assessments [12]. Furthermore, students who eat school breakfast and lunch receive higher nutritional quality than the ones who obtain their meals from home because school meals have higher dairy-rich food with a limited number of calories and added sugar compared to home meals [13]. This is because schools need to follow school meal regulations, which include the amount of calories, fruits, vegetables and grains to be eaten [13].
Gender has been an interesting topic in educational research, in order to study the differences in academic performance between boys and girls [14]. A study of Saudi Arabia’s TIMSS results concluded that the mathematics achievements of girls is stronger than that of boys, and this was indicated in three TIMSS cycles [15]. In Jordan, Innabi and Dodeen [16] concluded that in TIMSS 2015, boys were more likely than girls to correctly answer complex, unfamiliar, real-life situation mathematics questions, while girls were more likely to give the correct answer for familiar and less-difficult questions [16]. This shows the importance of contextualizing the problems in the curriculum and being relevant to the students [17,18,19]. A study of gender differences in the TIMSS assessment of Singapore concluded that girls performed as well as or better than boys in mathematics [20]. Other studies indicated that boys performed better compared to girls [14,21], while other authors concluded that there was no direct relationship between student gender and science achievement [22].
A number of studies found a strong relationship between student motivational beliefs and student academic achievement [23,24,25]. Liou [25] stated that there is a positive correlation between student motivational beliefs and academic performance. A TIMSS analysis study concluded that when students are motivated to learn, it will have a positive effect on their academic results [24]. A student’s motivation is influenced by their beliefs, interests, and attitudes, which can have either a positive or negative impact [26].
Students’ self-concepts are related to different aspects of their lives and how they perceive their abilities in different dimensions [23]. Academic self-concept and self-confidence are important concepts in motivation, as they have an impact on the students’ academic achievement [27,28,29]. Students’ science achievement depended greatly on student factors such as self-confidence [30]. A student’s low level of math self-concept will lead to a decline in their interest in the subject [31]; when academic self-concept increases, students’ interests in the subject increase [29], and there is a positive relationship between academic self-concept and standardized assessment results [28]. Liou [32] indicated that self-concept is positively associated with students’ individual achievements in mathematics and science.
A common phenomenon that threatens student safety in schools is bullying [33,34,35,36,37,38]. Bullying exists in every school, and it affects academic performance for both the victims who suffer it and the bullies themselves [34]. Gietz and McIntosh [39] stated that a student’s perceptions of their school’s environment—such as safety, bullying experience and clear behavior expectations—are associated with their academic achievement. Similarly, Strom et al. [33] found that schools with a high rate of bullying show lower academic performance, and Sulak [40] claimed that a low frequency of school discipline issues is often associated with high academic performance. A study of the association between teasing and bullying with academic achievement indicated that a high number of students and teachers perceive these to be significantly associated with low academic achievement and classroom engagement [35].
Classroom engagement refers to practices in which the students are actively involved in the learning process [41]. House and Telese [42] indicated that there is a significant positive relationship between student engagement and academic achievement. Students’ engagement could be promoted through collaborative learning, as this has a positive impact on student learning behaviors and academic achievement [43]. Teamwork engagement has a positive influence on students’ personal success, learning and work satisfaction [44].

1.2. Conceptual Framework

The conceptual framework of the study consisted of the TIMSS curriculum model and Piaget’s cognitive development theory. Figure 1 shows the TIMSS curriculum model, which consists of three parts [45]: (1) the intended curriculum refers to the mathematics and science learning expectations for students; (2) the implemented curriculum refers to classroom teaching practices; and (3) the attained curriculum refers to what the students learned, and their perceptions of learning mathematics and science.
As the focus of the study is on student factors and TIMSS results, it will be related to the attained curriculum. The attained curriculum refers to what the students have learned through the learning process. It is not measured only by student grades; it also involves student attitudes and characteristics that have been developed throughout the learning process [46]).
Piaget’s [47] Theory of Cognitive Development focuses on the way in which humans construct and use knowledge based on their biological development and interaction with the environment. The focus of the study was on grade 4 students who were in the Concrete Operational Stage. This stage is considered to be the turning point of a child’s cognitive development, language and fundamental skills, as it is the start of logical and operational thinking [48]. In TIMSS assessment, students need to be familiar with the content of mathematics and science, and they need to have acquired the cognitive skills to respond correctly to the questions [45]. The cognitive domains that are assessed in the assessment are Knowing, Applying, and Reasoning [45]. Referring to the skills that grade 4 students acquired in the concrete operational stage, students can use their Knowing skills in recalling and recognizing the information, their Applying skills in applying this knowledge in different contexts by the property of conservation and reversibility, and their Reasoning skills in solving problems in logical and rational ways.

1.3. Content and Cognitive Domains

The content domain focuses on the subjects or topics that need to be assessed [1]. Camilli and Dossey [5] showed that investigating the content domain in TIMSS helps the countries to gain more strategic use of the test results, obtain diagnostic information that helps to differentiate aspects of education on a national level, and to provide more supplementary information, as each country emphasizes a different aspect in the content domain. In the TIMSS assessment, the content domains for grade 4 in mathematics were Number, Geometry, and Data Display, while for science, these were Life Science, Physics and Earth Science [1]. Each content topic is divided into sub-topics. Daus and Braeken [49] showed that the varieties in the implementation of the content domains among countries in TIMSS since 2015 were because of some school’s investment in teaching Biology, while others aimed for a balance between the three domains.
The cognitive domain refers to the thinking process and skills that are required in order to respond to the assessment items [1]. In TIMSS assessment, the question items cover students’ thinking skills in three cognitive domains: Knowing, Applying and Reasoning [45].
The cognitive process in different domains requires the organization of the sequential information into an integrated structure [50]. A study of gender differences in TIMSS assessment according to the cognitive domain concluded that there is little difference in the three areas, which are Knowing, Applying and Reasoning, with boys outperforming girls in all of them [51]. Miscevic-Kadijevic [52] stated that cognitive achievement in the areas of Knowing, Applying and Reasoning were linked to self-confidence. Peduk and Ates [52] claimed that one of the most important reasons for nations not performing well in the TIMSS assessment is that the assessment and examinations that are implemented in these schools do not measure higher-order thinking skills. A study of Taiwanese TIMSS results concluded that Reasoning cognitive domain questions were more difficult than Applying and Knowing because Reasoning is considered a higher-order thinking skill that requires the analysis of information and judgment of its purpose [53].

1.4. Purpose and Research Questions

The purpose of this study was to examine the student factors that have an association with the grade 4 students’ mathematics and science TIMSS 2015 results in the content and cognitive domains in the UAE. The content domains in mathematics are Numbers, Geometry, and Data Display, while for science, these are Life Science, Physics and Earth Science [1]. The cognitive domains of Knowing, Applying and Reasoning are the same across these subjects [1]. The research addressed the following questions:
  • What are the most influential Student Factors that have an impact on grade 4 mathematics and science achievement in TIMSS 2015 in the UAE?
  • What are the relationships between Student Factors and the content and cognitive domains of mathematics and science in TIMSS 2015 in the UAE?

2. Methodology

The approach of this study was purely quantitative. The study used secondary data analysis of TIMSS 2015 for grade 4 students in the subjects of mathematics and science in the UAE.
The sites of the study were public and private schools. The population of the study were all grade 4 students in the UAE. For the UAE TIMSS 2015 study, the grade 4 sample comprised 372 private schools and 186 public schools [4]. The total number of sample schools was 558 schools. The sample of grade 4 comprised 21,177 students [4]. The percentage of grade 4 girls who participated in the study was 48%, while the percentage of boys was 52% [54].
The data collection instruments were divided into two parts: assessment items and student questionnaires. The assessment items consisted of grade 4 mathematics and science TIMSS 2015 questions. Table 1 shows the percentages of the TIMSS 2015 assessment items for the content domains in mathematics (Numbers, Geometry and Data Display), content domains in science (Life Science, Physics and Earth Science), and cognitive domains (Knowing, Applying and Reasoning) in both.

2.1. Selection of Variables

The variables were selected from students’ TIMSS 2015 questionnaires, based on studies in the literature that identified them as the most critical variables that affected student performance. As there were many variables in the TIMSS questionnaires, these were reduced by combining them into composite variables. The study used the TIMSS 2015 background indices for the composite variables. The background index is a composite variable that assigns the participants’ responses into one of three levels based on the data of the component variables [1].
There were seven composite factors in the student questionnaire that were selected for the study, and two ungrouped essential variables that were selected, which were gender and breakfast during school days. All of the student factors that are involved in the study are presented in Table 2. All of the items of the selected variables are presented in Appendix A (Table A1).

2.2. Data Analysis

The TIMSS assessment used Plausible Values (PV), which are a computational approximation of the population characteristics in assessments, which are used when there are few items to provide a precise estimation of students’ abilities [55]. The PVs were used in TIMSS assessment because they did not provide individual scores for students, but they estimated the population parameters such as average and variance. When analyzing TIMSS data, each PV variable needs to be considered during the analysis. These variables help us to achieve an accurate estimation of the average achievement for each domain.
TIMSS 2015 used Jackknife Repeated Replication (JRR) techniques that provide an accurate estimation of the sampling errors. The study followed recommendations from Rutkowski et al. [56] when calculating the sampling weight of the TIMSS analysis that included schools, classrooms and student factors.
Final Student Weight = (Student weight factor × Student weight adjustment) × (Class weight factor × Class weight adjustment)
An essential step in preparing the data for analysis was data cleaning, including correcting errors in the data, and correcting incoherent entries within and between instruments, etc. This process assisted us in handling potential errors before analysis (Chai 2020). The cleaning process in the study included making a gender variable 0, 1 (Female = 1, Male = 0) instead of 1, 2, as was indicated in TIMSS’ original data set. Furthermore, it included rescaling questions to recode “Never” as 1 instead of 4, and “Strongly Disagree” as 1 instead of 4 for positive variables.
Due to the large sample size of the TIMSS assessment, some of the data were missing. For multivariate analysis, it is recommended to drop the cases of the missing data rather than to replace them [57]. Therefore, as the study used a multivariate analysis, such as multiple linear regression, the study used the deleting method. Allison [58] stated that listwise deletion leads to an unbiased estimation of regression coefficients, and that it leads to an accurate estimate of standard errors. As the study used regression and SEM analysis, it is essential to take into consideration the analysis method when selecting the deleting method of data analysis. Therefore, the study used listwise deletion.
The data analysis techniques were descriptive statistics, multiple linear regression, and Structural Equation Modeling (SEM). The pieces of statistical software that were used to conduct these data analysis techniques were IEA IDB analyzer and Stata. The study used the IEA IDB analyzer to combine the data in order to ensure that the data were merged with the correct variables, plausible values and weights. The merged data were then produced using the SPSS format. However, the SPSS program could not perform the required analysis using the plausible values for the mathematics and science results. Therefore, Stata/IC 16.1 was used to perform these analyses. Stata had specific commands for survey analysis that used plausible values (PV), Jackknife Repeated Replication (JRR), sampling weights, and specific controls for TIMSS data.

3. Results

3.1. Descriptive Statistics

The descriptive statistics for student factors are presented in Table 3. There are nine variables in Table 3; these are the TIMSS indices, except for gender and breakfast on school days. All of the variables had a three-point Likert scale, except for breakfast on school days and gender. The largest average and standard deviation in Table 3 were for the breakfast on school days variable (M = 3.27. SD = 1.03). This is because this variable had four values. The variable ‘gender’ had two values (Female = 1, Male = 0); the mean of 0.49 showed that the numbers of male and female students were almost equal.

The Most Influential Student Factors That Have Impact on Science and Math Achievement

In order to answer the first research question, “What are the most influential student factors that have impact on science and math achievement?”, a multiple linear regression analysis was conducted. The selected variables of the student questionnaire were used to form the linear regression model of the student factors. The analysis was conducted for the five plausible values for the two subjects. Table 4 shows the regression analysis for student factors based on math achievement. The R2 of the mathematics achievement model based on student factors was 0.12, which means that approximately 12% of the variability of mathematics achievement was accounted for in the variables of the model.
The significant regression equation that predicted math achievement based on student factors was the following:
Y i G r a d e   4   M a t h   A c h i e v e m e n t                      = 369.75 + + 2.52 B r e a k f a s t i 13.10 B u l l y i n g i 5.13 L i k e   M a t h i                 + 11.5   E n g a g i n g   T e a c h i n g   i n   M a t h   L e s s o n s i       + 41.07 M a t h   C o n f i d e n c e i + ε
Like mathematics achievement, the regression analysis for the student factors that were associated with science achievement was conducted, and the results are shown in Table 5.
The significant regression equation that predicted science achievement based on student factors was the following:
Y i S cience   A c h i e v e m e n t                         = 327.37 + 2.20 B r e a k f a s t i 16.69 B u l l y i n g i                 + 21.57 L i k e   science   i + 43.40 s c i e n c e   C o n f i d e n c e i + ε

3.2. The Relationships between Student Factors and the Content and Cognitive Domains

In order to answer the second research question, “What are the relationships between student factors and the content and cognitive domains of mathematics and science TIMSS 2015 ?”, a structural equation modeling (SEM) analysis was conducted with the selected variables of student factors and the content and cognitive domains of mathematics and science. Table 6 shows the SEM analysis of student factors with the content domains of mathematics. From Table 6, all of the student factors had statistically significant relationships with all of the content domains of mathematics. The model had a weak fit, as the Standardized Root Mean Square Residual (SRMR) was 0.42, and the Coefficient of Determination (CD) was 0.30. The model has a weak fit, as a perfect fit for SRMR is when it is close to 0, and for CD is when it is close to 1 [59].
In Figure 2, the latent variables of the model are Data Display, Geometry and Number. The observed variables were gender (ASBG01), breakfast on school days (ASBG09), bullying (ASDGSB), liking learning mathematics (ASDGSLM), being engaged in math lessons (ASDGEML), and confidence in mathematics (ASDGSCM). The factors that had a positive effect on the three latent variables were breakfast on school days, being engaged in math lessons, and students’ confidence in mathematics; meanwhile, bullying and liking learning mathematics had a negative effect on the model. The gender variable had a positive effect on Data Display and Geometry, whilst also having a negative effect on the Number variable. This means that being a female student had a positive impact on Data Display and Geometry, whilst also having a negative effect on the Number content domain.
An SEM analysis was conducted with student factors, and the cognitive domains of mathematics and results are shown in Table 7. From the table, the model had a weak fit, as SRMR = 0.43 and CD = 0.32.
As shown in Figure 3, the latent variables of the model were Knowing, Applying and Reasoning. The observed variables were bullying (ASDGSB), engaging teaching in mathematics lessons (ASDGEML), liking learning mathematics (ASDGSLM), student confidence in mathematics (ASDGSCM), gender (ASBG01), and breakfast on school days (ASBG09). The observed variables that had a statistically significant positive effect with the three latent variables were breakfast, being engaged in math lessons, and student confidence in mathematics. The factors of bullying and liking learning mathematics had a negative effect on the three models of the cognitive domains. Gender had an insignificant effect on the cognitive domains of Knowing and Reasoning, while it had a statistically significant negative effect on the Applying model.
In the same vein as mathematics, an SEM analysis was conducted between the student factors and the content and cognitive domain of science. From Table 8, the SEM analysis model for the student factors with the content domain of science had a poor fit, as shown in the values SRMR = 0.40 and CD = 0.39.
From Figure 4, the latent variables in the model were Earth Science, Life Science and Physics. The observed variables were bullying (ASDGSB), engaging teaching in science lessons (ASDGESL), liking learning science (ASDGSLS), students being confident in science (ASDGSCS), gender (ASBG01), breakfast on school days (ASBG09). The factors that had a positive effect on the three latent variables were breakfast on school days, liking learning science, and student confidence in science, while bullying had a negative effect on the three models. Gender had a positive effect on Life Science and a negative effect on Earth Science and Physics. Students’ confidence in science had the largest effect on the three latent variables: Earth Science (b = 44.22), Life Science (b = 45.13), and Physics (b = 43.68).
An SEM analysis was conducted between student factors and the cognitive domains of science. From Table 9, the SEM analysis model for student factors with the cognitive domains of science had a poor fit, as the value of SRMR was 0.41, and that of CD was 0.39.
The model of SEM analysis between the student factors and the cognitive domains of science is illustrated in Figure 5. The latent variables were Knowing, Applying and Reasoning. The observed variables were bullying (ASDGSB), engaging teaching in science lessons (ASDGESL), liking learning science (ASDGSLS), students being confident in science (ASDGSCS), gender (ASBG01), and breakfast on school days (ASBG09). The factors that had a statistically significant positive effect on the three cognitive domains of science were breakfast on school days, liking learning science, and student confidence in science, while bullying had a statistically significant negative effect on the three models. Gender had a positive effect on Applying and Reasoning. Similarly to the model of the content domain, student confidence in science had the largest coefficient with the three latent variables.

4. Discussion and Implications

4.1. Student Factors That Have an Impact on Science and Math Achievement

The findings of the multiple linear regression model in Table 4 and Table 5 showed that there is a non-significant correlation between gender and mathematics and science achievement. This finding is similar to Boz, Yerdelen-Damar and Belge-Can’s [22], who stated that there was no direct relationship between student gender and science achievement. This finding is inconsistent with a study of Saudi Arabia, which found that the mathematics achievement of girls is better than that of boys [15]. Furthermore, it is not consistent with the Jordanian TIMSS results, as Innabi and Dodeen [16] indicated that girls performed better than boys in TIMSS 2015. A possible reason for the higher achievement of girls than boys might be that girls’ confidence in learning is greater than that of boys [20], while boys may not show all their knowledge in exams [60]. Furthermore, girls study hard to understand the material of the subject, while boys only focus on their performance [61]. Another reason could be because women in the UAE have the same rights as men, and they have access to education, different careers, social benefits and government office [62]. Furthermore, the UAE National Agenda, Vision 2021, aimed to reduce inequality, including gender imbalance [4]. In UAE TIMSS 2019, there was a significant difference of 9 points in favor of UAE boys in mathematics. For science, in the TIMSS 2019, girls performed better than boys by 4 points [54]. This needs further study on the differences in gender in TIMSS 2019 and the factors that might cause these differences, and how we can improve our teaching pedagogies based on this understanding of the genders in TIMSS 2019. It was expected that having breakfast on school days would have a positive association with mathematics and science results. The results matched Hjorth et al. [12], who concluded that students who do not eat breakfast daily had lower scores in cognitive assessments. Furthermore, Burrows et al. [7] concluded that balanced dietary behaviors are associated with better academic performance. McIsaac, Kirk and Kuhle [11] stated that an unhealthy lifestyle for elementary students would lead to poor academic performance in mathematics. The healthy lifestyle could be linked to students’ socioeconomic status. The economic affluence of homes was associated with student achievement [63]. Higher student achievement was associated with affluent students rather than the disadvantaged ones [64], and children from families with lower socioeconomic status performed more poorly in elementary schools than the children with higher socioeconomic status [65].
It was anticipated that bullying would have a negative association with mathematics and science achievement. The results were consistent with those of Al-Raqqad et al. [34], who stated that bullying had negative effects on students’ academic performance. In the same vein, Strom et al. [33] concluded that schools with a high incidence of bullying show lowered academic performance.
The linear regression model showed that the factor of liking learning mathematics had a negative association with TIMSS 2015 mathematics student performance. On the other hand, as expected, the factor of liking learning science had a positive association with student performance. Liking learning is referred to as the students’ desire to learn, which could be defined as motivation [66]. Students’ motivation influences their beliefs, interest, and attitudes [26], which could result in a positive effect on student attainment. Students will learn better when they believe that subjects will benefit them, when they are interested in classroom activities, and when they have a positive attitude to learning in school.
Engagement in mathematics lessons demonstrated a positive association with student performance, while engagement in science lessons showed an insignificant association. The findings of the current study of the positive association between student engagement and mathematics achievement were similar to some studies in the literature. House and Telese [42] indicated that there is a significant positive relationship between students’ engagement and their academic achievement in Korean TIMSS 2011 results. Furthermore, Moreira et al. [67] stated that higher-achieving students show higher cognitive engagement.
For the insignificant association between the engagement in science lessons and student performance, the explanations for these findings might be related to ineffective teaching strategies that were implemented in science classes. Littledyke [68] stated that students might have a negative attitude toward learning science when the concept is not linked to their experiences through the integration of the cognitive and affective domains.
The positive association with the confidence in learning and student achievement was similar to a number of studies in the literature. Mohammadpour, Kalantarrashidi and Shekarchizadeh [30] stated that students’ science achievement depended greatly on student factors such as self-confidence, Guay et al. [69] stated that primary school self-concept had an impact on academic achievement, and Sewasew and Schroeders [28] noted that there is a positive relationship between academic self-concept and standardized assessment results.
A possible reason for the positive association between confidence in learning and academic performance is that it is linked to student motivation. Guay et al. [69] illustrated that academic self-concept was associated with student motivation. When students are interested in learning mathematics and science, they will be able to follow the classroom activities and understand the teacher’s expectations.

4.2. The Relationships between Student Factors and the Content and Cognitive Domains of Mathematics and Science in TIMSS 2015

Structural Equation Modeling (SEM) analysis was conducted (see Table 6, Table 7, Table 8 and Table 9 and Figure 2, Figure 3, Figure 4 and Figure 5). The SEM analysis showed that there were differences between the genders in the performance in the specific content and cognitive domains. Girls performed better than boys in the content domains of Data Display and Geometry, while boys performed better in the Number and Applying questions. For science, girls performed better than boys in Life Science, Applying, and Reasoning questions, while boys performed better in Earth Science and Physics.
Studies in the literature indicated different findings from the current study in the content domains of mathematics. Stewart et al. [70] stated that there are no significant differences between male and female achievement in the areas of math calculation, geometric concepts, basic math concepts, and addition error factors. Furthermore, a study of the content domain of Data and Chance in the United States concluded that boys outperformed girls [71].
The current study concluded that there was an insignificant association between gender and the Reasoning cognitive domain questions. However, studies in the literature indicated that boys performed better in the Reasoning cognitive domain tasks. Stewart et al. [70] stated that boys outperformed girls in complex real-life problem situations. In Jordan, boys were more likely than girls to correctly answer complex, unfamiliar, real-life situations mathematics questions, while girls were more likely to obtain the correct answer for familiar and less-difficult questions [16].
It was difficult to find reasons for the differences in performance between genders in the specific content and cognitive domains. An argument provided by George and Robitzsch [51] about gender differences in specific content and cognitive domains stated that question items should be treated as a combination of both, rather than one domain by itself. The interaction effect of the content and cognitive domains could explain the significant differences between the genders which were not contemplated in a specific domain TIMSS analysis [51].
SEM analysis indicated that when the students had breakfast every school day it had a positive effect on the content domains and cognitive domains of mathematics and science. Having breakfast on school days improves students’ abilities by maintaining a balanced dietary lifestyle, which is associated with better cognitive skills and academic achievement [10]. It is therefore very important to support healthy diet behavior in order to help improve students’ academic achievement [11].
The study showed that when the students had been bullied in school, their achievement in the content domains and cognitive domains became lower. Students’ ability to learn will decrease as a result of teasing and bullying. This will lead to lower student engagement in school, which might decrease students’ desire to learn and perform well academically [35]. Furthermore, students who had been bullied were exposed to aggressive behavior that leads to lower performance in mathematics and science [72].
The findings of the SEM analysis indicated that when the students liked learning mathematics, their achievement in the content and cognitive domains became lower. For science, ‘liked learning science’ had a positive association with the content domains and cognitive domains.
It was difficult to explain the negative association between “liking learning mathematics” and student results, as well as in the content and cognitive domains. One possible explanation might be related to Ni et al.’s [73] indication that the desire to learn mathematics could be improved through high-cognitive-domain tasks, and building a positive relationship with the mathematics classroom. Furthermore, Slavin [74] stated that student motivation is influenced by previous experience in the school. High-achieving students might not be provided with high-cognitive-domain tasks that could make them like learning mathematics and have a positive relationship with the mathematics classroom. This might result in having a poor experience in mathematics lessons, and could affect their motivation negatively [75,76,77]. However, the negative association must be interpreted with caution because it had the lowest coefficient value in the multiple linear regression model, which was significant at the p = 0.05 level, while most of the other factors were significant at the p = 0.001.
Studies in the literature showed similar findings to the current study of the positive association between science motivation and student achievement, and in the content and cognitive domain. Liou [25], in a study of science motivational beliefs based on TIMSS data, concluded that there was a positive association between student motivational beliefs and academic performance.
The finding of the study indicated that when the students had a high level of engagement in mathematics lessons, their achievement in the content domains and cognitive domains became higher. For science, engaging teaching in science lessons had only one statistically significant negative effect with the latent variable ‘Reasoning’.
The positive association between classroom engagement, mathematics content and cognitive domains might be because students were actively involved in the learning activities of the mathematics lessons [41]. When the students are actively involved in the learning activities, they will understand the mathematical concepts and will be able to respond to the question items that cover specific content and cognitive domains.
The last variable was confidence and self-concept in mathematics and science. The factor of confidence in learning mathematics and science had a positive association with students’ results, as well as in the content and cognitive domains. The most interesting finding was that the factor of confidence in learning mathematics and science was the strongest student factor, as it had the highest coefficient in the regression model. This finding is similar to that of Miscevic-Kadijevic [52], who illustrated in an analysis study of TIMSS 2011 grade 4 results that cognitive achievement in the areas of Knowing, Applying and Reasoning was linked to self-confidence. Furthermore, in a study on Taiwan’s TIMSS 2011, Liou [32] concluded that self-concept is positively associated with grade 4 students’ individual achievement in mathematics and science.
Based on the findings of the study, there were some implications that need to be addressed in order to improve student performance. The current study concluded that bullying had a negative association with student achievement. Bullying had a negative influence on student wellbeing and safety [38], which could affect students’ desire to learn and perform well in schools. Therefore, schools need to establish a strong discipline system that includes proper consequences for students’ inappropriate behavior. Anderson, Ritter and Zamarro [78] stated that schools should develop prevention approaches rather than waiting for students to be involved in discipline issues. The prevention program could include lectures, assembly programs, workshops and competitions to raise awareness. Furthermore, teacher classroom management programs help to reduce behavioral problems and improve students’ social competencies [79].
As the study concluded that having breakfast on a school day had a positive association with grade 4 performance, it is important to ensure that students do not miss this important meal during school days. It is recommended to provide this meal to students at school in order to make sure that the students eat healthy food regularly. Au et al. [13] stated that students who eat school breakfast and lunch receive a higher quality of diet than the ones who obtain their meals from home.
As the strongest student factor that was associated with academic achievement was students’ self-confidence, it is important to maintain high self-confidence for students. School leaders should ensure that their students maintain high levels of self-confidence by following up with the classroom strategies that enhance this. These classroom practices include having a well-structured learning environment that helps students to feel confident enough to achieve their teachers’ expectations [80]. Teachers’ practices, experiences, and beliefs of learning and teaching related to TIMSS [80,81,82] and their needs to help the students achieve well in TIMSS content and cognitive domains need to be considered very well and comprehensively, in line with the development of the science and mathematics curricula [83,84]. The culture context of the students and teachers also need to be considered when thinking about changes and improvements in the learning environment [85].

5. Conclusions

The educational sector in the UAE considers Trends in International Mathematics and Science Study (TIMSS) to be a valuable indicator to trace educational improvements and to fulfill the country’s National Agenda 2021. The purpose of this study was to examine the student factors that have an association with UAE grade 4 students’ mathematics and science TIMSS 2015 results in the content and cognitive domains.
The analysis indicated that student factors had an association with mathematics and science achievement, as well as in the content and cognitive domains. There was insignificant association between gender and mathematics and science student achievement, and there were specific content and cognitive domains where boys outperformed girls. The factors that had a positive association with student performance were having breakfast, liking learning science, engagement in mathematics lessons, and student confidence in mathematics and science. The factors that had negative associations were bullying and liking learning mathematics. It is very interesting to note that student confidence in learning showed the strongest effect among the other factors in both the regression and SEM models.
The study had a few limitations. It was purely quantitative research, so it did not provide an in-depth understanding of the reasons behind student achievement in TIMSS 2015 in the content and cognitive domains. However, the fact that the instrument of the study was developed by experts in the assessment field and piloted in different countries provided more reliable and valid data that could be generalized to the whole cohort of grade 4 students in the UAE. The study used secondary sources of data that were not collected by the researcher; as such, the purpose of collecting the data might be different from the purpose of the analysis.

Author Contributions

Investigation, A.B.; Supervision, S.F.; Visualization, N.M.; Writing—original draft, A.B.; Writing—review and editing, N.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data reported in this research are available from the TIMSS 2015 International Database. Available online: https://timssandpirls.bc.edu/timss2015/international-database/ (accessed on 7 September 2022).

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Items of selected variables for the study.
Table A1. Items of selected variables for the study.
VariableDescription
ASDGSBTIMSS Index: Student Bullying
ASBG12ASomeone made fun of me
ASBG12BI was left out of games
ASBG12CSomeone spread lies about me
ASBG12DSomeone stole from me
ASBG12EI was hurt by others
ASBG12FSomeone forced me to do something
ASBG12GSomeone shared embarrassing information
ASBG12HSomeone Threatened me
ASDGEMLTIMSS index: Engaging Teaching in Mathematics Lessons
ASBM02AI know what my teacher expects me to do
ASBM02BMy teacher is easy to understand
ASBM02CI am interested in what my teacher says
ASBM02DMy teachers give me interesting things to do
ASBM02EMy teacher has clear answers
ASBM02FMy teacher gives good explanation
ASBM02GMy teacher let me show what I had learned
ASBM02HMy teacher does a variety of things to help us learn
ASBM02IMy teachers show me how to do better
ASBM02JMy teachers listen to me
ASDGSLMTIMSS Index: Like learning mathematics
ASBM01AI enjoy learning mathematics
ASBM01BI wish not to study math *
ASBM01CMath is boring *
ASBM01DI learn interesting things in mathematics
ASBM01EI like mathematics
ASBM01FI like schoolwork involving numbers
ASBM01GI like solve math problems
ASBM01HI look forward to math lessons
ASBM01IMath is my favorite subject
ASDGSCMTIMSS Index: Student confidence in mathematics
ASBM03AI usually do well in math
ASBM03BMathematics is harder for me than for others
ASBM03CI am just not good in math
ASBM03DI learn quickly in mathematics
ASBM03EMath makes me nervous
ASBM03FI am good at working out problems
ASBM03GI am good at mathematics
ASBM03HMathematics is harder for me than any other subject
ASBM03IMath makes me confused
ASDGESLTIMSS index: Engaging Teaching in Science Lessons
ASBS05AI know what my teacher expects me to do
ASBS05BlMy teacher is easy to understand
ASBS05CI am interested in what my teacher says
ASBS05DMy teachers give me interesting things to do
ASBS05EMy teacher has clear answers
ASBS05FMy teacher gives me clear explanation
ASBS05GMy teacher lets me show what I have learned
ASBS05HMy teacher does a variety of things to help us learn
ASBS05IMy teachers show me how to do better
ASBS05JMy teachers listen to me
ASDGSLSTIMSS Index: Like learning Science
ASBS04AEnjoy learning science
ASBS04BI wish not to study science *
ASBS04CScience is boring *
ASBS04DI learn interesting things in science
ASBS04EI like science
ASBS04FI look forward to learning science
ASBS04GScience teaches me how things in the world work
ASBS04HI like to do science experiments
ASBS04IScience is my favorite subject
ASDGSCSTIMSS Index: Students Confident in Science
ASBS06AI usually do well in science
ASBS06BScience is harder for me than for others
ASBS06CI am just not good at science
ASBS06DI learn quickly in science
ASBS06EI am good at science
ASBS06FScience is harder for me
ASBS06GScience makes me confused
Other variables of interest with no group
ASBG01Gender
ASBG09Breakfast on School Days
* Reversed coded.

References

  1. Aasheim, M.; Reedtz, C.; Handegård, B.; Martinussen, M.; Mørch, W. Evaluation of the incredible years teacher classroom management program in a regular Norwegian school setting. Scand. J. Educ. Res. 2018, 63, 899–912. [Google Scholar] [CrossRef]
  2. Aburizaizah, S.; Kim, Y.; Fuller, B. Principal leadership and student achievement: Decentralising school management in Saudi Arabia. Comp. A J. Comp. Int. Educ. 2019, 49, 795–816. [Google Scholar] [CrossRef]
  3. Allison, P. Missing Data: Design and Inference; SAGE: Thousand Oaks, CA, USA, 2001. [Google Scholar]
  4. Al-Raqqad, H.; Al-Bourini, E.; Al Talahin, F.; Aranki, R. The impact of school bullying on students’ academic achievement from teachers point of view. Int. Educ. Stud. 2017, 10, 44–50. [Google Scholar] [CrossRef]
  5. Anderson, K.; Ritter, G.; Zamarro, G. Understanding a vicious cycle: The relationship between student discipline and student academic outcomes. Educ. Res. 2019, 48, 251–262. [Google Scholar] [CrossRef]
  6. Anderson, M.; Gallagher, J.; Ramirez Ritchie, E. School meal quality and academic performance. J. Public Econ. 2018, 168, 81–93. [Google Scholar] [CrossRef]
  7. Anwar, F. Activity-based teaching, student motivation and academic achievement. J. Educ. Educ. Dev. 2019, 6, 154–170. [Google Scholar] [CrossRef]
  8. Arthur, Y.D.; Dogbe CS, K.; Asiedu-Addo, S.K. Enhancing Performance in Mathematics Through Motivation, Peer Assisted Learning, And Teaching Quality: The Mediating Role of Student Interest. Eurasia J. Math. Sci. Technol. Educ. 2022, 18, em2072. [Google Scholar] [CrossRef]
  9. Boz, Y.; Yerdelen-Damar, S.; Belge-Can, H. Investigation of relations among middle school (junior high school) students’ gender, learning approaches, perceptions of learning environment and science achievement. İlköğretim Online 2018, 17, 1268–1282. [Google Scholar] [CrossRef]
  10. Burrows, T.; Goldman, S.; Olson, R.; Byrne, B.; Coventry, W. Associations between selected dietary behaviours and academic achievement: A study of Australian school aged children. Appetite 2017, 116, 372–380. [Google Scholar] [CrossRef]
  11. Camilli, G.; Dossey, J. Multidimensional national profiles for TIMSS 2007 and 2011 mathematics. J. Math. Behav. 2019, 55, 100693. [Google Scholar] [CrossRef]
  12. Chai, C. The importance of data cleaning: Three visualization examples. Chance 2020, 33, 4–9. [Google Scholar] [CrossRef]
  13. Correa-Burrows, P.; Burrows, R.; Blanco, E.; Reyes, M.; Gahagan, S. Nutritional quality of diet and academic performance in Chilean students. Bull. World Health Organ. 2016, 94, 185–192. [Google Scholar] [CrossRef]
  14. Daus, S.; Braeken, J. The sensitivity of TIMSS country rankings in science achievement to differences in opportunity to learn at classroom level. Large-Scale Assessements Educ. 2018, 6, 1. [Google Scholar] [CrossRef]
  15. Denner, J.; Valdes, O.; Dickson, D.; Laursen, B. Math interest and self-concept among latino/a students: Reciprocal influences across the transition to middle school. J. Adolesc. 2019, 75, 22–36. [Google Scholar] [CrossRef]
  16. Dindya, J. The Singaporean mathematics curriculum: Connections to TIMSS. In Proceedings of the Identities, Cultures and Learning Spaces: 29th Annual Conference of the Mathematics Education Research Group of Australasia Incorporated, Canberra, Australia, 1–5 July 2006. [Google Scholar]
  17. Dumuid, D.; Olds, T.; Martín-Fernández, J.; Lewis, L.; Cassidy, L.; Maher, C. Academic performance and lifestyle behaviors in Australian school children: A cluster analysis. Health Educ. Behav. 2017, 44, 918–927. [Google Scholar] [CrossRef]
  18. Eltanahy, M.; Forawi, S.; Mansour, N. Incorporating entrepreneurial practices into STEM education: Development of interdisciplinary E-STEM model in high school in the United Arab Emirates. Think. Ski. Creat. 2020, 37, 100697. [Google Scholar] [CrossRef]
  19. Evans, C.; Smokowski, P.; Rose, R.; Mercado, M.; Marshall, K. Cumulative bullying experiences, adolescent behavioral and mental health, and academic achievement: An integrative model of perpetration, victimization, and bystander behavior. J. Child Fam. Stud. 2018, 28, 2415–2428. [Google Scholar] [CrossRef]
  20. Foy, P.; Martin, M.O.; Mullis IV, S.; Yin, L.; Centurino, V.; Reynolds, K. Reviewing the TIMSS 2015 Achievement Item Statistics. In Methods and Procedures in TIMSS 2015; Martin, M.O., Mullis, I.V.S., Hooper, M., Eds.; TIMSS & PIRLS International Study Center: Singapore, 2016; Chapter 11. [Google Scholar]
  21. George, A.; Robitzsch, A. Focusing on interactions between content and cognition: A new perspective on gender differences in mathematical sub-competencies. Appl. Meas. Educ. 2018, 31, 79–97. [Google Scholar] [CrossRef]
  22. Gietz, C.; McIntosh, K. Relations between student perceptions of their school environment and academic achievement. Can. J. Sch. Psychol. 2014, 29, 161–176. [Google Scholar] [CrossRef]
  23. Guay, F.; Stupnisky, R.; Boivin, M.; Japel, C.; Dionne, G. Teachers’ relatedness with students as a predictor of students’ intrinsic motivation, self-concept, and reading achievement. Early Child. Res. Q. 2019, 48, 215–225. [Google Scholar] [CrossRef]
  24. Haapala, E.; Eloranta, A.; Venäläinen, T.; Jalkanen, H.; Poikkeus, A.; Ahonen, T.; Lindi, V.; Lakka, T. Diet quality and academic achievement: A prospective study among primary school children. Eur. J. Nutr. 2017, 56, 2299–2308. [Google Scholar] [CrossRef]
  25. Han, F. Self-Concept and achievement in math among Australian primary students: Gender and culture issues. Front. Psychol. 2019, 10, 603. [Google Scholar] [CrossRef]
  26. Hayes, A.; Mansour, N. Confidence in Knowledge Base of English Language Learners Studying Science: Using Agency to Compensate for the Lack of Adequate Linguistic Identity. Res. Sci. Educ. 2017, 47, 353–371. [Google Scholar] [CrossRef]
  27. Hjorth, M.; Sørensen, L.; Andersen, R.; Dyssegaard, C.; Ritz, C.; Tetens, I.; Michaelsen, K.; Astrup, A.; Egelund, N.; Sjödin, A. Normal weight children have higher cognitive performance—Independent of physical activity, sleep, and diet. Physiol. Behav. 2016, 165, 398–404. [Google Scholar] [CrossRef]
  28. House, D.; Telese, J. Engagement in science lessons and achievement test scores of eighth-grade students in Korea: Findings from the TIMSS 2011 assessment. Educ. Is Prop. Proj. Innov. 2015, 135, 435–438. [Google Scholar]
  29. IEA. TIMSS. Trends in International Mathematics and Science Study. 2019. Available online: https://www.iea.nl/timss (accessed on 17 March 2021).
  30. IEA. TIMSS. TIMSS 2019 International Results in Mathematics and Science. 2022. Available online: https://timss2019.org/reports/achievement/ (accessed on 18 August 2022).
  31. Innabi, H.; Dodeen, H. Gender differences in mathematics achievement in Jordan: A differential item functioning analysis of the 2015 TIMSS. Sch. Sci. Math. 2018, 118, 127–137. [Google Scholar] [CrossRef]
  32. Institute for Objective Measurement. Plausible Values. 2020. Available online: https://www.rasch.org/rmt/rmt182c.htm (accessed on 9 May 2020).
  33. Kahveci, A.; Khaveci, M.; Mansour, N.; Alarfaj, M. Exploring science teachers’ affective states: Pedagogical discontentment, self-efficacy, intentions to reform, and their relationships. Res. Sci. Educ. 2018, 48, 1359–1386. [Google Scholar] [CrossRef]
  34. Kisfalusi, D. Bullies and victims in primary schools. Intersections 2018, 4, 133–158. [Google Scholar] [CrossRef]
  35. Kurdi, V.; Archambault, I.; Brière, F.; Turgeon, L. Need-supportive teaching practices and student-perceived need fulfillment in low socioeconomic status elementary schools: The moderating effect of anxiety and academic achievement. Learn. Individ. Differ. 2018, 65, 218–229. [Google Scholar] [CrossRef]
  36. Lacey, A.; Cornell, D.; Konold, T. The relations between teasing and bullying and middle school standardized exam performance. J. Early Adolesc. 2017, 37, 192–221. [Google Scholar] [CrossRef]
  37. Au, L.; Rosen, N.; Fenton, K.; Hecht, K.; Ritchie, L. Eating school lunch is associated with higher diet quality among elementary school students. J. Acad. Nutr. Diet. 2016, 116, 1817–1824. [Google Scholar] [CrossRef] [PubMed]
  38. Lay, Y.; Chandrasegaran, A. Availability of school resources and TIMSS grade 8 students’ science achievement: A comparative study between Malaysia and Singapore. Int. J. Environ. Sci. 2016, 11, 3065–3080. [Google Scholar]
  39. Lay, Y. The predictive effects of motivation toward learning science on TIMSS grade 8 students’ science achievement: A comparative study between Malaysia and Singapore. Eurasia J. Math. Sci. Technol. Educ. 2016, 12, 2949–2959. [Google Scholar] [CrossRef]
  40. Lay, Y.; Ng, K.; Chong, P. Analyzing affective factors related to eighth grade learners’ science and mathematics achievement in TIMSS 2007. Asia-Pac. Educ. Res. 2015, 24, 103–110. [Google Scholar] [CrossRef]
  41. Lei, H.; Cui, Y.; Zhou, W. Relationships between student engagement and academic achievement: A meta-analysis. Soc. Behav. Personal. Int. J. 2018, 46, 517–528. [Google Scholar] [CrossRef]
  42. Li, Q.; Cho, H.; Cosso, J.; Maeda, Y. Relations Between Students’ Mathematics Anxiety and Motivation to Learn Mathematics: A Meta-Analysis. Educ. Psychol. Rev. 2021, 33, 1017–1049. [Google Scholar] [CrossRef]
  43. Lim, L.; Lim, S.H.; Lim, W.Y.R.A. Rasch Analysis of Students’ Academic Motivation toward Mathematics in an Adaptive Learning System. Behav. Sci. 2022, 12, 244. [Google Scholar] [CrossRef]
  44. Liou, P.; Bulut, O. The effects of item format and cognitive domain on students’ science performance in TIMSS 2011. Res. Sci. Educ. 2017, 50, 99–121. [Google Scholar] [CrossRef]
  45. Liou, P. Profiles of adolescents’ motivational beliefs in science learning and science achievement in 26 countries: Results from TIMSS 2011 data. Int. J. Educ. Res. 2017, 81, 83–96. [Google Scholar] [CrossRef]
  46. Littledyke, M. Science education for environmental awareness: Approaches to integrating cognitive and affective domains. Environ. Educ. Res. 2008, 14, 254–268. [Google Scholar] [CrossRef]
  47. Long, M.; Wood, C.; Littleton, K.; Passenger, T.; Sheehy, K. The Psychology of Education, 2nd ed.; Taylor & Francis: Oxford, UK, 2011. [Google Scholar]
  48. Mansour, N. The representation of scientific literacy in Egyptian science textbooks. J. Sci. Educ. 2010, 11, 91–95. [Google Scholar]
  49. Mansour, N. Modelling the Sociocultural Contexts of Science Education: The Teachers’ Perspective. Res. Sci. Educ. 2013, 43, 347–369. [Google Scholar] [CrossRef]
  50. Mansour, N. Consistencies and inconsistencies between science teachers’ beliefs and practices. Int. J. Sci. Educ. 2013, 17, 1230–1275. [Google Scholar] [CrossRef]
  51. Mansour, N. The dissonance between scientific evidence, diversity and dialogic pedagogy in the science classroom. Int. J. Sci. Educ. 2020, 42, 190–217. [Google Scholar] [CrossRef]
  52. Mansour, N.; EL-Deghaidy, H.; Alshamrani, S.; Aldahmash, A. Rethinking the theory and practice of continuing professional development: Science teachers’ perspectives. Res. Sci. Educ. 2014, 44, 949–973. [Google Scholar] [CrossRef]
  53. Martin, M.; Mullis, I.; Foy, P. TIMSS 2015 assessment design. In TIMSS 2015 Assessment Frameworks; Mullis, I., Martin, M., Eds.; TIMSS & PIRLS International Study Center: Boston, MA, USA, 2013; Chapter 13. [Google Scholar]
  54. McIsaac, J.; Kirk, S.; Kuhle, S. The association between health behaviours and academic performance in Canadian elementary school students: A cross-sectional study. Int. J. Environ. Res. Public Health 2015, 12, 14857–14871. [Google Scholar] [CrossRef]
  55. Mcleod, S. Concrete Operational Stage Simply Psychology. 2010. Available online: http://www.simplypsychology.org/concrete-operational.html (accessed on 22 March 2019).
  56. Meinck, S.; Brese, F. Trends in gender gaps: Using 20 years of evidence from TIMSS. Large-Scale Assess. Educ. 2019, 7, 8. [Google Scholar] [CrossRef]
  57. Mills, J.; Holloway, C. The development of statistical literacy skills in the eighth grade: Exploring the TIMSS data to evaluate student achievement and teacher characteristics in the United States. Educ. Res. Eval. 2013, 19, 323–345. [Google Scholar] [CrossRef]
  58. Mills Jamie, D.; Marsha ESimon, M. Exploring eighth-grade minority and female students’ statistical literacy skills using TIMSS: Do differences exist? Middle Grades Res. J. 2015, 10, 3. Available online: https://go.gale.com/ps/i.do?p=AONE&u=anon~4c5ddf93&id=GALE|A457228633&v=2.1&it=r&sid=googleScholar&asid=681e049a (accessed on 2 September 2022).
  59. Miscevic-Kadijevic, G. TIMSS 2011: Relationship between Self-Confidence and Cognitive Achievement for Serbia and Slovenia. Rev. Electrónica De Investig. Educ. 2015, 17, 109–115. [Google Scholar]
  60. Mohammadpour, E.; Shekarchizadeh, A.; Kalantarrashidi, S. Multilevel modeling of science achievement in the TIMSS participating countries. J. Educ. Res. 2015, 108, 449–464. [Google Scholar] [CrossRef]
  61. Moreira, P.; Dias, A.; Matias, C.; Castro, J.; Gaspar, T.; Oliveira, J. School effects on students’ engagement with school: Academic performance moderates the effect of school support for learning on students’ engagement. Learn. Individ. Differ. 2018, 67, 67–77. [Google Scholar] [CrossRef]
  62. Mullis IV, S.; Martin, M.O.; Goh, S.; Cotter, K. TIMSS 2015 Encyclopedia: Education Policy and Curriculum in Mathematics and Science; TIMSS & PIRLS International Study Center: Boston, MA, USA, 2016. [Google Scholar]
  63. Murphy, C.; Abu-Tineh, A.; Calder, N.; Mansour, N. Teachers and students’ views prior to introducing inquiry-based learning in Qatari science and mathematics classrooms. Teach. Teach. Educ. 2021, 104, 103367. [Google Scholar] [CrossRef]
  64. Ni, Y.; Zhou, D.; Cai, J.; Li, X.; Li, Q.; Sun, I. Improving cognitive and affective learning outcomes of students through mathematics instructional tasks of high cognitive demand. J. Educ. Res. 2018, 111, 704–719. [Google Scholar] [CrossRef]
  65. Northey, G.; Govind, R.; Bucic, T.; Chylinski, M.; Dolan, R.; van Esch, P. The effect of “here and now” learning on student engagement and academic achievement. Br. J. Educ. Technol. 2018, 49, 321–333. [Google Scholar] [CrossRef] [Green Version]
  66. Orlich, D.; Harder, R.; Brown, A.; Trevisan, M.; Miller, D. Teaching Strategies: A Guide to Effective Instruction, 9th ed.; Cengage Learning: Boston, MA, USA, 2010. [Google Scholar]
  67. Pavešić, B.; Cankar, G. Linking mathematics TIMSS achievement with national examination scores and school marks: Unexpected gender differences in Slovenia. Orb. Sch. 2019, 12, 77–100. [Google Scholar] [CrossRef]
  68. Peduk, B.; Ates, O. Analysis of the science course curriculum objectives and high school entrance examination questions according to TIMSS framework. Int. J. Educ. Methodol. 2019, 5, 434–449. [Google Scholar] [CrossRef]
  69. Perše, T.; Kozina, A.; Leban, T. Negative school factors and their influence on math and science achievement in TIMSS 2003. Educ. Stud. 2011, 37, 265–276. [Google Scholar] [CrossRef]
  70. Piaget, J.; Cook, M. The Origins of Intelligence in Children, 3rd ed.; International Universities Press: New York, NY, USA, 1965. [Google Scholar]
  71. Prast, E.; Van de Weijer-Bergsma, E.; Miočević, M.; Kroesbergen, E.; Van Luit, J. Relations between mathematics achievement and motivation in students of diverse achievement levels. Contemp. Educ. Psychol. 2018, 55, 84–96. [Google Scholar] [CrossRef]
  72. Rutkowski, L.; Gonzalez, E.; Joncas, M.; von Davier, M. International large-scale assessment data. Educ. Res. 2010, 39, 142–151. [Google Scholar] [CrossRef]
  73. Sahin, M.; Ozturk, N. How classroom assessment affects science and mathematics achievement: Findings from TIMSS 2015. Int. Electron. J. Elem. Educ. 2018, 10, 559–569. [Google Scholar] [CrossRef]
  74. Seaton, M.; Parker, P.; Marsh, H.; Craven, R.; Yeung, A. The reciprocal relations between self-concept, motivation and achievement: Juxtaposing academic self-concept and achievement goal orientations for mathematics success. Educ. Psychol. 2014, 34, 49–72. [Google Scholar] [CrossRef]
  75. Sewasew, D.; Schroeders, U. The developmental interplay of academic self-concept and achievement within and across domains among primary school students. Contemp. Educ. Psychol. 2019, 58, 204–212. [Google Scholar] [CrossRef]
  76. Sikhakhane, H.; Muthukrishna, N.; Martin, M. The geographies of bullying in a secondary school context. S. Afr. J. Educ. 2018, 38, s1–s11. [Google Scholar] [CrossRef]
  77. Slavin, R.E. A model of effective instruction. Educ. Forum 1995, 59, 166–176. [Google Scholar] [CrossRef]
  78. STATA. Structural Equation Modeling (SEM)|Stata. 2022. Available online: https://www.stata.com/features/structural-equation-modeling/ (accessed on 18 August 2022).
  79. Statistics Solution. Missing Values in Data—Statistics Solutions. 2020. Available online: https://www.statisticssolutions.com/missing-values-in-data/ (accessed on 9 May 2020).
  80. Stewart, C.; Root, M.; Koriakin, T.; Choi, D.; Luria, S.; Bray, M.; Sassu, K.; Maykel, C.; O’Rourke, P.; Courville, T. Biological gender differences in students’ errors on mathematics achievement tests. J. Psychoeduc. Assess. 2017, 35, 47–56. [Google Scholar] [CrossRef]
  81. Strøm, I.; Thoresen, S.; Wentzel-Larsen, T.; Dyb, G. Violence, bullying and academic achievement: A study of 15-year-old adolescents and their school environment. Child Abus. Negl. 2013, 37, 243–251. [Google Scholar] [CrossRef]
  82. Stumm, S. Socioeconomic status amplifies the achievement gap throughout compulsory education independent of intelligence. Intelligence 2017, 60, 57–62. [Google Scholar] [CrossRef]
  83. Sulak, T. School climate and academic achievement in suburban schools. Educ. Urban Soc. 2016, 48, 672–684. [Google Scholar] [CrossRef]
  84. Tavsancil, E.; Yalcin, S. A determination of Turkish student’s achievement using hierarchical linear models in trends in international mathematics-science study (TIMSS) 2011. Anthropologist 2015, 22, 390–396. [Google Scholar] [CrossRef]
  85. UAE Government. Raising the Standard of Education. 2019. Available online: https://government.ae/en/about-the-uae/leaving-no-one-behind/4qualityeducation/raising-the-standard-of-education (accessed on 22 July 2019).
Figure 1. TIMSS curriculum model (from Mullis [45] (p. 5)).
Figure 1. TIMSS curriculum model (from Mullis [45] (p. 5)).
Education 12 00618 g001
Figure 2. SEM model for student factors with the content domain of mathematics.
Figure 2. SEM model for student factors with the content domain of mathematics.
Education 12 00618 g002
Figure 3. SEM model for student factors with the cognitive domain of mathematics.
Figure 3. SEM model for student factors with the cognitive domain of mathematics.
Education 12 00618 g003
Figure 4. SEM model for student factors with the content domains of science.
Figure 4. SEM model for student factors with the content domains of science.
Education 12 00618 g004
Figure 5. SEM model for student factors with the cognitive domains of science.
Figure 5. SEM model for student factors with the cognitive domains of science.
Education 12 00618 g005
Table 1. Percentages of the TIMSS 2015 assessment items for the content and cognitive domains (Mullis and Martin [45]).
Table 1. Percentages of the TIMSS 2015 assessment items for the content and cognitive domains (Mullis and Martin [45]).
Content Domains of MathematicsPercentages Content Domains of SciencePercentagesCognitive DomainsPercentages
Number50%Life Science45%Knowing40%
Geometry35%Physical Science35%Applying40%
Data Display15%Earth Science20%Reasoning20%
Table 2. Selected variables of the student factors.
Table 2. Selected variables of the student factors.
Selected Variables (TIMSS Index)Number of ItemsExamples (TIMSS Index)
Student bullying (ASDGSB)8Someone spread lies about me (ASBG12C)
Engaging teaching in Mathematics Lessons (ASDGEML)10My teachers show me how to do better (ASBM02I)
Like learning mathematics (ASDGSLM)9I enjoy learning mathematics (ASBM01A)
Student confidence in mathematics (ASDGSCM)9I usually do well in math (ASBM03A)
Engaging teaching in science lessons (ASDGESL)10I am interested in what my teacher says (ASBS05C)
Like learning science (ASDGSLS)9Enjoy learning science (ASBS04A)
Student confidence in science (ASDGSCS)7I usually do well in science (ASBM03A)
Other variables of interest with no group
Gender (ASBG01)
Breakfast on School Days (ASBG09)
Table 3. Descriptive statistics of the student factors.
Table 3. Descriptive statistics of the student factors.
VariableMSD
Bullying1.840.82
Like learning mathematics2.440.68
Like learning science2.560.62
Student confident in mathematics2.110.71
Student confident in science2.240.73
Engagement in mathematics lessons2.630.59
Engagement in science lessons2.680.57
Breakfast on school days3.271.03
Gender0.490.50
Table 4. Regression analysis results of the student factors with mathematics achievement.
Table 4. Regression analysis results of the student factors with mathematics achievement.
PredictorbSEtp
Gender−1.413.82−0.370.71
Breakfast on school days2.52 *0.912.750.01
Bullying−13.10 ***1.60−8.20<0.001
Like learning math−5.13 *2.36−2.180.033
Engaging teaching in mathematics lessons11.5 ***2.644.35<0.001
Student confident in mathematics41.07 ***1.8122.66<0.001
Intercept369.75 ***8.1245.52<0.001
R20.12
* significant at the 0.05 level, *** significant at the 0.001 level.
Table 5. Regression analysis results of student factors with science achievement.
Table 5. Regression analysis results of student factors with science achievement.
PredictorbSEtp
Gender2.834.160.680.50
Breakfast on school days2.20 *1.012.190.032
Bullying−16.69 ***1.80−9.26<0.001
Like learning science21.57 ***2.339.26<0.001
Engaging Teaching in science lessons0.322.780.120.91
Student confidence in science43.40 ***1.9722.01<0.001
Intercept327.37 ***10.0132.72<0.001
R20.16
* significant at the 0.05 level, *** significant at the 0.001 level.
Table 6. SEM analysis of the student factors model with the mathematics content domain.
Table 6. SEM analysis of the student factors model with the mathematics content domain.
ModelCoefficientp
Model with Data Display
Gender2.54 *0.047
Breakfast on school days2.06 **0.001
Bullying−15.09 ***<0.001
Like learning mathematics−4.05 **0.001
Engaging teaching in mathematics lessons16.10 ***<0.001
Student confident in mathematics41.62 ***<0.001
Model with Geometry
Gender3.58 **0.005
Breakfast on school days3.15 ***<0.001
Bullying−12.11 ***<0.001
Like learning mathematics−7.27 ***<0.001
Engaging teaching in mathematics lessons9.72 ***<0.001
Student confident in mathematics40.05 ***<0.001
Model with Number
Gender−4.48 ***<0.001
Breakfast on school days2.23 ***<0.001
Bullying−11.97 ***<0.001
Like learning mathematics−4.29 ***<0.001
Engaging teaching in mathematics lessons9.33 ***<0.001
Student confident in mathematics42.54 ***<0.001
Model Fit
SRMR0.42
CD0.30
* significant at the 0.05 level, ** significant at the 0.01 level, *** significant at the 0.001 level.
Table 7. SEM analysis of student factors with the cognitive domains of mathematics.
Table 7. SEM analysis of student factors with the cognitive domains of mathematics.
ModelCoefficientp
Model with Knowing
Gender−3.090.075
Breakfast on school days3.38 ***<0.001
Bullying−13.82 ***<0.001
Like learning mathematics−7.60 ***<0.001
Engaging teaching in mathematics lessons16.49 ***<0.001
Student confident in mathematics45.59 ***<0.001
Model with Applying
Gender−3.78 *0.025
Breakfast on school days3.64 ***<0.001
Bullying−13.67 **<0.001
Like learning mathematics−7.89 ***<0.001
Engaging teaching in mathematics lessons13.22 ***<0.001
Student confident in mathematics43.34 ***<0.001
Model with Reasoning
Gender0.0850.959
Breakfast on school days3.20 ***<0.001
Bullying−13.68 ***<0.001
Like learning mathematics−7.99 ***<0.001
Engaging teaching in mathematics lessons12.72 ***<0.001
Student confident in mathematics43.85 ***<0.001
Model Fit
SRMR0.43
CD0.34
* significant at the 0.05 level, ** significant at the 0.01 level, *** significant at the 0.001 level.
Table 8. SEM analysis for student factors with content domains of science.
Table 8. SEM analysis for student factors with content domains of science.
ModelCoefficientp
Model with Earth Science
Gender−3.24 *0.015
Breakfast on school days2.05 ***<0.001
Bullying−15.03 **0.002
Like learning science19.20 ***<0.001
Engaging teaching in science lessons0.390.806
Student confident in science44.22 ***<0.001
Model with Life Science
Gender6.63 ***<0.001
Breakfast on school days2.04 **0.003
Bullying−16.74 ***<0.001
Like learning science22.614 ***<0.001
Engaging teaching in science lessons−1.410.382
Student confident in science45.13 ***<0.001
Model with Physics
Gender−2.74 *0.041
Breakfast on school days2.02 **0.002
Bullying−16.70 ***<0.001
Like learning science20.01 ***<0.001
Engaging teaching in science lessons1.320.396
Student Confident in Science43.68 ***<0.001
Model Fit
SRMR0.40
CD0.39
* significant at the 0.05 level, ** significant at the 0.01 level, *** significant at the 0.001 level.
Table 9. SEM analysis for student factors with science cognitive domains.
Table 9. SEM analysis for student factors with science cognitive domains.
ModelCoefficientp
Model with Knowing
Gender−0.900.535
Breakfast on school days2.48 ***<0.001
Bullying−18.23 ***<0.001
Like learning science25.98 ***<0.001
Engaging teaching in science lessons1.780.292
Student confident in science46.29 ***<0.001
Model with Applying
Gender3.09 *0.02
Breakfast on school days1.45 *0.025
Bullying−16.07 ***<0.001
Like learning science21.50 ***<0.001
Engaging teaching in science lessons−1.230.433
Student confident in science42.66 ***<0.001
Model with Reasoning
Gender6.068 ***<0.001
Breakfast on school days3.32 ***<0.001
Bullying−14.29 ***<0.001
Like learning science17.94 ***<0.001
Engaging teaching in science lessons−3.58 *0.019
Student confident in science41.88 ***<0.001
Model Fit
SRMR0.41
CD0.39
* significant at the 0.05 level, *** significant at the 0.001 level.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Balfaqeeh, A.; Mansour, N.; Forawi, S. Factors Influencing Students’ Achievements in the Content and Cognitive Domains in TIMSS 4th Grade Science and Mathematics in the United Arab Emirates. Educ. Sci. 2022, 12, 618. https://doi.org/10.3390/educsci12090618

AMA Style

Balfaqeeh A, Mansour N, Forawi S. Factors Influencing Students’ Achievements in the Content and Cognitive Domains in TIMSS 4th Grade Science and Mathematics in the United Arab Emirates. Education Sciences. 2022; 12(9):618. https://doi.org/10.3390/educsci12090618

Chicago/Turabian Style

Balfaqeeh, Asma, Nasser Mansour, and Sufian Forawi. 2022. "Factors Influencing Students’ Achievements in the Content and Cognitive Domains in TIMSS 4th Grade Science and Mathematics in the United Arab Emirates" Education Sciences 12, no. 9: 618. https://doi.org/10.3390/educsci12090618

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop