Next Article in Journal
Arm Angle Tracking Control with Pole Balancing Using Equivalent Input Disturbance Rejection for a Rotational Inverted Pendulum
Next Article in Special Issue
A More Realistic Markov Process Model for Explaining the Disjunction Effect in One-Shot Prisoner’s Dilemma Game
Previous Article in Journal
Evolutionary Game of Multi-Subjects in Live Streaming and Governance Strategies Based on Social Preference Theory during the COVID-19 Pandemic
Previous Article in Special Issue
The Fear of Covid-19 Scale (FCV-19S) in Spain: Adaptation and Confirmatory Evidence of Construct and Concurrent Validity
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Impact of Secondary Education Choices on Mathematical Performance in University: The Role of Non-Cognitive Skills

1
Department of Economics and Statistics, University of Leon, 24007 Leon, Spain
2
Department of Applied Economics, University of Zaragoza, 50005 Zaragoza, Spain
3
Department of Education, Regional Government of Castilla and Leon, 24007 Leon, Spain
*
Author to whom correspondence should be addressed.
Mathematics 2021, 9(21), 2744; https://doi.org/10.3390/math9212744
Submission received: 31 July 2021 / Revised: 20 October 2021 / Accepted: 25 October 2021 / Published: 28 October 2021
(This article belongs to the Special Issue Quantitative Methods for Social Sciences)

Abstract

:
(1) Background: this study evaluates the most relevant factors affecting the performance in mathematics of university undergraduates. Precisely, the mathematical background of students. Spanish secondary education provides an opportunity to develop this analysis since students can choose between two secondary education tracks with different mathematical content and depth. (2) Methods: a survey was conducted covering personal characteristics, socioeconomic status, academic choices and academic achievement as well as a set of questions aimed to uncover attitudes towards mathematics. Students that show preferences regarding mathematics are prone to choose the track with more mathematical content, creating a potential confusion between training and attitudes towards mathematics. We propose an index of non- cognitive skills related to mathematics to account for this problem. (3) Results: prior background in mathematics plays a role in mathematical performance at university even after correcting for non-cognitive skills related to mathematics. The effects are heterogeneous with respect to gender. (4) Conclusions: choosing a more mathematical-oriented itinerary in secondary education seems to give an edge to students. Our results shed light on the implications associated with the decision of secondary school track choice made by students. Furthermore, they are meant to serve as a guide to improve the design of remedial courses.

1. Introduction

The objective of the present paper is to analyze the factors affecting results in mathematics. In particular, we draw on data from university undergraduate programs offered by the School of Business and Economics, Universidad de León (henceforth ULE), Spain. Precisely, we focus on the mathematical background of students when entering university.
This research relates to a large body of literature that analyses schooling using models and statistical methods of economic analysis such as the Educational Production Function [1,2,3]. In this kind of analysis, the output of schooling, measured as student’s performance, is a function of a set of inputs such as individual, family and school attributes. As a result, it is possible to measure how the effect on the student’s performance of policy variables such as school quality is affected by individual and family characteristics. A frequent finding is that the role of the policy variable diminishes substantially once individual and family characteristics are taken into account [4,5].
Previous empirical literature has focused on the student’s performance in mathematics [6,7,8] and student’s performance in university [9]. Of particular interest for our objective are studies analyzing performance on degrees related to Business and Economics [10,11,12,13,14,15]. In these papers, the mathematical background of students is included as an explanatory variable of student’s performance. This approach is interesting from a policy angle since mathematical background could be modified by changes in secondary education but also by remedial courses at university [11,12]. The effects of mathematical background on the student’s performance are analyzed using a survey on the student’s views [15], a natural experiment [12] and administrative (non- experimental) data [13,14]. They all find evidence of a substantial positive effect of the student’s mathematical background on performance at the university level.
Non-experimental data (administrative or survey data) are almost the norm in social science. In this setting, the Spanish secondary education provides an opportunity to analyze the effects of mathematical background using non-experimental data. In Spain, Students can choose among two upper secondary school tracks with different mathematical content and depth; namely, the Social Science (SS) or Science and Technology (ST) track. Therefore, it is possible to compare the performance of two groups of students with different mathematical backgrounds [13].
On the other hand, it is reasonable to expect that non-cognitive skills affect the performance in achievement tests, in general [16,17,18], and results in mathematics, in particular [19]. Therefore, the analysis is likely to be affected by self-selection bias [20,21], thus conditioning the choice of the upper secondary school track in our set up, generating a potential confusion between more training in secondary education and a particular attitude towards mathematics. Concerns about the possibility that students self-select into the ST track together with the size and direction of the estimation bias created by the self-selection problem have been discussed in the literature related to this study [13].
In this paper, we aim to mitigate the self-selection bias described above by including an index on attitudes and feelings towards mathematics. A proxy for the student’s attitudes towards mathematics has been used to analyze the performance of finance students [22]. In this regard, we conducted a more elaborated survey on math attitudes and propose an index that aggregates the information in the survey [23].
Our study contributes to this literature by combining the most significant characteristics of the aforementioned approaches. On the one hand, we follow the standard approach in the literature applying an Educational Production Function, which controls for the most important observable characteristics at this stage of the academic career. On the other hand, our methodology allows us to account for individual unobserved heterogeneity associated with non-cognitive skills, thus reducing potential selection bias issues. Finally, we further examine the heterogeneity of our results in the context of gender-specific characteristics.

2. Materials and Methods

This section contains a description of the survey, the Index of Non-Cognitive Mathematical Skills proposed in the paper and the empirical model estimated.

2.1. Description of the Survey

The subjects of the survey are students at the school of Business and Economics at ULE in Northwestern Spain. Precisely, first-year students enrolled in four-year degrees in Business, Finance, International Trade and Marketing. The university also offers a Degree in Economics with similar mathematical content in the first year. However, we decided to exclude students enrolled in this degree from the analysis since the grades were much lower than in the other degrees. In our analysis, we consider five groups of students. Precisely, three groups composed of students enrolled in degrees in Finance, International Trade and Marketing, respectively, and two groups of students enrolled in the degree in Business attending morning and afternoon classes, respectively.
All students are required to take mathematics in their first semester at university. The survey was given in the classroom, right before a lecture on Economics, at the beginning of the second semester. The number of students registered for the class in Economics (potential participants in the survey), the number of participants in the survey and the participation rate are shown in Table 1.
The questions in the survey cover personal characteristics, socioeconomic status, academic choices and academic results both in Secondary Education and University. See Appendix A for the questions of the survey. Of particular importance, it is a set of questions aimed to uncover feelings about mathematical work and perceptions of their own mathematical skills [24].
A control group of 10 third-year students was surveyed a few days in advance. The objective of distributing the survey to the control group was to uncover issues in the survey that could be spotted only at the time of answering the questions. Respondents in the control group made minor comments on the original wording of a few questions and were able to answer all the questions in ten minutes. As a result, we edited those questions in order to address the students’ comments and decided to allocate fifteen minutes to answer the survey.

2.2. A Proposal for an Index of Non-Cognitive Skills Related to Mathematics

We propose an index of non-cognitive skills related to mathematics, which come close to the concept of emotional intelligence (EI). Our measure is evaluated by using rating scales, which requires test-takers to rate their agreement with a series of statements about themselves in order to assess self-rated ability. There is evidence of a relationship between academic performance and EI measured by means of rating scales [18]. Therefore, we asked students to declare their degree of agreement with 15 statements describing their feelings about mathematical work and perceptions of their own mathematical skills [24] (see Appendix A). There are four degrees of agreement: Not at All, Slightly, Quite and A lot coded with integers ranging from 1 to 4.
We propose to use the following measure of non-cognitive skills. First, we run the regression of the value of the item I am good at Mathematics against all other 14 items:
z 1 i = a 1 + j = 2 15 a j z j i + w i
where the index i denotes individuals in the sample, z1i is the value of the item “I am good at Mathematics”, zji (j = 2,…,15) are the values of the other items, aj (j = 2,…,15) are coefficients to be estimated and wi is a random disturbance.
Second, after estimating Equation (1) by OLS, we use the fitted values of the regression z ^ 1 i as a measure of non-cognitive skills related to mathematics. We choose the degree of agreement with the statement I am good at Mathematics as a focal point since it is reasonable to expect a positive correlation of the agreement with this statement and non-cognitive skills related to Mathematics. However, we are aware that self-assessment of any item in the survey could be subjected to a whole set of upward and downward bias. Therefore, we try to reduce self-reporting bias by combining in a single index the information provided by students about their attitudes towards mathematics in the 15 items of the survey. For that purpose, we propose z ^ 1 as an index that aggregates the information in 14 items of the survey using as weights the partial correlation of such 14 items with the item I am good at Mathematics. Our choice of z ^ 1 is related to the well-known result that the fitted value of a regression equation is the best linear predictor of a variable (“I am good at Mathematics”) for given values of other correlated variables (other items in the survey) [25].

2.3. Empirical Model

The empirical model analyses the linear effect of a set of explanatory variables on grades in mathematics in the first semester of university:
m i = α 0 + α 1 T i + α 2 A i + j = 1 k β j x j i + u i
where mi is the grade in math of student i, Ti is a binary variable that takes the value 0 if a student chooses the SS track in upper secondary education and 1 if the student chooses the ST track, Ai is the index of non-cognitive skills defined above, xij denotes k control variables, ui is a random disturbance term with the usual properties and the α’s and β’s are parameters to estimate.
The key parameters for the objective of the present paper are α1 and α2. Since Ti is a binary variable, α1 can be written as:
α 1 = E [ m i | T i = 1 ] E [ m i | T i = 0 ]
In other words, α1 measures the difference in the expected grade in mathematics between a student who chooses the ST track (Ti = 1) and a student who chooses the SS track (Ti = 0) while all other explanatory variables are kept constant. In turn, α2 measures the effect on the average grade in mathematics of increasing 1 unit the index of non-cognitive skills while other variables are kept constant. In order to have a more intuitive interpretation of α2, we use the standardized value of z ^ 1 as the index of non-cognitive skills Ai. As a result, α2 can be interpreted as the effect of increasing non-cognitive skills by one standard deviation on the grade in mathematics.
Finally, we are aware of the ex-post nature of the proposed non-cognitive skills measure. In this regard, we interpret the index as a proxy control [25]. Therefore, the inclusion of the index, although affected by schooling, will partially control for (unobservable) non-cognitive factors. Thus, helping to mitigate the potential student’s self-selection issues. Furthermore, considering that the association between schooling and “late” non-cognitive skills is positive, the inclusion of our index will underestimate α 1 , thus setting a lower bound of the true effect.

3. Results

3.1. Index of Non-Cognitive Skills Related to Mathematics

In this section, we show the estimation results associated to the index of non-cognitive skills in Equation (1). First, we present the coefficient estimates of Equation (1) that relate the item I am good at Mathematics with the rest of the items that evaluate non-cognitive skills.
The coefficients significantly different from zero have the expected sign. The items, my mind is well suited to mathematics, I find mathematics to be easy and I feel that I have talent for solving mathematical problems have a positive coefficient meaning that each one has a positive correlation with I am good at mathematics keeping all other variables constant.
As it was discussed in Section 2.1, we use as an index of non-cognitive skills the fitted value of the item I am good at mathematics provided by the coefficients shown in the linear regression in Table 2. This predicted value uses the partial correlations measured by the regression coefficients as weights to aggregate the different items measuring non-cognitive skills. We use the standardized value of the index.

3.2. Descriptive Statistics of Participants

In Table 3, we provide sample statistics of the variables used in the empirical analysis, including the standardized index of non-cognitive skills computed above.
Grades in the Spanish education system are on a 0 to 10 scale. In Table 3, the average grade in mathematics is above the threshold passing grade of 5. In turn, the averages of the binary variables show that females make up 55% of participants while 20% of participants chose the ST track in their upper secondary education.
The last row of the table shows the descriptive statistics of the index of non-cognitive skills. The minimum and maximum values suggest that the sample distribution is slightly skewed to the right. In other words, most students have more than average non-cognitive skills related to mathematics.
In Table 4 above, we show the mean values of grades and non-cognitive skills stratified by gender, upper secondary education track and university degree. We show as well the value of an F test of differences in means (ANOVA) and the probability that a variable following an F distribution is greater than the value of the F test.
Average grades in mathematics are higher for females and the difference is significantly different from zero at the 5% confidence level. In turn, the index of non-cognitive skills is around one-tenth of a standard deviation higher for males than for females. In this case, the difference is not significantly different from zero at conventional levels of confidence.
Average grades in mathematics are substantially higher for students who chose the ST track in upper secondary education. As expected, students who chose the technical track in high school have a substantially higher average value of the index of non-cognitive skills and the difference is significantly different from zero at the 1% confidence level.
The average grade in mathematics ranges from 4.70 in International Trade to 5.74 in Business 2. The null hypothesis of mean equality across degrees is not rejected at conventional levels of confidence against the alternative that the mean is different in at least one degree. Finally, the average index of non-cognitive skills ranges from −0.44 in Marketing to 0.27 in Finance. In this case, the null hypothesis of mean equality across degrees is rejected at the 5% confidence level against the alternative that the mean is different in at least one degree.

3.3. Estimates of the Empirical Model

In Table 5, we show the estimates of the coefficients of three versions of the linear model in Equation (2). The model estimates the linear effect of the upper secondary education track and non-cognitive skills on the grades in mathematics. We estimate the model with two sets of control variables. The first set contains only the binary variables that indicate the degree in which the student is enrolled and gender (shown in Column 1), while the second set includes all control variables (shown in Columns 2, 3 and 4). See Appendix B for the full list of control variables. Among all control variables, we chose to show only the coefficient of the variable sex due to its size and significance. Furthermore, in order to analyze the impact on grades of non-cognitive skills by gender, we also report the estimated coefficients of Equation (2) augmented with the interaction between sex and non-cognitive skills (shown in Column 4). The estimates of all the coefficients are shown in Appendix C.
The first and second columns of Table 5 contain the estimates of the coefficients of the model in (2) without the index of non-cognitive skills. The results of the first two columns can be summarised using the two following equations:
G r a d e M a t h = 0.754 S e x + 1.246 T r a c k + D e g r e e C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
G r a d e M a t h = 0.631 S E X + 1.341 T R A C K + A l l C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
In both cases, the coefficient of TRACK provides a gross measure of the effect of studying the ST track on grades in mathematics. In other words, a measure of the effect of studying the ST track that disregards the fact that students who choose the ST track have, on average, a higher level of non-cognitive skills. The differences between the estimates in the first and second equations stem from the number of control variables included in the estimation.
The first equation shows the estimates of the model in (2) when only the five binary variables of degree and the binary variable SEX are included. In this case, the estimates show that, on average, the grade of a female student is 0.75 points higher than the grade of her male counterpart. In turn, choosing the ST track increases the grade in mathematics 1.24 points with respect to a student choosing the SS pathway. The estimates of the same model after including all the control variables are shown in the second equation. The estimates change moderately when adding family and academic characteristics as control variables. Precisely, the coefficient of the variable SEX decreases while the coefficient of the variable TRACK increases.
At any rate, after including all control variables, we find a substantial and significantly different from zero gross effect of studying the ST track in upper secondary education; in particular, an increase of 1.34 points associated with the choice of the ST track.
In the third column of Table 5, we show the estimates obtained when the index of non-cognitive skills is included as an explanatory variable. The results in the third column can be represented by the following equation:
G r a d e M a t h = 0.593 S E X + 0.643 T R A C K + 0.831 N O N C O G N I T I V E + A l l C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
In this case, the effect on grades of choosing the ST track decreases considerably. Now, choosing the ST track increases the grade in mathematics 0.64 points. In turn, a change of a standard deviation in non-cognitive skills increases the grade in mathematics by 0.83.
These results provide substantial evidence on the role played by mathematical background on university results and its relationship with non-cognitive skills. As expected, the results show that more mathematical background (namely, to choose the ST track) increases the grades in mathematics at university. However, the coefficients in the third column of Table 5 show how a sizeable portion of that increase is due to the superior non-cognitive skills of the students who choose the itinerary with more mathematical training. In the fourth column of Table 5, we show coefficient estimates after the inclusion of the interaction between the variables SEX and NON-COGNITIVE. The results in the fourth column can be represented by the following equation:
G r a d e M a t h = 0.593 S E X + 0.653 T R A C K + 1.019 N O N C O G N I T I V E 0.308 S E X × N O N C O G N I T I V E + A l l C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
The negative sign of the interaction indicates that non-cognitive skills are rather less important for females in determining math grades, although it is not statistically significant.
The coefficient of the gender indicator is shown among all other control variables because it is quite large and significantly different from zero. In fact, such a large effect of the control variable SEX led us to estimate the model separately for male and female students. This result is related to recent research showing that gender affects math performance both directly and through the choice of itinerary in secondary education [26].
We show the estimates of the gender specific regressions in Table 6.
The coefficients were estimated with all control variables. We choose to show only the coefficients of the variables TRACK and NON-COGNITIVE. The coefficients of all control variables are shown in Appendix C.
The results by gender without the index of non-cognitive skills (first and third column in Table 6) can be summarized using the following equations:
G r a d e M a t h M a l e = 1.188 T R A C K + A l l C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
G r a d e M a t h F e m a l e = 1.476 T R A C K + A l l C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
The coefficient of TRACK for females (1.476) is larger than for males (1.188). In other words, the gross effect on grades of choosing the ST track is larger for female students.
The results by gender with the index of non-cognitive skills (second and fourth column in Table 6) can be summarized using the following equations:
G r a d e M a t h M a l e = 0.577 T R A C K + 1.161 N O N C O G N I T I V E + A l l C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
G r a d e M a t h F e m a l e = 0.700 T R A C K + 0.664 N O N C O G N I T I V E + A l l C o n t r o l V a r i a b l e s + R a n d o m D i s t u r b a n c e
The inclusion of the index of non-cognitive skills as an explanatory variable produces noticeable changes in the estimates of the coefficients. On the one hand, the coefficient of TRACK decreases for both male and female students. This is an expected result similar to the one in Table 5. On the other hand, the coefficient of non-cognitive skills is almost twice as large for males. Moreover, those students with more non-cognitive skills, who tend to choose the ST, which in turn includes more mathematical content, obtain higher grades, indicating that non-cognitive skills are the mechanism through which tracking affects math grades. In particular, this effect is much stronger for male students.
Finally, we test the hypothesis that students self-select into the ST on the basis of non-cognitive skills. In Table 7, we show the estimates of two coefficients (SEX and NON-COGNITIVE) of a Probit model of the choice of the secondary education track. The coefficients of all control variables are shown in Appendix C. Clearly, non-cognitive skills increase the probability of choosing the ST track. Furthermore, female students are more likely to choose the SS pathway.

3.4. Robustness Checks

We further examine the robustness of our results using Principal Component Analysis with Varimax (orthogonal) rotation (PCA) by means of exploiting all the information included in the survey regarding attitudes and feelings towards mathematics (see Appendix A). Recall that our Index of Non-Cognitive Mathematical Skills basically includes information regarding statistically significant coefficients shown in Table 2. PCA allows us to generate three new items: self-assessment of mathematical capacity (F1), positive attitudes towards mathematics (F2) and negative attitudes towards mathematics (F3). Note that higher values of F3 imply that the negative attitude towards mathematics is weaker. These variables measure how eager and motivated students are to learn mathematics. Basically, F1 replicates the information contained in the Index of Non-Cognitive Mathematical Skills presented above, whereas F2 and F3 cover a broader range of non-cognitive skills towards mathematics.
Table 8 shows regression results when we replicate the specification presented in the last column of Table 5 using the variables generated by PCA instead of the Index of Non-Cognitive Skills discussed above. The main findings of the paper are congruent with the analysis of non-cognitive skills using PCA. The regression estimates using F1 as an explanatory variable are strikingly similar to the ones obtained using our proposed index on non-cognitive skills. The use of F2 and F3 as explanatory variables lead to an increase in the effect of the secondary education track to the point that, with the F3 item as an explanatory variable, the effect of the secondary education track is close in value to the gross effect reported in Table 5 (without controlling for non-cognitive skills). Hence, we show consistency with the results reported in the previous section, and therefore robustness regardless of the methodological approach used to carry out the analysis.

4. Discussion

In this paper, we find that choosing the ST track in secondary education has a positive effect on performance in mathematics at the university level. This result is consistent with previous findings in the literature, linking university performance with the student’s background to the extent that the choice of the ST track improves the student’s mathematical background. For example, good results in exams required for university entrance (SAT, A levels) have been found to have a positive effect on performance in mathematics at university [10,12]. Additionally, those students that have taken calculus in high school and have obtained high scores in a basic math test show a better performance in mathematics at university, while being required to take remedial math in university has a negative effect [10].
Our results are also in line with literature that considers the type of high school attended [14] or the itinerary chosen in secondary education [13] as a factor explaining the student’s university performance. In fact, a positive effect on mathematical performance in university has been found in students who attend a scientific oriented high school in Italy [14] or who choose the ST track in Spain [13]. Therefore, it seems that the training provided by certain secondary education programs has a positive effect on the student’s performance in mathematics at the university level. However, the effect of the high school track can be the consequence of a specific training but also of non-cognitive skills since the best students seem to choose the one with more mathematical content [13]. In other words, the training effect of attending a specific high school or program is blurred by the different non-cognitive skills of the students who choose such high school or program. In this study, we find evidence of the student’s self-selecting into the ST track since non-cognitive skills increase the probability of choosing the ST track.
In order to deal with this problem in regression analysis, it would be necessary to include a measure of non-cognitive skills. By doing so, the effect of choosing the ST track could be interpreted as an effect of training. Including pre-university academic results as an explanatory variable alongside the high school or track choice can be seen as a move in the direction of controlling for student’s non-cognitive skills [13,14]. However, pre-university academic results are a crude measure of non-cognitive skills since they are likely to be the result, besides non-cognitive skills, of previous training [12]. The direction and size of the bias created by using pre-university results as an explanatory variable instead of a more refined measure of non-cognitive skills has been previously analyzed [13].
In this sense, our paper goes one step further in trying to disentangle the effects of non-cognitive skills and training. For that purpose, we first extend previous research related to students’ mathematical ability [22] by asking a battery of questions on their feelings about mathematical work and their perception of their own mathematical skills [24]. Second, we combine the information obtained in a single variable that is included in the regression as a measure of non-cognitive skills. As a result, we expect to improve the measurement of the training component of choosing an ST track.
The inclusion of a measure of non-cognitive skills as an explanatory variable in the regression produces a substantial reduction in the effect of choosing the ST track in secondary education. However, roughly half of the effect estimated before remains after the inclusion of the non-cognitive skills variable. This result is qualitatively similar to the inclusion of pre-university academic results as an explanatory variable in the regression [13].
Our robustness-check analysis shows that the result of including our index of non-cognitive skills is congruent with the results obtained using items developed by Principal Component Analysis.
A caveat should be mentioned again about the finding that choosing the ST track has a positive effect on mathematical results at the university level even after controlling for non-cognitive skills. The answers to the questions in our survey can be affected by the previous training and effort of students. However, as discussed in the section on methodology, the direction of the bias indicates that our estimations can be interpreted as a lower bound [25].
Additionally, our results show that, on average, female students obtain better grades than males. Similar results have been reported in the literature related to our paper [12,13,14]. Although, the opposite result has been found as well [10]. In this regard, recent literature shows that these contrasting results are conditioned by the direct gender effect on math performance as well as the indirect effect implied by the different secondary school choices between males and females [26].
The effect of being a female student is almost as large as the effect of choosing the ST track. This result prodded us to carry out a more detailed analysis that, to the best of our knowledge, is absent in the previous literature related to our study. For that purpose, we include an interaction between the binary variable sex and the index of non-cognitive skills and run different regressions for male and female students. Both exercises show that non-cognitive skills have a larger effect on grades for males while choosing the ST track has a larger effect on grades for female students. Therefore, our results depict a picture of females relying more on the training component of choosing the ST track for increasing their grades while males rely on non-cognitive skills to get better grades.

Author Contributions

Conceptualization, C.A., J.V. and J.M.G.; methodology, C.A., J.V. and J.M.G.; software, C.A. and J.V.; validation, C.A. and J.V.; formal analysis, C.A., J.V. and J.M.G.; investigation, J.M.G.; resources, C.A., J.V. and J.M.G.; data curation, C.A. and J.M.G.; writing—original draft preparation, C.A. and J.V.; writing—review and editing, C.A. and J.V.; visualization, C.A. and J.V.; supervision, J.V.; project administration, C.A; funding acquisition, C.A. and J.V. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

It is our understanding that our research was conducted in accordance with the ethics requirements of our universities and is exempt from research ethics committee oversight. The reason is that the subjects in our survey cannot be identified in anyway or exposed to risks, liabilities, or reputational damage.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data and code used in this study can be found at https://t.ly/q1uu (accessed on 28 October 2021).

Acknowledgments

Javier Valbuena would like to thank the support from the project S23_20R (Grupo de Investigación de Referencia en Economía Pública, Gobierno de Aragón).

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Survey
Personal characteristics and socioeconomic status of students
1Age
2SexFemale Male
3Did you live at home while completing upper secondary education?
Yes Only with mother/father No
4Do you have any siblings?Yes No
5What of the following statements best describes your household
(a) There were a lot of books at home. More than 100 There were not a lot of books at home. Between 25 and 50 (b) There were few books at home. Less than 25.
Parent’s schooling
6No graduationPrimarySecondaryUniversity
Father
Mother
Employment status of parents
Tick the alternative which better defines the employment status of your parents when you were in Primary and Secondary school
7Stay at homeUnemployedEmployed
Mother
Father
Characteristics of the student related to Secondary and Upper Secondary Education
8Type of upper secondary school
Public Charter Private
9Type of math in lower secondary school A B
10Did you have to repeat a year in Secondary EducationYes No
11Upper Secondary Education Track
Arts Science and Technology Humanities and Social Science
12Did you study math in baccalaureateYes No
13In the event you have studied math in Upper Secondary Education, what was your grade?
Characteristics of the student related to University
14Did you apply for financial aid to attend university?Yes No
15If yes, did you get financial aid to attend university? Yes No
16Work status at University
Full time schooling Full time schooling with sporadic work Part time schooling and part time job Full time job and full time schooling
17Would you have liked to attend a different university?Yes No
18Would you have liked to enrol in a different Degree?Yes No
19Is this your first year studying for this Degree?Yes No
20Have you had to retake first year math?Yes No
21Did you pass first year math in your first attempt?Yes No
22What was your numerical grade in first year math? (up to one decimal place),
23What was your numerical grade in first year Economics? (up to one decimal place),
24What was your numerical grade in Economic History? (up to one decimal place),
25What is your current Grade Point Average?,
Attitudes toward Mathematics
What is your level of agreement with the following statements?
Not at allSlightlyQuiteA lot
26Mathematics is a source of anxiety for me
27I enjoy doing mathematics
28My mind is well suited for mathematics
29I get nervous when I do not understand a problem
30I try to avoid mathematics
31Mathematics is interesting
32I feel confident when I do mathematics
33I have aversion to mathematics
34I am afraid of mathematics
35Mathematics is fun
36I like to work with numbers
37I believe I am good at mathematics
38I find mathematics to be easy
39I feel that I have talent for solving mathematical problems
40Mathematical problems are useful in my daily life.

Appendix B

List of control variables used in the analysis
Binary variables denoting the degree in which the student is enrolled: International Trade, Marketing, Finance, Business 1 and Business 2. There are five binary variables that take the value of 1 when the student enrolls in the degree and 0 otherwise.
INTACT is a binary variable that takes the value of 1 when the student lived with both parents in Secondary School and 0 otherwise.
SIBLINGS is a binary variable that takes the value of 1 when the student has siblings and 0 otherwise.
BOOKS is a binary variable that takes the value of 1 when there were more than 100 books at home and 0 otherwise.
MOTHER ED is a binary variable that takes the value of 1 when the mother graduated from university and 0 otherwise.
FATHER ED is a binary variable that takes the value of 1 when the father graduated from university and 0 otherwise.
CHARTER is a binary variable that takes the value of 1 when the student attended a charter school and 0 otherwise.
REPEAT is a binary variable that takes the value of 1 when the student had to repeat a year through Secondary Education and 0 otherwise.
SCHOLARSHIP is a binary variable that takes the value of 1 when the student has applied for financial aid and 0 otherwise.
OTHERUNIVERSITY is a binary variable that takes the value of 1 when the student wanted to attend a different university and 0 otherwise.
OTHERDEGREE is a binary variable that takes the value of 1 when the student wanted to enrol in a different degree and 0 otherwise.
SEX is a binary variable that takes the value of 1 for female students and 0 for males.

Appendix C

Tables with all coefficients in the model.
Table A1. Coefficients of linear models explaining grades (full sample).
Table A1. Coefficients of linear models explaining grades (full sample).
N = 156Dependent Variable: Grade in Mathematics
Control Variables: Degree and SexControl Variables: All
INT. TRADE4.039
(0.344)
3.235
(0.821)
4.216
(0.753)
4.155
(0.754)
MARKETING4.800
(0.357)
4.212
(0.823)
5.307
(0.758)
5.219
(0.761)
FINANCE3.946
(0.419)
3.426
(0.868)
4.119
(0.785)
4.018
(0.789)
BUSINESS 15.305
(0.399)
4.665
(0.771)
5.290
(0.697)
5.155
(0.706)
BUSINESS 24.552
(0.309)
4.0046
(0.740)
4.600
(0.670)
4.499
(0.675)
INTACT 0.341
(0.483)
0.042
(0.435)
0.113
(0.439)
SIBLINGS 0.029
(0.343)
−0.176
(0.309)
−0.143
(0.310)
BOOKS 0.011
(0.315)
−0.320
(0.287)
−0.359
(0.289)
MOTHER ED 0.036
(0.317)
−0.015
(0.284)
−0.007
(0.283)
FATHER ED 0.264
(0.321)
0.137
(0.288)
0.105
(0.289)
CHARTER −0.161
(0.311)
−0.012
(0.279)
0.001
(0.279)
REPEAT −1.401
(0.454)
−1.224
(0.407)
−1.109
(0.421)
SCHOLARSHIP 0.518
(0.368)
0.425
(0.329)
0.412
(0.329)
OTHER UNIVERSITY 0.331
(0.316)
0.286
(0.282)
0.293
(0.282)
OTHER DEGREE −0.310
(0.325)
−0.2093
(0.291)
−0.183
(0.292)
SEX0.754
(0.284)
0.631
(0.293)
0.593
(0.262)
0.593
(0.261)
TRACK1.246
(0.351)
1.341
(0.367)
0.643
(0.348)
0.653
(0.348)
NON-COGNITIVE 0.831
(0.139)
1.019
(0.214)
SEX×NON-COGNITIVE −0.308
(0.268)
R20.150.220.390.39
Note: results from estimating Equation (2) using data from ULE. Standard errors in brackets.
Table A2. Coefficients of linear models explaining grades by gender.
Table A2. Coefficients of linear models explaining grades by gender.
Dependent Variable: Grade in Mathematics
Male (N = 69)Female (N = 87)
INT. TRADE4.619
(1.243)
4.910
(1.028)
2.666
(1.094)
3.992
(1.076)
MARKETING5.438
(1.206)
5.952
(1.001)
3.540
(1.132)
4.968
(1.119)
FINANCE4.439
(1.288)
4.216
(1.065)
3.206
(1.175)
4.365
(1.133)
BUSINESS 16.291
(1.114)
5.664
(0.928)
3.944
(1.088)
5.197
(1.065)
BUSINESS 25.270
(1.075)
5.043
(0.889)
3.614
(1.044)
4.649
(1.007)
INTACT−0.579
(0.723)
−0.240
(0.601)
1.084
(0.672)
0.470
(0.644)
SIBLINGS−0.061
(0.606)
0.033
(0.500)
0.089
(0.425)
−0.231
(0.403)
BOOKS0.312
(0.549)
−0.216
(0.465)
0.169
(0.418)
−0.135
(0.396)
MOTHER ED−0.027
(0.520)
0.034
(0.429)
−0.060
(0.410)
−0.174
(0.380)
FATHER ED−0.557
(0.522)
−0.697
(0.432)
0.945
(0.423)
0.881
(0.391)
CHARTER−0.448
(0.494)
−0.345
(0.408)
0.121
(0.420)
0.299
(0.392)
REPEAT−1.49
(0.686)
−0.638
(0.591)
−1.802
(0.671)
−2.016
(0.623)
SCHOLARSHIP1.021
(0.569)
0.757
(0.473)
0.256
(0.498)
0.144
(0.461)
OTHER UNIVERSITY0.071
(0.480)
0.207
(0.397)
0.748
(0.429)
0.619
(0.398)
OTHER DEGREE−0.783
(0.513)
−0.627
(0.425)
−0.236
(0.449)
−0.112
(0.416)
TRACK1.188
(0.602)
0.577
(0.511)
1.476
(0.496)
0.700
(0.507)
NON-COGNITIVE 1.161
(0.228)
0.664
(0.184)
R20.310.540.310.41
Note: results from estimating Equation (2) using data from ULE. Standard errors in brackets.
Table A3. Coefficients of a Probit model explaining the choice of Secondary Education Track.
Table A3. Coefficients of a Probit model explaining the choice of Secondary Education Track.
N = 156Dependent Variable:; ST = 1, SS = 0
CoefficientStandard Error
INT. TRADE−0.1880.769
MARKETING−0.5170.754
FINANCE0.0170.760
BUSINESS 1−1.0600.761
BUSINESS 2−0.3670.674
INTACT−0.3680.425
SIBLINGS−0.7380.325
BOOKS−0.9830.354
MOTHER ED0.0380.313
FATHER ED−0.1170.308
CHARTER1.2280.350
REPEAT0.5330.436
SCHOLARSHIP−0.1630.370
OTHER UNIVERSITY0.1080.305
OTHER DEGREE0.2810.311
SEX−0.0750.286
NON-COGNITIVE0.6660.168

References

  1. Hanushek, E.A. Interpreting Recent Research on Schooling in Developing Countries. World Bank Res. Obs. 1995, 10, 227–246. [Google Scholar] [CrossRef] [Green Version]
  2. Case, A.; Deaton, A. School Inputs and Educational Outcomes in South Africa. Q. J. Econ. 1999, 114, 1047–1084. [Google Scholar] [CrossRef]
  3. Bratti, M.; Staffolani, S. Student Time Allocation and Educational Production Functions. Ann. Econ. Stat. 2013, 111/112, 103–140. [Google Scholar] [CrossRef]
  4. Dearden, L.; Ferri, J.; Meghir, C. The Effect of School Quality on Educational Attainment and Wages. Rev. Econ. Stat. 2002, 84, 1–20. [Google Scholar] [CrossRef] [Green Version]
  5. Eide, E.; Showalter, M.H. The effect of school quality on student performance: A quantile regression approach. Econ. Lett. 1998, 58, 345–350. [Google Scholar] [CrossRef] [Green Version]
  6. Jürges, H.; Schneider, K. Central exit examinations increase performance. but take the fun out of mathematics. J. Popul. Econ. 2010, 23, 497–517. [Google Scholar] [CrossRef] [Green Version]
  7. Maué, E. Achievement—And what else? The standardisation of semester grades due to the implementation of state-wide exit examinations. Stud. Educ. Eval. 2016, 51, 42–54. [Google Scholar] [CrossRef]
  8. van Ackeren, I.; Block, R.; Klein, E.D.; Kühn, S.M. The impact of statewide exit exams in Germany: A descriptive case study of three german states with differing low stakes exam regimes. Educ. Policy Anal. Arch. 2012, 20, 1–28. [Google Scholar]
  9. Smith, J.; Naylor, R. Determinants of Degree Performance in UK Universities: A Statistical Analysis of the 1993 Student Cohort. Oxf. Bull. Econ. Stat. 2001, 63, 29–60. [Google Scholar] [CrossRef]
  10. Ballard, C.L.; Johnson, M.F. Basic Math Skills and Performance in an Introductory Economics Class. J. Econ. Educ. 2004, 35, 3–23. [Google Scholar] [CrossRef]
  11. Pozo, S.; Stull, C.A. Requiring a Math Skills Unit: Results of a Randomized Experiment. Am. Econ. Rev. 2006, 96, 437–441. [Google Scholar] [CrossRef] [Green Version]
  12. Lagerlöf, J.N.M.; Seltzer, A.J. The Effects of Remedial Mathematics on the Learning of Economics: Evidence from a Natural Experiment. J. Econ. Educ. 2009, 40, 115–137. [Google Scholar] [CrossRef]
  13. Dolado, J.J.; Morales, E. Which factors determine academic performance of economics freshers? Some Spanish evidence. Investig. Econ. 2009, 33, 179–210. [Google Scholar]
  14. Cappellari, L.; Lucifora, C.; Pozzoli, D. Determinants of grades in maths for students in economics. Educ. Econ. 2012, 20, 1–17. [Google Scholar] [CrossRef]
  15. Darlington, E.; Bowyer, J. Students’ views of A-level Mathematics as preparation for degree-level economics. Citizsh. Soc. Econ. Educ. 2017, 16, 100–116. [Google Scholar] [CrossRef]
  16. Borghans, L.; Meijers, H.; Ter Weel, B. The role of noncognitive skills in explaining cognitive test scores. Econ. Inq. 2008, 46, 2–12. [Google Scholar] [CrossRef]
  17. Borghans, L.; Golsteyn, B.H.; Heckman, J.; Humphries, J.E. Identification problems in personality psychology. Pers. Individ. Differ. 2011, 51, 315–320. [Google Scholar] [CrossRef]
  18. MacCann, C.; Jiang, Y.; Brown, L.E.R.; Double, K.S.; Bucich, M.; Minbashian, A. Emotional intelligence predicts academic performance: A meta-analysis. Psychol. Bull. 2020, 146, 150–186. [Google Scholar] [CrossRef]
  19. Arens, A.K.; Frenzel, A.C.; Goetz, T. Self-Concept and Self-Efficacy in Math: Longitudinal Interrelations and Reciprocal Linkages with Achievement. J. Exp. Educ. 2020, 1–19. [Google Scholar] [CrossRef]
  20. Cunha, F.; Heckman, J. Formulating, identifying and estimating the technology of cognitive and noncognitive skill formation. J. Hum. Resour. 2008, 43, 738–782. [Google Scholar]
  21. Heckman, J.J.; Kautz, T. Hard evidence on soft skills. Labour Econ. 2012, 19, 451–464. [Google Scholar] [CrossRef] [Green Version]
  22. Ely, D.P.; Hittle, L. The impact of math background on performance in managerial economics and basic finance courses. J. Financ. Educ. 1990, 19, 59–61. [Google Scholar]
  23. Chen, Y.; Feng, S.; Heckman, J.J.; Kautz, T. Sensitivity of self-reported noncognitive skills to survey administration conditions. Proc. Natl. Acad. Sci. USA 2019, 117, 931–935. [Google Scholar] [CrossRef] [PubMed]
  24. Castrillo, S.; Cabrerizo, J. La Práctica de la Evaluación Educativa; Pearson: Madrid, Spain, 2010; p. 352. [Google Scholar]
  25. Angrist, J.; Pischke, S. Mostly Harmless Econometrics: An Empiricists’ Companion; Princeton University Press: Princeton, NJ, USA, 2008; pp. 66–68. [Google Scholar]
  26. Contini, D.; Di Tommaso, M.L.; Mendolia, S. The gender gap in mathematics achievement: Evidence from Italian data. Econ. Educ. Rev. 2017, 58, 32–42. [Google Scholar] [CrossRef] [Green Version]
Table 1. Students and participants in the survey by degree.
Table 1. Students and participants in the survey by degree.
DegreePotential ParticipantsActual ParticipantsParticipation %
INT. TRADE574070
MARKETING624470
FINANCE532547
BUSINESS 1624877
BUSINESS 2462860
TOTAL28018566
Source: Own elaboration using data from ULE.
Table 2. Supporting regression for the index of non-cognitive skills.
Table 2. Supporting regression for the index of non-cognitive skills.
Dependent Variable: I Am Good at Mathematics(N = 156)
Constant0.468
Mathematics is a source of anxiety for me−0.088
I enjoy doing Mathematics0.120
My mind is well suited for mathematics0.305 ***
I get nervous when I do not understand a problem0.052
I try to avoid mathematics−0.011
Mathematics is interesting−0.046
I feel confident when I do mathematics−0.041
I have aversion to mathematics 0.034
I am afraid of mathematics−0.098
Mathematics is fun0.028
I like to work with numbers−0.083
I find mathematics to be easy0.314 ***
I feel that I have talent for solving mathematical problems0.241 ***
Mathematical problems are useful in my daily life. 0.057
R20.35
Note: Results from estimating Equation (1) using data from ULE. *** p < 0.01, ** p < 0.05, * p < 0.1.
Table 3. Descriptive statistics.
Table 3. Descriptive statistics.
AVERAGEST. DVMINMAX
GRADE MATH5.181.84010
SEX0.550.4901
TRACK0.200.4001
NON-COGNITIVE01−2.602.80
Source: own elaboration using data from ULE.
Table 4. Means by sex, secondary education track and university degree.
Table 4. Means by sex, secondary education track and university degree.
Variables of InterestObservations %
Stratifying Variables Grade in MathNon-Cognitive Skills
SEXMale4.780.0544
Female5.49−0.0456
F test value5.900.34
P(F distribution > F test value)0.02 **0.56
TRACKSocial Science4.95−0.1479
Technical6.050.5621
F test value9.3813.94
P(F distribution > F test value)0.00 ***0.00 ***
DEGREEInt. Trade4.70−0.0722
Marketing5.53−0.4422
Finance4.860.2714
Business 15.170.1927
Business 25.740.1813
F value0.554.24
P(F distribution > F test value)0.460.04 **
Source: own elaboration using data from ULE. *** p < 0.01, ** p < 0.05, * p < 0.1.
Table 5. Coefficients of linear models explaining grades (full sample).
Table 5. Coefficients of linear models explaining grades (full sample).
Dependent Variable: Grade in Mathematics
Control Variables: Degree and SexControl Variables: All
SEX0.754 ***
(0.284)
0.631 **
(0.293)
0.593 **
(0.262)
0.593 **
(0.261)
TRACK1.246 ***
(0.351)
1.341 ***
(0.367)
0.643 *
(0.348)
0.653 *
(0.348)
NON-COGNITIVE 0.831 ***
(0.139)
1.019 ***
(0.214)
SEX×NON-COGNITIVE −0.308
(0.268)
R20.150.220.380.39
N156156156156
Note: results from estimating Equation (2) using data from ULE. *** p < 0.01, ** p < 0.05, * p < 0.1.
Table 6. Coefficients of linear models explaining grades by gender.
Table 6. Coefficients of linear models explaining grades by gender.
Dependent Variable: Grade in Mathematics
Male (N = 69)Female (N = 87)
TRACK1.188 *
(0.602)
0.577
(0.511)
1.476 ***
(0.496)
0.700
(0.507)
NON-COGNITIVE 1.161 ***
(0.228)
0.664 ***
(0.184)
R20.310.540.310.41
Note: Results from estimating Equation (2) by gender using data from ULE. *** p < 0.01, ** p < 0.05, * p < 0.1.
Table 7. Coefficients of a Probit model explaining the choice of the secondary education track.
Table 7. Coefficients of a Probit model explaining the choice of the secondary education track.
N = 156Dependent Variable: ST = 1, SS = 0
CoefficientStandard Error
SEX−0.0750.286
NON-COGNITIVE0.666 ***0.168
Note: *** p < 0.01, ** p < 0.05, * p < 0.1.
Table 8. Coefficients of linear models explaining grades. PCA factor as explanatory variables.
Table 8. Coefficients of linear models explaining grades. PCA factor as explanatory variables.
Dependent Variable: Grade in Mathematics
N = 156F1F2F3
SEX 0.620 **
(0.262)
0.507 *
(0.281)
0.652 **
(0.290)
TRACK0.626 *
(0.352)
0.877 **
(0.367)
1.171 ***
(0.373)
NON-COGNITIVE1.082 ***
(0.226)
0.304
(0.215)
0.246
(0.210)
SEX×NON-COGNITIVE−0.422
(0.273)
0.421
(0.281)
0.113
(0.287)
R20.380.310.25
Note: *** p < 0.01, ** p < 0.05, * p < 0.1.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Arias, C.; Valbuena, J.; Garcia, J.M. The Impact of Secondary Education Choices on Mathematical Performance in University: The Role of Non-Cognitive Skills. Mathematics 2021, 9, 2744. https://doi.org/10.3390/math9212744

AMA Style

Arias C, Valbuena J, Garcia JM. The Impact of Secondary Education Choices on Mathematical Performance in University: The Role of Non-Cognitive Skills. Mathematics. 2021; 9(21):2744. https://doi.org/10.3390/math9212744

Chicago/Turabian Style

Arias, Carlos, Javier Valbuena, and Jose Manuel Garcia. 2021. "The Impact of Secondary Education Choices on Mathematical Performance in University: The Role of Non-Cognitive Skills" Mathematics 9, no. 21: 2744. https://doi.org/10.3390/math9212744

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop