Next Article in Journal
Core Content, Experience and Enlightenment of CSR in the J-League
Next Article in Special Issue
Impact of Organizational Culture on Academics’ Readiness and Behavioral Intention to Implement eLearning Changes in Kuwaiti Universities during COVID-19
Previous Article in Journal
Car-Following Model Optimization and Simulation Based on Cooperative Adaptive Cruise Control
Previous Article in Special Issue
Sustainability of Online Teaching: The Case Study Mother Tongue Spelling Course at Montenegrin Universities
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Online Education and Undergraduates’ Academic Record during the COVID-19 Pandemic in China: Evidence from Large-Scale Data

School of Economics and Management, Anhui University of Science and Technology, Huainan 232001, China
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(21), 14070; https://doi.org/10.3390/su142114070
Submission received: 11 October 2022 / Revised: 25 October 2022 / Accepted: 26 October 2022 / Published: 28 October 2022

Abstract

:
Digital technology-based online education is key to promoting high-quality development of higher education. Many studies have analyzed the effects of online education during the COVID-19 pandemic, but analyses based on large-scale data are lacking. This study uses a quasi-natural experiment during the COVID-19 pandemic to explore the short- and long-term relationships between emergency remote education (teaching and learning) and undergraduates’ academic record using multiple comparison analysis of variance (ANOVA) and multiple linear regression. The research data come from the academic record of 123,208 courses of 2622 undergraduates from the classes of 2017–2021 in a Chinese university, across nine semesters. The data do not satisfy the homogeneity of variance hypothesis test; therefore, a non-parametric test is adopted for hypothesis testing. The results show that: (1) In the online education semester, the students’ academic record improved substantially with low fluctuation and greater stability; (2) this improvement is more obvious for sophomores and juniors than for freshmen, and (3) online education during the pandemic period significantly improved the course scores of undergraduates, especially sophomores, in the following one or two semesters.

1. Introduction

Because of the COVID-19 pandemic’s impact on human health worldwide, people’s understanding of knowledge transmission has changed, especially in the field of education. In February 2020, China’s Ministry of Education issued guidelines on the organization of online education in colleges and universities, advocating that “classes [are] punctuated, but learning continues.” Therefore, colleges and universities across the country launched online education (i.e., online teaching, learning, evaluation, and supervision) activities in the first half of 2020. In the second half of 2020, colleges and universities resumed face-to-face education activities. The pandemic made the majority of teachers, students, and university administrators in China experience a complete “digital technology-based educational experiment,” although this “experiment” has the characteristics of an “emergency” situation. During the pandemic, online teaching adopted by Chinese teachers included live teaching, video teaching, and Massive Open Online Courses teaching, with the help of software such as Tencent Conference, Tencent Classroom, Rain Classroom, Super Star Learning, Ding Talk, Tik Tok, and so on.
Previous studies, at home and abroad, have focused on online education from different perspectives. First, researchers have studied the influential factors of students’ online learning, finding that parent participation [1,2]; teacher–student interaction [3,4]; and students’ autonomy [5,6], learning engagement [7,8], and learning preference [9,10] are important factors affecting students’ online learning outcomes. Second, scholars measured students’ online learning participation from three aspects: pre-class self-study, classroom activities, and after-class activities [11], which specifically included online discussion, video-watching, number of visits, learning duration, knowledge point test, chapter assignment, and goal achievement [12,13]. Third, researchers evaluated the effect of online teaching from different aspects of curriculum construction (including curriculum contents, teaching plans, and skills) [14,15], teacher–student growth (including student ability, achievement, and teacher–student satisfaction) [16,17], and organizational support of colleges and departments (including organizational endowment, network environment, and technical support) [18,19].
Recently, numerous domestic and foreign researchers have studied emergency remote teaching and learning during the COVID-19 pandemic, comparing different effects of online and offline education on students’ learning outcomes albeit with inconsistent conclusions. Some scholars claimed that online education is better because students’ performance, ability, and course score improved after online learning [20], showing high levels of learning initiative, homework completion [21,22], and positive evaluations [23,24]. Others showed that online teaching was not as effective as classroom teaching in improving students’ performance and outcomes [25]. Students’ learning and the persistence effect was poor [26], and teachers’ and students’ satisfaction were low [27], because it was difficult to receive timely feedback [28,29]. Online education was only suitable for students with time management skills and strong self-regulation ability [16]. In addition, other scholars argued that there was no significant difference in the impact of online and offline education on students’ learning performance [30,31]. That is, the effect of online education was substantially equivalent to that of offline education [32], and the overall feelings of different students toward online learning greatly differed, leading to huge variances in the effect of online education [33,34].
In general, the literature discussed above serves as a reference to evaluate comprehensively the effect of online education. However, these studies have the following shortcomings: (1) The vast majority of research data were obtained through questionnaires. Even the data of students’ scores were also self-reported, making them highly subjective; (2) the survey data were all one-off surveys, lacking opportunities for horizontal and vertical comparative analysis; and (3) few studies have adopted an experimental approach, and the research samples were very small (no more than 100 people) and limited to certain courses or teaching methods. Therefore, an objective evaluation—of the impact of online education on students’ learning outcomes through large-scale data and long-term analysis—is urgently needed.
Accordingly, this study’s objective is to provide empirical evidence and data support for an objective observation and evaluation of the emergency remote teaching and learning effects during the COVID-19 pandemic. This study contributes mainly in the following aspects: (1) The pandemic has created a quasi-experiment of emergency online education in China. Different data from the early, current, and later stages of this quasi-experiment were collected, through which the impact of emergency remote teaching and learning on students’ learning outcomes for different grades and semesters can be detected; and (2) the data used in this study were large-scale panel data, which came from 2622 undergraduates and 123,208 courses across nine semesters in a Chinese university. To some extent, this might close the gap in the lack of data objectivity from the self-reported surveys used in previous studies.

2. Materials and Methods

2.1. Population and Sampling

The undergraduates whose grades were examined in the quasi-natural experiment came from a Chinese university. The university, located in a prefecture-level city of Anhui Province, is a key university with more than 29,000 full-time undergraduates. The School of Economics and Management, an independent secondary unit, was selected as the cluster sample of participants in this study. This school has more than 2000 full-time (four-year) undergraduate students, pursuing eight types of majors. Table 1 lists the distribution of all types of majors and the number of students for which the study data correspond.
Before the outbreak of COVID-19, most of the courses were delivered through face-to-face communication. During the pandemic, universities launched online teaching activities in the first half of 2020 (i.e., the second semester of school year 2019–2020). In the second half of 2020, teachers and students returned to the campus and resumed classroom teaching and learning activities. Therefore, the subjects involved in this quasi-natural experiment included undergraduate students from the classes of 2016–2019.
Considering that the undergraduates from the class of 2016 were in the off-campus internship stage in the second semester of their senior year during the COVID-19 pandemic, there were no online courses in the semester; hence, they were not suitable for the experiment, and their data were removed from the study accordingly. In addition, to evaluate whether online education had an impact on the students’ follow-up offline learning outcomes, we added the data of two classes of 2020 and 2021 as the control group for comparison. Finally, the subjects of this study were all full-time undergraduate students from 2017 to 2021—a total of 2622 students.

2.2. Grouping

Among all the samples, students from the classes of 2017–2019 were the ones who participated in online education in this quasi-experiment. Their course scores in the second semester of 2019–2020 were used as the experimental data, and their course scores for the remaining semesters were used as the control data for the within-subjects comparison. The course scores of undergraduates of the classes of 2020–2021 were used as the control data for the between-subjects design for comparison. Notably, the students’ courses and related teachers remained almost unchanged between 2017 and 2021. Through within- and between-subjects comparisons, we can fully evaluate students’ learning outcomes by grade and by semester, as influenced by the online education during the pandemic period.

2.3. Data Sources and Analysis

Authentic and objective data, derived from the undergraduate educational administration system, comprised a total of 189,903 grades. We selected the relevant grades data as follows. First, the data of all physical education courses were deleted. Second, all courses must have direct or indirect participation and interaction of teachers, and students’ course scores must also be given by teachers. Therefore, some online courses related to extra-curricular reading (e.g., Wisdom Tree and Erya online courses) that are automatically scored by the computer system were removed. Finally, we deleted the data of a small number of students who changed majors. Similarly, data on individuals who returned to school and retook the courses after joining the army were also removed. Finally, we selected 123,208 pieces of data applicable to this study, covering the final scores in 434 courses of students from eight undergraduate specialties across nine semesters from 2017 to 2021. The courses included general curriculum, public foundation curriculum, public elective curriculum, basic subject curriculum, professional curriculum (including core courses, compulsory courses, elective courses, course design, and graduation project), and so on.
ANOVA, multiple comparison tests, and multiple linear regression were conducted in this study, and the data were processed and analyzed by SPSS27.0 software.

3. Results

3.1. Comparison of Scores by Semester

In the first and second semesters of 2017–2018, the data only contained those of students of the class of 2017. In the first semester of 2018–2019, students of the class of 2018 were enrolled at the university. In the first semester of 2019–2020, students of the class of 2019 were enrolled. In the first semester of 2020–2021, students of the class of 2020 were enrolled. In the first semester of 2021–2022, students of the class of 2021 were enrolled, and students of the class of 2017 were graduated. The annual enrollment of the college showed an increasing trend (see Table 1 for details). Therefore, the sample size in Table 2 gradually increases from top to bottom every semester. In this study, the experimental group samples affected by the pandemic were from the second semester of 2019–2020 (shown in bold in Table 2). A comparison of the mean scores of students in different semesters shows that the course scores of students who adopted online learning during the pandemic were significantly improved compared with their scores in the four semesters before the pandemic, but lower than those in the three semesters after the pandemic. The small standard deviation and standard error of the data indicate that online education better promotes the stability of students’ academic record.

3.2. Comparison of Scores by Classes

Considering that online education was delivered to freshmen, sophomores, and juniors during the pandemic period, we classified and sorted out the data to observe and compare more clearly the differences in online learning effects among students of different grades. The academic record curves of students of the classes of 2017–2021 in different periods of the four years covered in this study are drawn in Figure 1. The score data of students in the same class and different semesters (row data in Figure 1) allow a self-longitudinal comparison of students’ scores (within-subject design). Meanwhile, the score data of students of different classes in the same semester allow a horizontal comparison of students’ learning outcomes (between-subject design). First, students of the classes of 2020 and 2021 were not enrolled during the pandemic period, and their academic record data can be used as control data for comparative analysis. The analysis shows that students’ course scores in the first semester of their freshman year were higher, and the same phenomenon is observed on the grade curve of students of the class of 2017–2019. This may be due to the fact that freshmen students, when they first entered the university, still maintained the learning attitude and habits of their high school years, and this enabled them to perform better given that self-study activity in the evening was required among freshmen. Students’ scores began to decline significantly in the second semester, and then fluctuated up and down among students of the classes of 2017–2021.
During the online learning period in the second semester of 2019–2020, students of the class of 2019 were in the second semester of their freshman year (green curve in Figure 1). Online education did not change the trend that the academic performance (average score of 80.254) declines in the second semester. However, in the following three semesters, there was a small and stable improvement in their academic record, and this phenomenon also appeared in the class of 2018. In the second semester of their sophomore year (red curve in Figure 1), students of the class of 2019 had significantly increased their academic record (average score of 80.574) compared with their scores in the previous two semesters (the second semester of their freshman year and the first semester of their sophomore year). Their academic record improved further in the following two semesters (the first and second semesters of their junior year), but began to decline in the beginning of their senior year. Students of the class of 2017 experienced all eight semesters of the study period, from their freshman year to graduation. They were in the second semester of their junior year when they started online learning (blue curve in Figure 1). Online education contributed to their academic record for this semester becoming the second highest (average score of 81.266), only lower than that of their freshman year in the first semester. However, in the first semester of their senior year, a drop is still observed. The data of senior students had no value for comparison because they had no other courses except for off-campus internship and graduation thesis.

3.3. Multiple Comparison Tests

The analysis above is only based on the descriptive statistical results of the data, without conducting a strict significance test. To obtain a more scientific and accurate conclusion, we conducted multi between-group comparison ANOVA test on the data by semester and by class. ANOVA is a prevalent statistical method used widely in educational and psychological research. Before conducting an ANOVA test, an important first step is to verify the distributional assumptions. We used the Levene’s and Shapiro–Wilks tests to examine normality and heterogeneity of variance, respectively [35]. The data present a skewed distribution and do not satisfy the homogeneity of variance hypothesis test, meaning that a non-parametric test was required. Considering the group size and asymmetry of samples in different groups, the Kruskal–Wallis rank sum test was used for multiple between-group comparisons in the ANOVA test. Because there was too much information from the multiple comparison test results, we dichotomized the results from inferential statistics into significant or non-significant ones and summarized them in Table 3. The details of the test results are listed in Table A1 and Table A2 in Appendix A. We combined these results with the data in Figure 1 and conducted the following analysis.
Table 3 was divided into two parts. In the first half, students’ scores were compared between groups by semester. The results show no significant difference in students’ academic scores in the second semester of 2019–2020 (marked as the sixth semester) compared with those in the previous two semesters (marked as the fourth and fifth semesters). Although the average value of students’ scores in Table 1 had increased, the online teaching activities carried out during the pandemic had not significantly improved students’ academic record. However, in the seventh and eighth semesters after the pandemic, students’ academic performance significantly improved compared with their performance in the sixth semester, suggesting that online education during the pandemic had a delayed effect on the improvement of students’ learning outcomes after the pandemic.
There may be differences in the online learning outcomes of students from different grades, resulting in the total data being leveled, which may lead to the total data failing to pass the significance test. Therefore, the lower part of Table 3 compared the students’ scores by semester and grade between groups. The data for the class of 2021 were only available for one semester; thus, a comparative analysis between semesters was not possible.
There were three semesters of data for students of the class of 2020 showing that there was no significant difference in students’ academic performance between the second semester of 2020–2021 (the second semester of their freshman year, marked as the eighth semester in Table 3) and the first semester of 2021–2022 (the first semester of their sophomore year, marked as the ninth semester in Table 3). This data comparison demonstrates no significant difference in the course data of students who did not experience online learning during the pandemic period (the control group) in the two semesters after the pandemic.
There were five semesters of data for students of the class of 2019, who are the ones that participated in online learning in the second semester of their freshman year. The data in Table 3 show no significant difference in students’ learning outcomes between the sixth semester during the pandemic and the seventh and eighth semesters after the pandemic. Notably, the data comparison between the seventh and fifth semesters was useless, as we have previously emphasized that the fifth semester is the first semester of the freshman year for students of the class of 2019, and the academic record is generally higher than for any other semester.
For students of the class of 2018, there was a significant difference between their academic record for the sixth semester during the pandemic and the fifth semester before the pandemic, as well as the seventh and eighth semesters after the pandemic. The results further show that their academic record for the sixth semester was significantly higher than that for the fifth semester and significantly lower than that for the seventh and eighth semesters. Combined with the analysis above of the class of 2020 students (control group), the results strongly suggest that students in the second semester of their sophomore year during the pandemic had significantly improved their academic performance when they adopted online learning. In addition, we found a lag effect of online education in that the students’ face-to-face learning performance in the following two semesters improved substantially.
For students of the class of 2017, their academic record for the sixth semester during the pandemic also shows a significant improvement compared with their academic record for the fifth semester before the pandemic. This result further supports the finding that online education improved students’ learning performance and outcomes. It should be stressed here that although their academic record decreased in the seventh and eighth semesters after the pandemic ended, this should not be used as evidence to reject the abovementioned lag effect because students of the class of 2017 were already in their senior year and had fewer courses in the seventh and eighth semesters.
In conclusion, the current effect of online education during the pandemic on students’ academic record was verified in the data of sophomore and junior students from the classes of 2017 and 2018, while the lag effect was only verified in the data of sophomore students from the classes of 2018.

3.4. Multiple Linear Regressions

To obtain further scientific support for the study’s results, logarithmic transformation was applied to normalize the data, and multiple linear regression analysis was conducted. The dependent variable of the regression equation is the continuous course score, and the independent variables are the dummy variables of different semesters. The regression results of using dummy variables are summarized in Table 4.
The linear regression results in Table 4 are similar to those of the ANOVA in Table 3, which further support the reliability of this study’s findings. The regression analysis of all the data indicates that online education during the pandemic period significantly improved the course scores of all the students in the sixth and seventh semesters. The regression analysis of grade (class) data also shows that online education during the pandemic period significantly improved the course scores of junior students in the sixth and seventh semesters and improved the course scores of sophomores in the seventh and eighth semesters.

4. Discussion

The findings that online education helped improve students’ learning performance and outcomes has been supported by many studies [20,21]. We found this improvement to be especially true for upper-level students. A recent survey of Chinese college students showed that juniors and seniors had better online learning skills than freshmen [36]. Another study from China found that lower-grade undergraduates prefer to be taught in the classroom [22]. The reasons might be the higher requirements of online education with respect to students’ basic quality, skills, and abilities compared with the requirements of traditional classroom education. Specifically, upper-level students were found to be more proficient in computer technology, more well-rounded in their learning ability, and show higher learning autonomy and stronger independent thinking. They could obtain, screen, and sort out abundant information on the Internet to facilitate online learning, such that their online learning performance was better. By contrast, the skill and ability of freshmen were relatively weaker, and their online learning performances were relatively lower than those of upper-level students.
This study has another finding that online education could significantly improve junior students’ offline academic record in the following one to two semesters. The experimental research of Welsh scholars showed no significant difference in student performance between the online learning and classroom lecture groups and that in contrast to our findings, the subjects in the classroom lecture group performed better (with more cases reported). However, the course scores of students in the classroom lecture group decreased significantly after two weeks, while those in the online learning group did not show such a decline [37]. In another study, Dutch scholars conducted a controlled intervention experiment on 71 fourth grade medical students of Duke University, finding that online learning within a limited time significantly improved the clinical practice performance of medical students after six months [38]. This previous study supports the conclusion of our study to a certain extent, that is, online education has a lag effect on the improvement of undergraduates’ learning performance. The reason may be that online education can better cultivate students’ information literacy [39], improve students’ autonomous learning ability [23], and enhance students’ self-efficacy in learning [40], compared with traditional face-to-face education. These advantages contribute to students’ future offline course learning. Another possible reason is the independent home environment for online learning during the pandemic, which greatly reduced the interaction among students. Interpersonal interaction among students is important in improving students’ educational aspirations and academic performance [41]. A semester of home-based study might have created an urgent need for more social interaction and possibly increased students’ enthusiasm, interest, and engagement in offline learning after they returned to school, thus promoting the improvement of student’s academic performance.
It can be inferred that given the advancements in digital technology, college teaching activities are increasingly stepping into an era of highly open, diversified, and personalized education. Online education is not a “patent” under an “emergency” state nor a “one-off” tool and means of education; rather, it should be one of the choices and means of education under the “normal” state. No country in the world has launched such a large-scale online education system as China did, which puts the most rigid test on the software and hardware capabilities of technology [42]. The findings in this study show that the online education “experiment” was basically successful. Online education is good for the improvement of undergraduates’ learning performance and outcomes in short and long periods. However, we suggest that online education cannot completely replace classroom education, especially for freshmen, as they have just entered school and prefer to take classes in the classroom. Senior students who carry out graduation projects may also hope to get face-to-face guidance from instructors.
The phased characteristics reflected in this study are a true portrayal of online education in China, but this is only at the beginning and preliminary stage, and a series of deep-seated problems involved in an “emergency” state still need to be solved in the post pandemic era. Most teachers lack experience in online teaching, and doing so during the pandemic was their first experience of such. Moreover, because of time constraints and insufficient preparation, teachers may not master online teaching methods well despite their efforts, thus affecting teaching quality [22]. In the post pandemic era, the global pandemic has recurred and abated a few times. Although students returned to the offline from the online class mode, they still yearn for the way of reviewing by watching videos repeatedly. In addition, for students who are unable to return to the campus in areas affected by the pandemic, online classes are the only choice for them to keep up with their studies. Universities are increasingly adopting online and offline-integrated teaching. Colleges and universities should encourage teachers to explore new teaching scenarios boldly, use high-tech teaching tools, and try new teaching modes such as flipping classes.

5. Conclusions

To be objective in observing and evaluating the relationship between emergency online education and students’ learning outcomes during the COVID-19 pandemic, this study used large-scale panel data of 123,208 course scores of 2622 undergraduates from the classes of 2017–2021 in the School of Economics and Management in a Chinese university. Through horizontal and vertical comparison ANOVA across nine semesters, we found that students’ course scores in the emergency online education semester fluctuated less and improved substantially, and this improvement was more obvious for sophomores and juniors than for freshmen. Moreover, online education during the pandemic period significantly improved the course scores of undergraduates, especially sophomores, in the following one or two semesters.
However, the study is subject to some limitations. First, the data were gathered from students majoring in economics and management in a Chinese university; therefore, the conclusions are not necessarily representative of students from different cultures, countries, and specialties. Online education during the COVID-19 pandemic will probably bring challenges for specialized courses that require experimental teaching and hands-on practice. Moreover, the confounding variables include students’ aptitude and discipline-specific variations. In addition, variations in pedagogies implemented across courses have yet to be addressed owing to the lack of primary data. Therefore, we cannot provide more explanations to interpret the research outcomes along these lines. Future research may combine large-scale data analysis with interviews, questionnaires, focus groups, and long-term follow-up experiments.

Author Contributions

J.G. developed the conceptualization and contributed to the formal analysis, methodology, software, and writing (original draft). S.X. and J.Y. contributed to the resources and data curation. N.Y. contributed the writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Teaching Demonstration Class Project of Anhui Province (2020SJJXSFK0918), the Key Teaching and Research Project of Anhui Province (2020jyxm0453), the Education Research Project of Coal Industry (2021MXJG051), and the 2022 Quality Engineering Project of Anhui Province (2021sx033).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data was obtained from Anhui University of Science and Technology and are available from the J. Geng with permission from Anhui University of Science and Technology.

Acknowledgments

The authors are grateful to the editors and reviewers, who provided valuable comments and suggestions to improve the quality of the paper significantly.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Multiple comparison tests of academic record grouping by semester.
Table A1. Multiple comparison tests of academic record grouping by semester.
Grouping 1Test StatisticStandard ErrorStandard Test Statisticsp-Value
(Two-Sided Test)
Adj. p-Value 2
(Two-Sided Test)
2-3−129.173622.305−0.2080.8361.000
2-4−2357.231622.005−3.7900.0000.005
2-5−2721.226585.646−4.6470.0000.000
2-6−3027.965584.087−5.1840.0000.000
2-8−4447.927577.072−7.7080.0000.000
2-9−7955.762573.632−13.8690.0000.000
2-7−8297.485578.851−14.3340.0000.000
2-111,792.619726.14216.2400.0000.000
3-4−2228.058488.940−4.5570.0000.000
3-5−2592.054441.761−5.8680.0000.000
3-6−2898.792439.692−6.5930.0000.000
3-8−4318.754430.329−10.0360.0000.000
3-9−7826.589425.706−18.3850.0000.000
3-7−8168.312432.713−18.8770.0000.000
3-111,663.446615.99918.9340.0000.000
4-5−363.995441.339−0.8250.4101.000
4-6−670.734439.268−1.5270.1271.000
4-8−2090.696429.896−4.8630.0000.000
4-9−5598.531425.268−13.1650.0000.000
4-7−5940.254432.281−13.7420.0000.000
4-19435.388615.69615.3250.0000.000
5-6−306.739386.066−0.7950.4271.000
5-8−1726.700375.368−4.6000.0000.000
5-9−5234.536370.059−14.1450.0000.000
5-7−5576.259378.098−14.7480.0000.000
5-19071.392578.94115.6690.0000.000
6-81419.962372.9313.8080.0000.005
6-94927.797367.58613.4060.0000.000
6-75269.520375.67914.0270.0000.000
6-18764.654577.36315.1800.0000.000
8-9−3507.836356.334−9.8440.0000.000
8-73849.559364.67610.5560.0000.000
8-17344.692570.26512.8790.0000.000
9-7341.723359.2080.9510.3411.000
9-13836.857566.7856.7700.0000.000
7-13495.134572.0666.1100.0000.000
1 The numbers (1–9) of the between-group difference comparison represent different semesters. Each row tests the null hypothesis that two semesters have the same distributions. 2 Significance values were adjusted by Bonferroni correction for multiple tests.
Table A2. Multiple comparison tests of academic record grouping by semester and grade.
Table A2. Multiple comparison tests of academic record grouping by semester and grade.
GradeGrouping 1Test StatisticStandard ErrorStandard Test Statisticsp-Value
(Two-Sided Test)
Adj. p-Value 2
(Two-Sided Test)
20173-7−63.125280.947−0.2250.8221.000
3-2748.434196.9163.8010.0000.004
3-5−1523.383185.802−8.1990.0000.000
3-4−1779.882192.335−9.2540.0000.000
3-8−1933.446341.419−5.6630.0000.000
3-6−2235.189187.275−11.9350.0000.000
3-14093.667195.32920.9580.0000.000
7-2685.309287.7452.3820.0170.483
7-51460.258280.2565.2100.0000.000
7-41716.757284.6306.0320.0000.000
7-8−1870.321400.735−4.6670.0000.000
7-6−2172.064281.235−7.7230.0000.000
7-14030.542286.66114.0600.0000.000
2-5−774.949195.929−3.9550.0000.002
2-4−1031.448202.135−5.1030.0000.000
2-8−1185.013347.035−3.4150.0010.018
2-6−1486.755197.326−7.5350.0000.000
2-13345.233204.98616.3190.0000.000
5-4256.499191.3251.3410.1801.000
5-8−410.064340.851−1.2030.2291.000
5-6−711.806186.237−3.8220.0000.004
5-12570.284194.33513.2260.0000.000
4-8−153.564344.456−0.4460.6561.000
4-6−455.307192.756−2.3620.0180.509
4-12313.785200.59011.5350.0000.000
8-6−301.743341.656−0.8830.3771.000
8-12160.221346.1376.2410.0000.000
6-11858.478195.7439.4940.0000.000
20183-7−1717.650212.930−8.0670.0000.000
3-8−948.656210.048−4.5160.0000.000
5-41610.834207.7757.7530.0000.000
5-8−3287.169194.589−16.8930.0000.000
5-6−2070.577197.313−10.4940.0000.000
4-8−1676.335202.450−8.2800.0000.000
4-6−459.743205.070−2.2420.0250.524
5-9−1326.455284.331−4.6650.0000.000
5-32338.513215.18410.8670.0000.000
5-7−4056.163197.697−20.5170.0000.000
9-4284.379289.7670.9810.3261.000
9-6−744.122282.360−2.6350.0080.176
9-31012.058295.1253.4290.0010.013
9-81960.714280.4636.9910.0000.000
9-72729.708282.6299.6580.0000.000
4-3727.679222.3183.2730.0010.022
4-7−2445.330205.440−11.9030.0000.000
6-3267.936212.5731.2600.2081.000
6-81216.592191.6986.3460.0000.000
6-71985.586194.85210.1900.0000.000
8-7768.995192.0944.0030.0000.001
20197-51963.737157.84212.4410.0000.000
6-8312.420153.5282.0350.0420.419
6-7−382.972155.742−2.4590.0140.139
8-770.552146.3830.4820.6301.000
6-91355.058152.0718.9110.0000.000
6-52346.708164.49014.2670.0000.000
8-9−1042.638142.471−7.3180.0000.000
8-52034.288155.65813.0690.0000.000
7-9−972.086144.853−6.7110.0000.000
9-5991.650154.2216.4300.0000.000
20209-71655.09288.74518.6500.0000.000
8-71752.24691.66019.1170.0000.000
8-9−97.15486.900−1.1180.2640.791
1 The numbers (1–9) of the between-group difference comparison represent different semesters. Each row tests the null hypothesis that two semesters have the same distributions. 2 Significance values were adjusted by Bonferroni correction for multiple tests.

References

  1. Ye, Y.J.; Wang, C.X.; Zhu, Q.Y.; He, M.X.; Havawala, M.; Bai, X.F.; Wang, T. Parenting and teacher-student relationship as protective factors for Chinese adolescent adjustment during COVID-19. Sch. Psychol. Rev. 2021, 51, 187–205. [Google Scholar] [CrossRef]
  2. Luo, M.Y.; Luo, L.W. The impact of digital divide on middle school students’ online education: A survey of parents of middle school students in Nanchang City. Educ. Acad. Mon. 2020, 3, 64–71. [Google Scholar] [CrossRef]
  3. Doan, T.H.D. The advantages and disadvantages of virtual learning. IOSR J. Res. Method Educ. (IOSR-JRME) 2020, 10, 45–48. [Google Scholar]
  4. Lei, W.P.; Huang, G.Z. Major epidemic and problems facing the development of online education. Educ. Res. Exp. 2020, 2, 13–16+22. [Google Scholar]
  5. Gegenfurtner, A.; Fryer, L.; Järvelä, S.; Harackiewicz, J.; Narciss, S. Affective learning in digital education. Front. Educ. 2019, 4, 128. [Google Scholar]
  6. Wu, Q.; Luo, R.G. Learning achievement prediction and teaching reflection based on online learning behavior. Mod. Educ. Technol. 2017, 27, 18–24. [Google Scholar] [CrossRef]
  7. Pham, Q.; Huynh, M. Earning achievement and knowledge transfer: The impact factor of e-learning system at Bachkhoa University, Vietnam. Int. J. Innov. 2018, 6, 194–206. [Google Scholar] [CrossRef]
  8. Hu, X.Y.; Xu, H.Y.; Chen, Z.X. An empirical study on the relationship between learner information literacy, online learning engagement and learning performance. China Audio-Vis. Educ. 2020, 3, 77–84. [Google Scholar]
  9. Salamat, L.; Ahmad, G.; Bakht, M.; Saifi, I. Effects of e-learning on students’ academic learning at university level. Asian Innov. J. Soc. Sci. Humanit. 2018, 2, 1–12. [Google Scholar]
  10. Song, Q.M.; Zhang, Y.H. An empirical analysis of the influence of online learning on the ability development of engineering students. Jiangsu High. Educ. 2020, 11, 75–79. [Google Scholar] [CrossRef]
  11. Zhang, H.R.; Liu, Y. Primary and secondary education thinking under major epidemic situation: Based on the perspective of empirical analysis. Educ. Econ. 2020, 36, 3–9+28. [Google Scholar]
  12. Chen, K.Q.; Gao, L.; Meng, X.D. Online learning path mining in college blended teaching and its enlightenment to teaching reform: A case study of biochemistry course in a university. Explor. High. Educ. 2020, 5, 5–13. [Google Scholar]
  13. Baber, H. Determinants of students’ perceived learning outcome and satisfaction in online learning during the pandemic of COVID-19. J. Educ. e-Learn. Res. 2020, 7, 285–292. [Google Scholar] [CrossRef]
  14. Hsu, H.C.; Wang, C.V.; Levesque-Bristol, C. Reexamining the impact of self-determination theory on learning outcomes in the online learning environment. Educ. Inf. Technol. 2019, 24, 2159–2174. [Google Scholar] [CrossRef]
  15. Cao, H.Y.; Sun, Y.D.; Luo, Y.C.; Shan, Y.G. Thinking on the learning design of “student centered” hybrid teaching courses in colleges and universities. High. Eng. Educ. Res. 2021, 1, 187–192. [Google Scholar]
  16. Hawkins, A.; Graham, C.R.; Sudweeks, R.R.; Barbour, M.K. Academic performance, course completion rates, and student perception of the quality and frequency of interaction in a virtual high school. Distance Educ. 2013, 34, 64–83. [Google Scholar]
  17. Wang, J.X.; Cui, Y.P.; Yan, Y.T. Analysis on the effect and potential influencing factors of large-scale online education practice during the War on “Epidemic”: A case study of Xiaogan City, Hubei Province. Audio-Vis. Educ. Res. 2020, 41, 5–12. [Google Scholar]
  18. Yates, A.; Starkey, L.; Egerton, B.; Flueggen, F. High school students’ experience of online learning during COVID-19: The influence of technology and pedagogy. Technol. Pedagog. Educ. 2020, 30, 59–73. [Google Scholar] [CrossRef]
  19. Bao, W.; Chen, D.C.; Wang, J. Study on online and offline learning paradigm and teaching effectiveness in the post-epidemic era: A comparative analysis based on online and offline college student survey data. China Audio-Vis. Educ. 2021, 6, 7–14. [Google Scholar]
  20. Kim, K.J.; Lee, Y.J.; Mi, J.L. E-learning for enhancement of medical student performance at the Objective Structured Clinical Examination (OSCE). PLoS ONE 2021, 16, e0253860. [Google Scholar] [CrossRef]
  21. Ratten, V. Coronavirus (COVID-19) and the entrepreneurship education community. J. Enterprising Communities People Places Glob. Econ. 2020, 14, 753–764. [Google Scholar] [CrossRef]
  22. Wang, J.D.; Shen, C.; Yang, L.; Gao, M.Z.; Wang, H.; Deng, K. Comparative analysis of online and offline undergraduate teaching quality: Based on teaching evaluation data of Tsinghua University. China Audio-Vis. Educ. 2022, 3, 90–95+102. [Google Scholar]
  23. Yoo, H.; Kim, D.; Lee, Y.M.; Rhyu, I.J. Adaptations in anatomy education during COVID-19. J. Korean Med. Sci. 2021, 1, e13. [Google Scholar] [CrossRef] [PubMed]
  24. Wang, Y.; Xiao, H.W.; Xu, Y. Research on online learning performance evaluation model based on mobile Internet. China Audio-Vis. Educ. 2017, 3, 132–137. [Google Scholar] [CrossRef]
  25. Larson, D.K.; Sung, C.H. Comparing student performance: Online versus blended versus face-to-face. J. Asynchronous Learn. Netw. 2009, 13, 31–42. [Google Scholar]
  26. Bettinger, E.; Loeb, S. Promises and Pitfalls of Online Education; Brookings Institution: Washington, DC, USA, 2017. [Google Scholar]
  27. Mohamed, A.; Mahdy. The impact of COVID-19 pandemic on the academic performance of veterinary medical students. Front. Vet. Sci. 2020, 7, 594261. [Google Scholar] [CrossRef]
  28. Dynarski, E. Online courses are harming the students who need the most help. The New York Times, 30 April 2022. [Google Scholar]
  29. Eriksson, T.; Adawi, T.; Stohr, C. “Time is the bottleneck”: A qualitative study exploring why learners drop out of MOOCs. J. Comput. High. Educ. 2017, 29, 133–146. [Google Scholar] [CrossRef] [Green Version]
  30. Ge, Y.M.; Yu, X.J. Exploration of “substantial equivalence” between online teaching and offline classroom under epidemic situation. Mod. Educ. Technol. 2020, 30, 124–126. [Google Scholar]
  31. Hjorth-Johansen, E.; Hofos, D.; Kyn, N.M. E-earning or lectures to increase knowledge about congenital heart disease in infants: A comparative interventional study. Nurs. Open 2019, 6, 1143–1149. [Google Scholar] [CrossRef] [Green Version]
  32. Aristeidou, M.; Scanlon, E.; Sharples, M. Profiles of engagement in online communities of citizen science participation. Comput. Hum. Behav. 2017, 74, 246–256. [Google Scholar] [CrossRef]
  33. Rizun, S. The impact of environmental factors on academic performance of university students taking online classes during the COVID-19 Pandemic in Mexico. Sustainability 2020, 12, 9194. [Google Scholar]
  34. Li, Y.; Chen, X.Y.; Chen, Y.X.; Zhang, F. Investigation and enlightenment of college students’ online learning during the COVID-19: A case study of Zhu Kezhen College of Zhejiang University. Open Educ. Res. 2020, 26, 60–70. [Google Scholar] [CrossRef]
  35. Zhou, Y.; Skidmore, S.T. A reassessment of ANOVA reporting practices: A review of three APA journals. J. Methods Meas. Soc. Sci. 2017, 8, 3–19. [Google Scholar] [CrossRef]
  36. Zhu, J.Q.; Zhao, H.X.; Wang, X. Effects of online learning on college students in Eastern China: A structural equation model. Front. Public Health 2022, 10, 853928. [Google Scholar] [CrossRef] [PubMed]
  37. Mohee, K.; Haboubi, H.N.; Protty, M. Comparison of an e-learning package with lecture-based teaching in the management of supraventricular tachycardia (SVT): A randomised controlled study. Postgrad. Med. J. 2020, 98, 187–192. [Google Scholar] [CrossRef]
  38. Sikkens, J.J.; Caris, M.G.; Schutte, T.; Kramer, M.H.; Tichelaar, J.; van Agtmael, M.A. Improving antibiotic prescribing skills in medical students: The effect of e-learning after 6 months. J. Antimicrob. Chemother. 2018, 73, 2243–2246. [Google Scholar] [CrossRef]
  39. Wan, Z.; Wang, Y.; Haggerty, N. Why people benefit from e-learning differently: The effects of psychological processes on e-learning outcomes. Inf. Manag. 2008, 45, 513–521. [Google Scholar] [CrossRef]
  40. Mais, A.N.; Luae, A.T.; Ferial, M.A.A. Estimating students’ online learning satisfaction during COVID-19: A discriminant analysis. Heliyon 2021, 7, e08544. [Google Scholar]
  41. Mehall, S. Purposeful interpersonal interaction in online learning: What is it and how is it measured? Online Learn. 2020, 5, 182–204. [Google Scholar]
  42. Wu, D.G.; Li, W. Stage characteristics of large-scale online teaching in Chinese universities: Empirical research based on group investigation of students, faculty and academic staff. J. East China Norm. Univ. 2020, 38, 1–30. [Google Scholar] [CrossRef]
Figure 1. Average academic record of undergraduate students in each semester from 2017 to 2021.
Figure 1. Average academic record of undergraduate students in each semester from 2017 to 2021.
Sustainability 14 14070 g001
Table 1. Major type and population distribution of the research data.
Table 1. Major type and population distribution of the research data.
SpecialtyClass of 2017 2Class of 2018 2Class of 2019 2Class of 2020Class of 2021Total
Finance and banking808985101120475
E-commerce6870626179340
Human resources management7470797079372
Marketing6861545074307
Environmental economics3432313539171
Management information system3732353540179
Financial management9478798682419
Accounting 1-817386119359
Total4555134985246322622
1 In 2018, the school started recruiting students majoring in accounting. 2 Students from the classes of 2017–2019 fully participated in online courses for one semester during the pandemic.
Table 2. Data grouping by semester (N = 123,208).
Table 2. Data grouping by semester (N = 123,208).
SemesterSampleMean 2Standard DeviationStandard Error of MeanSkewnessKurtosisConfidence Interval
Up LimitDown Limit
First semester of 2017–2018486582.7389.9530.143−1.1512.96582.45883.018
Second semester of 2017–2018472379.33911.9520.174−1.6415.48978.79879.480
First semester of 2018–201910,55579.55611.0670.108−1.2574.52279.34579.767
Second semester of 2018–201910,58880.15310.9560.106−1.6137.21279.94480.361
First semester of 2019–202016,75180.25010.9730.085−1.4575.85280.08380.416
Second semester of 2019–2020 117,16680.9159.5850.071−1.3766.25880.77181.058
First semester of 2020–202118,71482.0029.7080.073−1.2995.18581.86382.161
Second semester of 2020–202119,30280.97610.2830.074−1.2584.76680.72781.118
First semester of 2021–202220,54481.68910.4820.073−1.1633.32081.53981.826
Sum123,20880.90510.4580.030−1.3585.24380.84780.963
All the data correspond to students of classes 2017–2021, excluding students from 2016 and before. 1 The COVID-19 outbreak was in January 2020, and online education was adopted only in this semester. 2 The highest mark is 100.
Table 3. Significance test of academic record grouping by semester and grade.
Table 3. Significance test of academic record grouping by semester and grade.
SemesterFirst Semester of 2017–2018Second Semester of 2017–2018First Semester of 2018–2019Second Semester of 2018–2019First Semester of 2019–2020Second Semester
of 2019–2020 1
First Semester of 2020–2021Second Semester of 2020–2021First Semester of 2021–2022
Grouping123456789
Inter-group comparison of student academic record by semester
Significant2,3,4,5,
6,7,8,9
1,4,5,
6,7,8,9
1,4,5,
6,7,8,9
1,2,3,
7,8,9
1,2,3,
7,8,9
1,2,3,
7,8,9
1,2,3,
4,5,7,8
1,2,3,
4,5,6,7,9
1,2,3,
4,5,6,8
Not significant-325,64,64,59-7
Inter-group comparison of student academic record by semester and grade
Class of 2017Significant2,3,4,5,
6,7,8
1,3,4,
5,6,8
1,2,4,
5,6,8
1,2,3,
7
1,2,3,
6,7
1,2,3,
5,7
1,4,5,
6,8
1,2,3,
7
N/A
Not significant-775,6,84,84,82,34,5,6N/A
Class of 2018SignificantN/AN/A4,5,7,
8,9
3,5,7,
8
3,4,6,
7,8,9
5,7,83,4,5,
6,8,9
3,4,5,
6,7,9
3,5,
7,8
Not significantN/AN/A66,9-3,4,9--4,6
Class of 2019SignificantN/AN/AN/AN/A6,7,8,
9
5,95,95,95,6,7,8
Not significantN/AN/AN/AN/A-7,86,86,7-
Class of 2020SignificantN/AN/AN/AN/AN/AN/A8,977
Not significantN/AN/AN/AN/AN/AN/A-98
1 COVID-19′s outbreak was in January 2020, and online education was adopted only in this semester. The numbers (1–9) of the between-group difference comparison represent different semesters. N/A means no data. The Kruskal–Wallis rank sum test was used for multiple between-group comparisons, and the significance values were adjusted by Bonferroni correction method. Significant means of students’ academic record in this group (semester) differed from those of other groups (semesters) at the p = 0.001 level. Not significant means of students’ academic record in this group (semester) did not differ from other groups (semesters) at the p = 0.05 level.
Table 4. Multiple linear regression results of dummy variables.
Table 4. Multiple linear regression results of dummy variables.
Non-Standardized CoefficientStandardized CoefficienttpF
BStandard ErrorBeta
All classesConstant80.7150.08 1014.9440.000114.048 (0.000)
12.0230.1690.03811.9560.000
2−1.5760.171−0.029−9.2060.000
3−1.1590.129−0.031−8.9910.000
4−0.5620.129−0.015−4.3660.000
5−0.4650.113−0.015−4.1120.000
71.2870.110.04411.6860.000
80.1580.1090.0051.4420.149
90.9680.1080.0358.9840.000
Class of 2017Constant81.2660.144 564.9180.00074.412 (0.000)
11.4720.2120.0476.9390.000
2−2.1270.214−0.067−9.9470.000
3−2.7710.203−0.094−13.6540.000
4−1.1510.209−0.034−5.5960.000
5−1.2710.202−0.04−5.8030.000
7−1.8430.305−0.036−6.0460.000
8−0.2990.37−0.005−0.8090.419
Class of 2018Constant80.5730.125 644.6080.00090.762 (0.000)
30.2620.1930.0081.3560.175
4−0.7640.186−0.026−4.0990.000
5−2.2020.179−0.079−12.2790.000
71.7380.1770.0609.6220.000
81.6510.1740.0289.2330.000
9−0.6630.257−0.014−2.5830.010
Class of 2019Constant80.2540.145 554.3530.00063.523 (0.000)
52.7770.2070.10213.3970.000
70.2970.1960.0121.5150.130
80.3040.1930.0131.5730.116
91.3550.1920.0577.0710.000
Notes: 1 = first semester of the academic year 2017–2018; 2 = second semester, 2017–2018; 3 = first semester, 2018–2019; 4 = second semester, 2018–2019; 5 = first semester, 2019–2020; 7 = first semester, 2020–2021; 8 = second semester, 2020–2021; and 9 = first semester, 2021–2022. The reference group is 6 (second semester of 2019–2020).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Geng, J.; Xun, S.; Yang, J.; Yang, N. Online Education and Undergraduates’ Academic Record during the COVID-19 Pandemic in China: Evidence from Large-Scale Data. Sustainability 2022, 14, 14070. https://doi.org/10.3390/su142114070

AMA Style

Geng J, Xun S, Yang J, Yang N. Online Education and Undergraduates’ Academic Record during the COVID-19 Pandemic in China: Evidence from Large-Scale Data. Sustainability. 2022; 14(21):14070. https://doi.org/10.3390/su142114070

Chicago/Turabian Style

Geng, Jichao, Shoukui Xun, Jian Yang, and Na Yang. 2022. "Online Education and Undergraduates’ Academic Record during the COVID-19 Pandemic in China: Evidence from Large-Scale Data" Sustainability 14, no. 21: 14070. https://doi.org/10.3390/su142114070

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop