Next Article in Journal
Optimizing Phosphorus Application Rate and the Mixed Inoculation of Arbuscular Mycorrhizal Fungi and Phosphate-Solubilizing Bacteria Can Improve the Phosphatase Activity and Organic Acid Content in Alfalfa Soil
Next Article in Special Issue
Qualitative Analyses of e-Learning Implementation and Hybrid Teaching during the COVID-19 Pandemic at Spanish Universities
Previous Article in Journal
How Corporate Social Responsibility Affects Firm Performance: The Inverted-U Shape Contingent on Founder CEO
Previous Article in Special Issue
Understanding Chinese EFL Learners’ Acceptance of Gamified Vocabulary Learning Apps: An Integration of Self-Determination Theory and Technology Acceptance Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Students’ Affective Learning Outcomes and Academic Performance in the Blended Environment at University: Comparative Study

Institute of Humanities, Peter the Great Saint-Petersburg Polytechnic University, 195251 St. Petersburg, Russia
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(18), 11341; https://doi.org/10.3390/su141811341
Submission received: 20 July 2022 / Revised: 31 August 2022 / Accepted: 7 September 2022 / Published: 9 September 2022
(This article belongs to the Special Issue Digitalization of Education: Technology Enhanced Learning)

Abstract

:
This study examines how the gender of students and their level of education (undergraduate or postgraduate students) influence affective learning outcomes in a mixed environment. The research model is based on four key indicators: satisfaction, perception of experience (perceived usefulness, ease of use, and perceived behavioral control), perception of benefits (general learning effectiveness, knowledge sharing and increasing, study skills improvement, and sense of progress), and academic performance. Moderating factors, including gender and education level, were used to define the distinctions in the measured results. The study was conducted in the fall semester of 2021. The target samples were students of undergraduate and postgraduate levels studying during the semester in the blended environment. A total of 513 students from Peter the Great Polytechnic University took part in the research. The online questionnaire was conducted to define the affective learning outcomes of students in the blended environment and the influence of affective outcome factors on academic performance. The Likert-type five-point scale was used to determine all the variables. For our statistical analysis, we used SPSS 24.0 and SmartPLS 3.0 programs. Two tests were implemented to determine the differences between gender and education level in relation to students’ affective learning outcomes. Finally, our study revealed how distinctive aspects of affective learning outcomes impact academic learning outcomes in a blended format using linear regression analysis. According to the results obtained, the results between males and females were similar and academic performance results were mostly predicted by satisfaction level. A difference was revealed between undergraduate students’ results and postgraduate students’ results. Perceived benefit has a greater effect on academic performance for postgraduate students, while satisfaction level has a greater effect on academic performance results for undergraduate students than for postgraduate students.

1. Introduction

Blended learning is a form of combining online learning with traditional learning. The introduction of blended learning has changed the way higher education resources are provided. Although blended learning was initially used as non-formal learning, during the pandemic, the issue of introducing blended learning as part of formal campus education was especially relevant. Blended learning has been implemented in various practices, from undergraduate to postgraduate education. Learning assessment is one of the most important aspects [1]. A variety of assessment methods naturally emerge in response to the need to measure learning outcomes. While there is debate about the various methods that can be used as an assessment of learning in a blended environment, they have not paid attention to the relationship between learning outcomes and assessment tools in a wide range of higher education disciplines. Evaluation should be the main factor at the very beginning of course design in a blended environment, not a later addition [2]. However, due to the COVID-19 pandemic, the situation has not given enough time to develop quality assessment tools. The alignment between learning objectives, learning outcomes, and assessment tools is important to ensure that learners achieve the necessary course achievement. Assessing learning outcomes is key to measuring actual student achievement, which is also critical to examining the effectiveness of teaching methods and student learning [1].
This paper investigates university students’ affective learning outcomes and academic performance in a blended environment in the academic years 2020–2021. This is a comparative study which has used gender and education level to define the differences in the measured indicators. Factors identifying affective learning outcomes in a blended format were analyzed.
Specifically, this study focused on three major research questions:
  • Are students’ affective learning outcomes and academic performance in blended learning affected by gender?
  • Are students’ affective learning outcomes and academic performance in blended learning affected by the education levels of students’ degrees, including undergraduate (UG), and post-graduate (PG) degrees?
  • To what extent do students’ affective learning outcomes predict students’ academic performance? Is there a difference by gender or by education level?
The structure of the paper is as follows: Section 1 presents the theoretical background to the investigation; Section 2 describes the developed research model and hypothesis as well as the methodology of the current research; in Section 3, the validity testing results and analysis of students’ affective learning outcomes and academic performance in a blended learning environment are discussed; Section 4 presents the comparison of our research with previous studies; and Section 5 concludes the findings.

1.1. Background

1.1.1. Blended Learning

Online learning has become widespread due to the development of technology [1,2,3,4]. The consequence of the COVID-19 pandemic has been a change in the format of the educational process, including online or blended learning [5,6,7].
For the current study, blended learning refers to the integration of two types of learning—online learning and face-to-face learning [8,9,10]. This educational model has such features as flexibility, access to a variety of educational resources, and the interactivity of traditional learning.
Early research on blended learning focused on the theoretical aspects of the educational model, the use of resources and learning content, the creation of a supportive educational environment, and the evaluation of the effectiveness of blended learning in several dimensions, such as educational outcomes, skill development, and learning satisfaction [11,12,13,14,15]. Most research findings reflect the effectiveness of blended learning versus face-to-face learning [16,17,18,19,20,21]. There are also studies [22,23] showing a positive attitude towards blended learning through flexible learning opportunities and promoting innovation, which deserves further research.

1.1.2. Affective Outcomes

Affective outcomes indicate students’ perceptions of their education in a blended environment. To determine aspects of affective learning in a blended environment, student satisfaction with the course (positive assessment of courses), perceptions of the learning experience (students’ perceptions of evaluation of learning on the course), and benefits (students’ perception of improved learning) were examined.
Satisfaction was examined in seven studies. As a result of studies, participants in courses in a blended learning environment have given their courses positive ratings [24,25,26]. For example, de Lima and Zorrilla [27] assessed student satisfaction with the achievement of learning objectives. The results of the study indicated that the students were completely satisfied with the communication with their peers, especially highlighting the support and comments from peers as well as the sharing of resources by other participants. K. Lee [28] and Rabin and Kalman and Kaltz [29] also evaluated student satisfaction with the educational process. A study by Watson, Watson, Yu, Alamri, and Muller [30] examined student satisfaction more specifically. The applicants of the course expressed their satisfaction with the study of the course, the learning process, and tasks. Comparative analysis revealed that men’s satisfaction with the course was lower than that of women. In addition, instructor-led students were less satisfied than students doing research.
Studies on the emotional state of students were considered. For example, one study [31] explored the perceptions of students who report that the course is boring or, on the contrary, are satisfied with the course. Loizzo et al. [32] studied the concept of enjoyment students get from the educational process in a mixed environment. In a study by L. Wang, Hu, and Zhou [33], students’ emotional tendencies (joy, sadness, anger, disappointment, surprise, pride, falling in love, and fear) were analyzed. We also reviewed studies examining participant perceptions of learning [25,34,35]. For example, Poquet et al. [36] and Kovanovich et al. [37] focused on aspects related to the social presence of students (i.e., group cohesion, open communication, and emotional expression) in a mixed environment.
Studies on student attitudes towards such factors as course design and content, interaction with the teacher, simplicity and ease of use of the course, its usefulness, and control were also considered [29,34,37,38,39,40,41]. Moreover, in these studies, the problems that students faced while studying in a blended learning environment were considered. According to Shapiro et al. [42] and Watson et al. [30], students experienced a heavy workload, a lack of discussion practice, a lack of prior knowledge, and a lack of time to master the material [40,43].
Studies were reviewed that reflected the benefits of learning noted by students. Some studies have looked at the motivation of course participants [26,32] and evaluated the effectiveness of blended learning environments [38]. For example, Shapiro et al. [42] identified motivations for students to study online. Such as enrichment of knowledge and improvement of skills, and the development of a future career is especially highlighted. DeBoer, Haney, Atiq, Smith, and Cox [44] conducted a study to examine student self-efficacy in a blended learning environment on neuroscience topics. At the end of this course, students showed a significant increase in self-efficacy as a result of the study. Some studies [32,45] investigated students’ perceptions of behavioral learning (i.e., affective, behavioral, and cognitive learning) in a blended learning environment. In addition, several studies have looked at other benefits of blended learning environments, such as learning effectiveness [34,43], knowledge sharing [40,46], improved learning skills [47], sense of progress [34], confidence [25,48], and user persistence [39,49].
The analyzed studies describe the factors that make it possible to study the attitudes of students and affective learning outcomes. However, we believe that these factors can be combined in different ways depending on the conditions of the study, forming one research model. The use of this type of analysis in a mixed educational environment has not been previously used in the literature. In addition, an important condition for such analysis is the epidemiological situation in which a mixed educational environment was introduced abruptly without prior preparation.
We fill these gaps in the literature by providing an integrated conceptual framework for examining the influence of various factors on affective learning outcomes and academic performance of students in a blended learning environment, given the perceived benefits, perceived experience, and student satisfaction. We consider these factors as a prior attitude towards learning within a blended environment, which, in turn, influences students’ intention to continue learning and improve their academic performance.
Innovation diffusion theory [50] provides a theoretical framework for current research. Diffusion theory states that the decision to innovate consists of five stages: knowledge, persuasion, decision, implementation, and confirmation [50]. Based on Rogers’ conceptualization, we further suggest seven proposed characteristics of innovation that influence people’s decisions to innovate: perceived usefulness, ease of use, perceived behavioral control, general learning effectiveness, knowledge sharing and increasing, study skills improvement, and sense of progress. We singled out these categories as they directly affect academic performance and students’ attitudes towards a mixed environment. In the context of affective learning outcomes in a blended environment, which represents an innovation in the educational environment, this theory can help explain how the perception of innovative characteristics of blended learning affects affective learning outcomes.

2. Materials and Methods

2.1. Research Model

The training was built on flipped classroom activities and project-based learning as pedagogical tools to create a blended learning environment. Work on each module of the discipline is divided into four stages. The first stage of work consists of the independent work of students with theoretical material. For this, the Moodle electronic educational platform is used, which provides the necessary materials and links to additional sources of information.
At the classroom lesson (stage 2), students are given time to discuss the studied material, answering students’ questions. Furthermore, various tasks for the application of theoretical material are proposed. During the lesson, students discuss new terminology that is incomprehensible in self-study and consider ways to apply the information in practice.
The basis of the 3rd stage is teamwork. It is necessary to divide the group into 3–4 small subgroups of students, each of which studies the proposed section of the theoretical material. Then, during a class session, students discuss the material they have learned with other groups, sharing key concepts and terms. At the end of each block of theoretical material, questions for reflection and analysis are presented. The whole group is invited to collectively answer the questions posed (teamwork). The electronic educational platform Moodle presents video and audio materials on the topics being studied, which allow you to better understand the theoretical material.
The final 4th stage consists of design work. Students are offered a task in the format of a case study with questions. After studying the case, students prepare a presentation, either in their teams or individually, about their proposed solution to the problem and answer questions (project class).
The research model (Figure 1) is based on four key indicators: satisfaction, perception of experience (perceived usefulness, ease of use, and perceived behavioral control), perception of benefits (general learning effectiveness, knowledge sharing and increasing, study skills improvement, and sense of progress), and academic performance. Moderating factors, including gender and education level, were used to define the differences in the measured outcomes.
In order to predict students’ differences in affective outcomes and academic performance between genders and education level, the following hypotheses are put forward:
Hypothesis 1a (H1a).
Students’ affective learning outcomes in blended environment are affected by gender.
Hypothesis 1b (H1b).
Students’ academic performance in blended environment is affected by gender.
Hypothesis 2a (H2a).
Students’ affective learning outcomes in blended environment are affected by education level.
Hypothesis 2b (H2b).
Students’ academic performance in blended environment is affected by education level.
Hypothesis 3 (H3).
Students’ affective learning outcomes significantly and positively affect academic performance in blended environment.
Hypothesis 4 (H4).
Gender significantly influences the relationship between affective learning outcomes and academic performance.
Hypothesis 5 (H5).
Education level significantly influences the relationship between affective learning outcomes and academic performance.

2.2. Data Collection

The study was conducted in the fall semester of 2021 (15 learning weeks). The target samples were students of undergraduate and postgraduate levels studying during the semester in the blended environment. A total of 544 students of Peter the Great Polytechnic University took part in the online questionnaire (Appendix A) on a voluntary basis, 513 data were used in the study due to the incomplete nature of 31. According to the demographic data, 46.98% and 53.02% were male and female students, so gender distribution was quite balanced. All students were from humanities fields of study: 34.70%—students of linguistic sciences, 45.61%—students of legal sciences, and 19.69%—students of psychological sciences (Table 1). The age of the respondents ranged from 20 to 24 (mean age—22.2).
To measure academic performance, the results of professional disciplines were taken. Among postgraduate students, the academic results of the 1st year master students were considered. The online questionnaire was conducted in the Moodle system to define the affective learning outcomes of students in a blended environment during the COVID-19 pandemic and the influence of affective outcome factors on academic performance. The Likert-type five-point scale was used to measure all the variables. Each question item was developed based on the existing literature and instruments in previous studies. The basis for the items measuring “perceived usefulness”, “ease of use”, and “perceived behavioral control” were the scales from Bhattacherjee [51], Ifinedo [52], and Yeap et al. [53]. To evaluate general learning effectiveness; knowledge sharing and increasing; study skills improvement; and sense of progress, we used eight items, each adopted from Valdivia Vázquez et al. [26] and Y. Jung & Lee [38]. We used the students’ semester grades in professional disciplines (four courses) as measures of academic performance (AP). Official statements were used to collect information on grades.

2.3. Data Analysis

For our statistical analysis, we used SPSS 24.0 (version 24.0, IBM, Armonk, NY, USA) and SmartPLS 3.0 (version 3.0, SmartPLS GmbH, Oststeinbek, Germany) programs. To compare students’ affective learning outcomes scores in the blended environment, the average scores and standard deviations (σ) of students on 18 items were used. Two tests were implemented to determine the differences between gender and education level in relation to students’ affective learning outcomes. A Student’s t-test for independent samples was used to calculate the statistical differences between gender and education level across the eight dimensions. Finally, our study also attempted to reveal whether the main factors of affective learning outcomes predict the academic learning outcomes in a blended format using linear regression analysis. We also compared the results of different groups of students, including male and female students, as well as postgraduate (PG) and undergraduate (UG) students.

3. Results

3.1. The Normality and Validity Testing

We analyzed the data normality test with the skewness and kurtosis values on each variable, which were between −0.778 to −0.211 and −0.916 to 5.794, thus we concluded that the data observed was normally distributed. It has been established that the reliability test reflects the internal stability and consistent level of each measurement questionnaire. Therefore, a questionnaire with good reliability was obtained with a Cronbach α > 0.7. In the current study, the Cronbach’s α value on each construct was from 0.76–0.93. This confirmed the existence of high questionnaire reliability and internal consistency between latent variables. We also calculated the loading factor, C.R., and AVE to assess convergence validity. Convergent validity was indicated by an item factor loading ≥ 0.5 [54], AVE ≥ 0.5, and CR ≥ 0.7 [55]. The AVE, loading factor, and C.R. values ranged from 0.62 to 0.91, from 0.72 to 0.96, and from 0.68 to 0.92, respectively, indicating very good convergent validity for this model (Table 2).
In addition, due to the cross-loading criterion, there is the presence of discriminant validity between all constructs as the loading indicators on their own constructs are in all cases higher than all their cross loadings with other constructs (Table 3).

3.2. Students’ Affective Learning Outcomes and Academic Performance for Different Genders

We used an independent sample t-test to determine the differences between male and female students’ affective learning outcomes and academic performance in a blended environment. Table 4 summarizes the results.
According to Table 4, the female students’ mean scores were generally higher than the male students’ mean scores for almost all considered indicators of affective learning outcomes and academic performance in a blended learning environment. The differences between the two tested groups were significant in two indicators—ease of use (p < 0.05) and academic performance (p < 0.01). Males experienced blended learning with less difficulty, while the average academic performance scale was higher for females.

3.3. Students’ Affective Learning Outcomes and Academic Performance for Different Education Level

We also used an independent sample t-test to investigate the differences between undergraduates’ and postgraduates’ affective learning outcomes and academic performance in a blended environment. Table 5 presents the results.
The positive value of the mean difference demonstrates that the mean scores of the undergraduates are higher than those of the postgraduates, while the negative value reflects the reverse. According to the results, UG and PG students showed significant differences in almost all measurement factors, including perceived usefulness (p < 0.01), perceived behavioral control (p < 0.05), general learning effectiveness (p < 0.05), study skills improvement (p < 0.05), sense of progress (p < 0.05), satisfaction (p < 0.01), and academic performance (p < 0.05).

3.4. Regression Analysis

The results of the linear regression analysis conducted to analyze whether the affective learning outcomes of the university students predicted the academic performance scales are presented in Table 6.
According to Table 6, the affective learning outcomes predict the academic performance results of the students in a significantly positive way (β ranged from 0.23 to 0.44; t ranged from 4.58 to 12.87). The results between males and females are similar and the academic performance results were mostly predicted by satisfaction level (R2 = 0.58, adjusted R2 = 0.52 for males, R2 = 0.63, adjusted R2 = 0.60 for females).
The results of the linear regression analyses conducted to analyze whether the affective learning outcomes of the university undergraduate and graduate students predicted the academic performance scales are presented in Table 7.
Table 7 summarizes the affective learning outcomes predicting the academic performance of the undergraduate and postgraduate students in a positive way (β ranged from 0.22 to 0.46, and t ranged from 4.51 to 13.27). A difference was revealed between undergraduate students’ results and postgraduate students’ results. A total of 44% of the total variance of the academic performance scores for postgraduate students can be explained by the perceived benefit scores (R2 = 0.59, adjusted R2 = 0.55), while only 25% of the total variance of the academic performance scores for undergraduate students can be explained by the perceived benefit scores (R2 = 0.23, adjusted R2 = 0.20). Thus, perceived benefit has a greater effect on academic performance for postgraduate students. A total of 46% of the total variance of the academic performance scores for undergraduate students can be explained by the satisfaction level (R2 = 0.60, adjusted R2 = 0.57), while only 32% of the total variance of the academic performance scores for postgraduate students can be explained by the satisfaction level (R2 = 0.37, adjusted R2 = 0.34). Thus, satisfaction level has a greater effect on academic performance results for undergraduate students than for postgraduate students.
Generally, it was found that satisfaction was the factor that mostly influenced students’ academic performance in a blended environment in this research.

4. Discussion

This study aimed to examine students’ affective learning outcomes and academic performance in a blended learning environment. Nine measurement items were used for the study to analyze gender differences and differences between undergraduate and postgraduate students within our research model. We also investigated whether gender or education level significantly influences the relationship between affective learning outcomes and academic performance.
According to the results obtained, female students, on average, showed higher scores than male students in all considered indicators of affective learning outcomes and academic achievement in blended learning settings. Differences between the two test groups were significant in two dimensions—ease of use and academic performance. Men experienced less difficulty with blended learning, while the average academic achievement scale was higher for women. It can be concluded that men are more receptive and adaptive to the blended environment. However, this did not allow them to get higher results in academic achievements. Female students, despite more difficulties with blended learning, were able to learn the material better.
The study also showed that postgraduate students perceive blended learning much better than undergraduates. Postgraduate students showed significant differences in almost all measured factors, including perceived usefulness, perceived behavioral control, general learning effectiveness, knowledge sharing and increasing, sense of progress, satisfaction, and academic achievement. This can be explained by the fact that postgraduate students have gone through a longer educational path, have more experience in obtaining knowledge, which helps them learn more effectively in a mixed environment. Thus, it is worth paying more attention to undergraduates when including them in blended learning.
Based on the study, it can be concluded that, as in previous studies [25,26,32,49], the selected factors do have a significant impact on affective learning outcomes in a blended environment. The analysis agrees with the findings from other studies [34,37,38]. A distinguishing feature of the current study is the use of moderating factors such as gender and education level. It is important to note that educational technologies do not always work equally effectively for all groups of students. Past research [13,16,19,28] has identified scoring factors that are truly relevant to current research and have a significant impact on academic achievement and affective learning outcomes. Thanks to previous studies [7,8,35,48], we were able to form a model for the current study. However, the contribution of current work in the study is in the categories of students.
However, a distinctive feature of this study is the study of the significance of the considered factors on the results of students in male and female groups separately, as well as separately for undergraduate and postgraduate students. Thus, the practical application of the results of this study will be to the category of students in the implementation of blended learning. So, we know that it is more difficult for a group of female students to study in a blended environment, however, they cope no worse than a group of male students, but perhaps for female students the learning process becomes more labor-intensive. Undergraduate students also need to be treated more carefully, offering them possible additional instructions and training materials, as well as more sensitive supervision.

5. Conclusions

The findings of the current study have several important implications for educators when implementing live online learning in the future. It can be used by university leaders and teachers, who will be able to direct all their efforts to improving students’ satisfaction with blended learning, since satisfaction has a direct impact on the affective learning outcomes in a blended environment. Based on the results of the study, educational program developers can structure courses by discipline in such a way that a mixed environment has a positive effect on affective learning outcomes and student satisfaction. An important task is to organize blended learning in such a way that students (especially undergraduate students) feel the benefits of taking the course, are motivated to receive and share knowledge, feel progress, and increase their own knowledge base. To do this, it is important to distribute the course and balance between the online environment and face-to-face classes so that students feel the effectiveness of learning.
The limitations of the study are associated with the sample, as we investigated students’ perceptions and behaviors only in Russia while the COVID-19 pandemic and blended learning are common worldwide. The study was based on humanities students, while students from technical institutions could have their own characteristics, and their affective learning outcomes and academic performance results in a blended environment may differ. It is also important to note that for such an analysis, it is possible to use other approaches related to mediation and moderation effects. This study was based only on differences in education and gender, but there are other characteristics that require special attention.

Author Contributions

Conceptualization, A.K. and E.T.; methodology, A.K.; software, T.B.; validation, A.K., E.T. and T.B.; formal analysis, A.K.; investigation, E.T.; resources, T.B.; data curation, T.B.; writing—original draft preparation, A.K.; writing—review and editing, A.K.; visualization, E.T.; supervision, T.B.; project administration, A.K.; funding acquisition, E.T. All authors have read and agreed to the published version of the manuscript.

Funding

The research is partially funded by the Ministry of Science and Higher Education of the Russian Federation under the strategic academic leadership program “Priority 2030” (Agreement 075-15-2021-1333 dated 30 September 2021).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of Institute of Humanities (protocol code 715, 1 September 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Students measured “To what extent do you agree or disagree with the following statements”.
ConstructScale
1Perceived usefulnessPU 1 I believe that using blended learning technologies would improve my ability to learn
PU 2 I believe that blended learning technologies would allow me to get my work done more quickly
PU 3 I believe that blended format would be useful for my learning
2Ease of useEU 1 It was easy for me to learn in blended environment
EU 2 I do not notice any inconsistencies as I learn in blended environment
3Perceived behavioral controlPBC 1 I have sufficient extent of knowledge to use blended learning
PBC 2 I have sufficient extent of control to make a decision to adopt blended learning
PBC 3 I have sufficient extent of self-confidence to make a decision to adopt blended learning
4General learning effectivenessGLE 1 I achieved the objectives of the learning program in a blended environment
GLE 2 The quality of the learning course in blended environment was high.
5Knowledge sharing and increasingKSI 1 My overall professional knowledge increased after the blended learning course
KSI 2 I was able to share my knowledge with peers during the blended learning course
6Study skill improvementSSI 1 Due to the blended learning course I improved my time management skills
SSI 2 I Due to the blended learning course I improved my problem-solving skills
7Sense of progressSP 1 I feel the general improvement in my knowledge and skills after the blended learning course
SP 2 I feel a progress of my professional development after the blended learning course
8SatisfactionSAT 1 My overall experience with blended learning was very satisfying
SAT 2 My overall experience with blended learning was very pleasing

References

  1. Bediang, G.; Stoll, B.; Geissbuhler, A.; Klohn, A.M.; Stuckelberger, A.; Nko’o, S.; Chastonay, P. Computer literacy and E-learning perception in Cameroon: The case of Yaounde Faculty of Medicine and Biomedical Sciences. BMC Med. Educ. 2013, 13, 57. [Google Scholar] [CrossRef] [PubMed]
  2. Choules, A.P. The use of elearning in medical education: A review of the cur-rent situation. Postgrad. Med. J. 2007, 83, 212–216. [Google Scholar] [CrossRef]
  3. Olum, R.; Atulinda, L.; Kigozi, E.; Nassozi, D.R.; Mulekwa, A.; Bongomin, F.; Kiguli, S. Medical education and E-learning during COVID-19 pandemic: Aware-ness, attitudes, preferences, and barriers among undergraduate medicine and nursing students at Makerere University, Uganda. J. Med. Educ. Curric. Dev. 2020, 7, 2382120520973212. [Google Scholar] [CrossRef]
  4. Rouleau, G.; Gagnon, M.P.; Côté, J.; Payne-Gagnon, J.; Hudson, E.; Dubois, C.A.; Bouix-Picasso, J. Effects of e-learning in a continuing education context on nursing care: Systematic review of systematic qualitative, quantitative, and mixed-studies reviews. J. Med. Internet Res. 2019, 21, e15118. [Google Scholar] [CrossRef] [PubMed]
  5. Abbasi, M.S.; Ahmed, N.; Sajjad, B.; Alshahrani, A.; Saeed, S.; Sarfaraz, S.; Abduljabbar, T. E-Learning perception and satisfaction among health sciences students amid the COVID-19 pandemic. Work 2020, 67, 549–556. [Google Scholar] [CrossRef] [PubMed]
  6. Alsoufi, A.; Alsuyihili, A.; Msherghi, A.; Elhadi, A.; Atiyah, H.; Ashini, A.; El-hadi, M. Impact of the COVID-19 pandemic on medical education: Medical students’ knowledge, attitudes, and practices regarding electronic learning. PLoS ONE 2020, 15, e0242905. [Google Scholar] [CrossRef]
  7. Camargo, C.P.; Tempski, P.Z.; Busnardo, F.F.; Martins, M.D.A.; Gemperli, R. Online learning and COVID-19: A meta-synthesis analysis. Clinics 2020, 75, e2286. [Google Scholar] [CrossRef]
  8. Jowsey, T.; Foster, G.; Cooper-Ioelu, P.; Jacobs, S. Blended learning via distance in pre-registration nursing education: A scoping review. Nurse Educ. Pract. 2020, 44, 102775. [Google Scholar] [CrossRef]
  9. Leidl, D.M.; Ritchie, L.; Moslemi, N. Blended learning in undergraduate nursing education—A scoping review. Nurse Educ. Today 2020, 86, 104318. [Google Scholar] [CrossRef]
  10. Li, C.; He, J.; Yuan, C.; Chen, B.; Sun, Z. The effects of blended learning on knowledge, skills, and satisfaction in nursing students: A meta-analysis. Nurse Educ. Today 2019, 82, 51–57. [Google Scholar] [CrossRef] [PubMed]
  11. Gerdprasert, S.; Pruksacheva, T.; Panijpan, B.; Ruenwongsa, P. Development of a web-based learning medium on mechanism of labour for nursing students. Nurse Educ. Today 2010, 30, 464–469. [Google Scholar] [CrossRef] [PubMed]
  12. Gerdprasert, S.; Pruksacheva, T.; Panijpan, B.; Ruenwongsa, P. An interactive web-based learning unit to facilitate and improve intrapartum nursing care of nursing students. Nurse Educ. Today 2011, 31, 531–535. [Google Scholar] [CrossRef] [PubMed]
  13. Koch, C.; Brich, J. The feasibility and effectiveness of a blended-learning course for detecting and avoiding bias in medical data: A pilot study. BMC Med. Educ. 2020, 20, 408. [Google Scholar] [CrossRef] [PubMed]
  14. Sáiz-Manzanares, M.C.; Escolar-Llamazares, M.C.; Arnaiz González, Á. Effectiveness of blended learning in nursing education. Int. J. Environ. Res. Public Health 2020, 17, 1589. [Google Scholar] [CrossRef]
  15. Vallée, A.; Blacher, J.; Cariou, A.; Sorbets, E. Blended learning compared to traditional learning in medical education: Systematic review and meta-analysis. J. Med. Internet Res. 2020, 22, e16504. [Google Scholar] [CrossRef]
  16. Huang, T.H.; Liu, F.; Chen, L.C.; Tsai, C.C. The acceptance and impact of Google Classroom integrating into a clinical pathology course for nursing students: A technology acceptance model approach. PLoS ONE 2021, 16, e0247819. [Google Scholar] [CrossRef]
  17. Cao, W.; Hu, L.; Li, X.; Li, X.; Chen, C.; Zhang, Q.; Cao, S. Massive Open Online Courses-based blended versus face-to-face classroom teaching methods for fundamental nursing course. Medicine 2021, 100, e24829. [Google Scholar] [CrossRef]
  18. Moon, H.; Hyun, H.S. Nursing students’ knowledge, attitude, self-efficacy in blended learning of cardiopulmonary resuscitation: A randomized controlled trial. BMC Med. Educ. 2019, 19, 414. [Google Scholar] [CrossRef]
  19. Kaveevivitchai, C.; Chuengkriankrai, B.; Luecha, Y.; Thanooruk, R.; Panijpan, B.; Ruenwongsa, P. Enhancing nursing students’ skills in vital signs assessment by using multimedia computer-assisted learning with integrated content of anatomy and physiology. Nurse Educ. Today 2009, 29, 65–72. [Google Scholar] [CrossRef]
  20. Castillo, J.; Gallart, A.; Rodríguez, E.; Castillo, J.; Gomar, C. Basic life support and external defibrillation competences after instruction and at 6 months comparing face-to-face and blended training. Randomised trial. Nurse Educ. Today 2018, 65, 232–238. [Google Scholar] [CrossRef]
  21. Gouifrane, R.; Lajane, H.; Belaaouad, S.; Benmokhtar, S.; Lotfi, S.; Dehbi, F.; Radid, M. Effects of a Blood Transfusion Course Using a Blended Learning Approach on the Acquisition of Clinical Reasoning Skills among Nursing Students in Morocco. Int. J. Emerg. Technol. Learn. 2020, 15, 260–269. [Google Scholar] [CrossRef]
  22. Johnston, R.; Hepworth, J.; Goldsmith, M.; Lacasse, C. Use of iPodTM Technology in Medical-Surgical Nursing Courses: Effect on Grades. Int. J. Nurs. Educ. Scholarsh. 2010, 7. [Google Scholar] [CrossRef] [PubMed]
  23. Blissitt, A.M. Blended learning versus traditional lecture in introductory nursing pathophysiology courses. J. Nurs. Educ. 2016, 55, 227–230. [Google Scholar] [CrossRef] [PubMed]
  24. Khalil, M.; Ebner, M. Clustering patterns of engagement in Massive Open Online Courses (MOOCs): The use of learning analytics to reveal student categories. J. Comput. High. Educ. 2017, 29, 114–132. [Google Scholar] [CrossRef]
  25. Li, K.; Moore, D.R. Motivating students in massive open online courses (MOOCs) using the attention, relevance, confidence, satisfaction (arcs) model. J. Form. Des. Learn. 2018, 2, 102–113. [Google Scholar] [CrossRef]
  26. Vázquez, J.A.V.; Ramirez-Montoya, M.S.; Gónzalez, J.R.V. Motivation and knowledge: Pre-assessment and post-assessment of MOOC participants from an energy and sustainability project. Int. Rev. Res. Open Distrib. Learn. 2018, 19. [Google Scholar] [CrossRef]
  27. de Lima, M.; Zorrilla, M.E. Social networks and the building of learning communities: An experimental study of a social MOOC. Int. Rev. Res. Open Distrib. Learn. 2017, 18, 40–64. [Google Scholar] [CrossRef]
  28. Li, K. MOOC learners’ demographics, self-regulated learning strategy, perceived learning and satisfaction: A structural equation modeling approach. Comput. Educ. 2019, 132, 16–30. [Google Scholar] [CrossRef]
  29. Rabin, E.; Kalman, Y.M.; Kalz, M. An empirical investigation of the antecedents of learner-centered outcome measures in MOOCs. Int. J. Educ. Technol. High. Educ. 2019, 16, 14. [Google Scholar] [CrossRef]
  30. Watson, S.L.; Watson, W.R.; Yu, J.H.; Alamri, H.; Mueller, C. Learner profiles of attitudinal learning in a MOOC: An explanatory sequential mixed methods study. Comput. Educ. 2017, 114, 274–285. [Google Scholar] [CrossRef]
  31. Buhr, E.E.; Daniels, L.M.; Goegan, L.D. Cognitive appraisals mediate relationships between two basic psychological needs and emotions in a massive open online course. Comput. Hum. Behav. 2019, 96, 85–94. [Google Scholar] [CrossRef]
  32. Loizzo, J.; Ertmer, P.A.; Watson, W.R.; Watson, S.L. Adult MOOC Learners as Self-Directed: Perceptions of Motivation, Success, and Completion. Online Learn. 2017, 21, n2. [Google Scholar] [CrossRef]
  33. Wang, L.; Hu, G.; Zhou, T. Semantic analysis of learners’ emotional tendencies on online MOOC education. Sustainability 2018, 10, 1921. [Google Scholar] [CrossRef]
  34. Jung, E.; Kim, D.; Yoon, M.; Park, S.; Oakley, B. The influence of instructional design on learner control, sense of achievement, and perceived effectiveness in a supersize MOOC course. Comput. Educ. 2019, 128, 377–388. [Google Scholar] [CrossRef]
  35. Meek, S.E.; Blakemore, L.; Marks, L. Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review. Assess. Eval. High. Educ. 2017, 42, 1000–1013. [Google Scholar]
  36. Poquet, O.; Kovanović, V.; de Vries, P.; Hennis, T.; Joksimović, S.; Gašević, D.; Dawson, S. Social presence in massive open online courses. Int. Rev. Res. Open Distrib. Learn. 2018, 19. [Google Scholar] [CrossRef]
  37. Kovanović, V.; Joksimović, S.; Poquet, O.; Hennis, T.; de Vries, P.; Hatala, M.; Gašević, D. Examining communities of inquiry in Massive Open Online Courses: The role of study strategies. Internet High. Educ. 2019, 40, 20–43. [Google Scholar] [CrossRef]
  38. Jung, Y.; Lee, J. Learning engagement and persistence in massive open online courses (MOOCS). Comput. Educ. 2018, 122, 9–22. [Google Scholar] [CrossRef]
  39. Li, B.; Wang, X.; Tan, S.C. What makes MOOC users persist in completing MOOCs? A perspective from network externalities and human factors. Comput. Hum. Behav. 2018, 85, 385–395. [Google Scholar]
  40. Singh, A.B.; Mørch, A.I. An analysis of participants’ experiences from the first international MOOC offered at the University of Oslo. Nord. J. Digit. Lit. 2018, 13, 40–64. [Google Scholar] [CrossRef]
  41. Yang, H.H.; Su, C.H. Learner behaviour in a MOOC practice-oriented course: In empirical study integrating TAM and TPB. Int. Rev. Res. Open Distrib. Learn. 2017, 18, 35–63. [Google Scholar] [CrossRef]
  42. Shapiro, H.B.; Lee, C.H.; Roth, N.E.W.; Li, K.; Çetinkaya-Rundel, M.; Canelas, D.A. Understanding the massive open online course (MOOC) student experience: An examination of attitudes, motivations, and barriers. Comput. Educ. 2017, 110, 35–50. [Google Scholar] [CrossRef]
  43. Swinnerton, B.J.; Morris, N.P.; Hotchkiss, S.; Pickering, J.D. The integration of an anatomy massive open online course (MOOC) into a medical anatomy curriculum. Anat. Sci. Educ. 2017, 10, 53–67. [Google Scholar] [CrossRef] [PubMed]
  44. DeBoer, J.; Haney, C.; Atiq, S.Z.; Smith, C.; Cox, D. Hands-on engagement online: Using a randomised control trial to estimate the impact of an at-home lab kit on student attitudes and achievement in a MOOC. Eur. J. Eng. Educ. 2019, 44, 234–252. [Google Scholar] [CrossRef]
  45. Hudson, L.; Wolff, A.; Gooch, D.; Van Der Linden, J.; Kortuem, G.; Petre, M.; O’Connor-Gotra, S. Supporting urban change: Using a MOOC to facilitate attitudinal learning and participation in smart cities. Comput. Educ. 2019, 129, 37–47. [Google Scholar] [CrossRef]
  46. Stich, A.E.; Reeves, T.D. Massive open online courses and underserved students in the United States. Internet High. Educ. 2017, 32, 58–71. [Google Scholar] [CrossRef]
  47. Rodriguez, B.C.P.; Armellini, A. Developing self-efficacy through a massive open online course on study skills. Open Prax. 2017, 9, 335–343. [Google Scholar] [CrossRef]
  48. Bonafini, F.C. The effects of participants’ engagement with videos and forums in a MOOC for teachers’ professional development. Open Prax. 2017, 9, 433–447. [Google Scholar] [CrossRef]
  49. Najafi, H.; Rolheiser, C.; Harrison, L.; Heikoop, W. Connecting learner motivation to learner progress and completion in massive open online courses. Can. J. Learn. Technol. Rev. Can. L’apprentissage Technol. 2018, 44. [Google Scholar] [CrossRef]
  50. Rogers, E.M.; Singhal, A.; Quinlan, M.M. Diffusion of innovations. In An Integrated Approach to Communication Theory and Research; Routledge: England, UK, 2014; pp. 432–448. [Google Scholar]
  51. Bhattacherjee, A. Understanding information systems continuance: An expectation-confirmation model. MIS Q. 2001, 25, 351–370. [Google Scholar] [CrossRef]
  52. Ifinedo, P. Students’ perceived impact of learning and satisfaction with blogs. Int. Inf. Learn. Technol. 2017, 34, 322–337. [Google Scholar] [CrossRef]
  53. Yeap, J.A.L.; Ramayah, T.; Soto-Acosta, P. Factors propelling the adoption of m-learning among students in higher education. Elect. Mark. 2016, 26, 323–338. [Google Scholar] [CrossRef]
  54. Hair, J.F., Jr.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis, 7th ed.; Pearson Prentice Hall: Upper Saddle River, NJ, USA, 2009. [Google Scholar]
  55. Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
Figure 1. Research model.
Figure 1. Research model.
Sustainability 14 11341 g001
Table 1. Demographic data (N = 513).
Table 1. Demographic data (N = 513).
Demographic VariablesNumberPercentage
GenderMale24146.98
Female27253.02
EducationUndergraduate40378.56
Postgraduate11021.44
Field of studyLinguistics17834.70
Psychology10119.69
Law23445.61
Table 2. Measurement model.
Table 2. Measurement model.
IndicatorItemsFactor LoadingsαC.R.AVE
PUPU10.8040.8950.9100.816
PU20.821
PU30.817
EUEU10.8790.9010.8920.837
EU20.883
PBCPBC10.9060.9270.9200.889
PBC20.904
PBC30.911
GLEGLE10.9140.9040.8730.882
GLE20.876
KSIKSI10.7970.8920.9020.857
KSI20.854
SSISSI10.8110.8720.8190.797
SSI20.847
SPSP10.7240.7600.6820.624
SP20.801
SATSAT10.9610.9290.9170.911
SAT20.901
APAP10.9170.9170.9040.896
AP20.915
AP30.901
AP40.927
Table 3. Cross-loading criterion.
Table 3. Cross-loading criterion.
ConstructsPUEUPBCGLEKSISSISPSATAP
PU10.8720.4020.4960.1720.2170.3210.3140.5210.414
PU20.8920.4620.4240.1810.1810.2160.3890.4360.439
PU30.8880.4130.4660.2260.2140.1980.3610.4690.461
EU10.5770.9110.3880.0870.0330.2010.3960.3910.396
EU20.5420.8810.4010.1120.0920.2360.3120.3860.512
PBC10.4360.5340.8650.2360.1550.1340.2760.1680.476
PBC20.4960.4830.8790.3010.1970.0930.2160.0920.416
PBC30.4790.5140.8940.2580.1670.1100.3890.1790.389
GLE10.4320.3960.1920.7920.4090.3730.4130.0930.401
GLE20.4220.4140.2060.8440.3920.4160.3730.1160.373
KSI10.4080.3630.3110.4110.8160.2880.3850.1890.341
KSI20.3690.3550.2950.4010.8950.2330.4030.2040.333
SSI10.4170.3510.4180.3790.3660.8960.3850.1160.285
SSI20.3240.3990.3740.2190.4920.8410.3260.2410.217
SP1−0.0120.1270.0850.2050.5440.3630.8150.2780.119
SP2−0.0190.0920.0320.1160.4870.4310.8830.2110.183
SAT10.3790.3350.2010.0820.1180.2640.1790.9160.179
SAT20.5110.3910.1880.1130.0740.3120.2010.8950.201
AP10.1920.1690.1760.1480.2390.2460.1390.4790.839
AP20.2110.1970.2060.1100.1380.1740.1680.3140.878
AP30.2790.1130.0930.0860.2360.1160.1910.4160.891
AP40.1860.1760.1190.1290.2650.1620.1040.3620.904
Table 4. Gender differences in students’ affective learning outcomes and academic performance.
Table 4. Gender differences in students’ affective learning outcomes and academic performance.
FactorsGendert-Valuep-Value
Male (SD)Female (SD)
Affective learning outcomesPerceived experience (PE)PU3.88 (0.65)3.93 (0.69)−1.110.264
EU3.77 (0.66)3.69 (0.73)2.59 *0.042
PBC3.55 (0.72)3.49 (0.67)1.520.184
Perceived benefit (PB)GLE3.75 (0.71)3.80 (0.69)−1.450.174
KSI3.44 (0.68)3.46 (0.70)−0.980.842
SSI3.55 (0.65)3.60 (0.67)−1.510.189
SP3.70 (0.69)3.73 (0.67)−1.140.781
Satisfaction (SAT)3.91 (0.73)3.87 (0.69)1.370.211
Academic performance (AP)3.41 (0.75)3.64 (0.67)−6.76 **0.007
* p < 0.05; ** p < 0.01.
Table 5. The education level differences in students’ affective learning outcomes and academic performance.
Table 5. The education level differences in students’ affective learning outcomes and academic performance.
FactorsEducation Levelt-Valuep-Value
UG (SD)PG (SD)
Affective learning outcomesPerceived experience (PE)PU3.89 (0.70)4.11 (0.68)−6.65 **0.007
EU3.73 (0.65)3.76 (0.60)−0.370.747
PBC3.44 (0.73)3.53 (0.76)−2.73 *0.037
Perceived benefit (PB)GLE3.44 (0.73)3.53 (0.76)−2.73 *0.037
KSI3.45 (0.65)3.40 (0.67)1.96 *0.048
SSI3.57 (0.71)3.62 (0.70)−1.980.046
SP3.70 (0.66)3.81 (0.72)−3.46 *0.018
Satisfaction (SAT)3.80 (0.68)3.94 (0.65)−4.79 **0.009
Academic performance (AP)3.48 (0.75)3.56 (0.70)−2.63 *0.041
* p < 0.05; ** p < 0.01.
Table 6. Affective leaning outcomes as a predictor of academic outcomes for male and female students.
Table 6. Affective leaning outcomes as a predictor of academic outcomes for male and female students.
Males (N = 241)
BSEB β tFR2Adjusted R2
Constant2.770.090.296.02 **30.29 **0.380.35
PE0.010.005.89 **
BSEB β tFR2Adjusted R2
Constant3.170.100.317.09 **33.95 **0.310.30
PB0.010.006.47 **
BSEB β tFR2Adjusted R2
Constant4.020.120.4311.34 ***57.29 ***0.580.52
SAT0.010.0010.18 ***
Females (N = 272)
BSEB β tFR2Adjusted R2
Constant1.960.080.234.58 *20.07 *0.190.17
PE0.010.003.37 *
BSEB β tFR2Adjusted R2
Constant3.610.100.347.81 **37.53 **0.360.31
PB0.010.006.14 **
BSEB β tFR2Adjusted R2
Constant4.420.130.4412.87 ***60.29 ***0.630.60
SAT0.010.0011.56 ***
Dependent variable: Academic performance. Note: * p < 0.05; ** p < 0.01; *** p < 0.001.
Table 7. Affective learning outcomes as a predictor of academic performance for undergraduate and graduate students.
Table 7. Affective learning outcomes as a predictor of academic performance for undergraduate and graduate students.
Undergraduates (N = 403)
BSEB β tFR2Adjusted R2
Constant2.550.100.285.94 **30.11 **0.380.35
PE0.010.005.77 **
BSEB β tFR2Adjusted R2
Constant2.310.090.254.73 *21.29 **0.230.20
PB0.010.005.91 *
BSEB β tFR2Adjusted R2
Constant4.630.130.4613.27 ***61.29 ***0.600.57
SAT0.010.0012.49 ***
Postgraduates (N = 110)
BSEB β tFR2Adjusted R2
Constant2.180.080.224.51 *20.07 *0.190.17
PE0.010.004.18 *
BSEB β tFR2Adjusted R2
Constant4.980.110.4411.09 ***58.31 ***0.590.55
PB0.010.009.93 ***
BSEB β tFR2Adjusted R2
Constant3.910.100.327.66 **40.18 **0.370.34
SAT0.010.006.04 **
Dependent variable: Academic performance. Note: * p < 0.05; ** p < 0.01; *** p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kobicheva, A.; Tokareva, E.; Baranova, T. Students’ Affective Learning Outcomes and Academic Performance in the Blended Environment at University: Comparative Study. Sustainability 2022, 14, 11341. https://doi.org/10.3390/su141811341

AMA Style

Kobicheva A, Tokareva E, Baranova T. Students’ Affective Learning Outcomes and Academic Performance in the Blended Environment at University: Comparative Study. Sustainability. 2022; 14(18):11341. https://doi.org/10.3390/su141811341

Chicago/Turabian Style

Kobicheva, Aleksandra, Elena Tokareva, and Tatiana Baranova. 2022. "Students’ Affective Learning Outcomes and Academic Performance in the Blended Environment at University: Comparative Study" Sustainability 14, no. 18: 11341. https://doi.org/10.3390/su141811341

APA Style

Kobicheva, A., Tokareva, E., & Baranova, T. (2022). Students’ Affective Learning Outcomes and Academic Performance in the Blended Environment at University: Comparative Study. Sustainability, 14(18), 11341. https://doi.org/10.3390/su141811341

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop