Next Article in Journal
Carbon Cycling in Mangrove Ecosystem of Western Bay of Bengal (India)
Previous Article in Journal
Optimization of Sintering Process of Alumina Ceramics Using Response Surface Methodology
Previous Article in Special Issue
Sustainable Partnership: Operational Condition Analysis for Brand Value Co-Creation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Structural Relationship of Key Factors for Student Satisfaction and Achievement in Asynchronous Online Learning

Center for Teaching and Learning, Kyung Hee University, Seoul 02447, Korea
*
Author to whom correspondence should be addressed.
Sustainability 2021, 13(12), 6734; https://doi.org/10.3390/su13126734
Submission received: 31 March 2021 / Revised: 6 June 2021 / Accepted: 7 June 2021 / Published: 14 June 2021

Abstract

:
This study examines the structural relationship among key factors influencing student satisfaction and achievement in online learning. A structural model was developed by considering course structure, student–student interaction, instructor presence, student engagement, student satisfaction and achievement as key factors. In order to verify the effectiveness of the developed structural model, we utilized the survey data collected from a total of 250 students enrolled in two asynchronous online courses offered at Kyung Hee University in Korea in the fall semester of 2020. Then, the collected survey data were analyzed using the structural equation model. The verification of the statistical analysis results indicates that the course structure has a more significant effect on the student satisfaction and achievement than the other key factors such as the student–student interaction, instructor presence and student engagement. It also reveals that the student engagement affects only the student satisfaction and has a mediated effect between student–student interaction and student satisfaction.

1. Introduction

The COVID-19 pandemic has created significant challenges for global higher education communities and forced them to initiate online teaching and learning. During the pandemic, most universities tried to provide support for teaching and learning activities to achieve effective online learning education. However, many university students in Korea expressed dissatisfaction with the quality of the online courses they took in 2020 [1]. This was mainly because faculty members did not have enough time to prepare for their online teaching due to the rapid outbreak of COVID-19. Most faculty members were used to teaching in a face-to-face class format, but had considerably fewer actionable instructional tactics in online instruction [2]. Several researchers have suggested instructional strategies to improve the quality of online courses, which identify the possible factors associated with learning outcomes such as student satisfaction, perceived learning outcomes, and academic achievement [3,4,5,6,7,8]. However, they are still controversial because multiple factors are related to the learning process, and there is little consensus on the nature and number of the dimensions that measure the learning experience precisely [4].
The transactional theory of Moore [9] is one of the most appealing and well-known theories about distance education. It provides educators with a theoretical framework of key variables that they should consider in online learning environments. Many researchers have tried to find the best way to conduct effective online courses, considering the dynamic relationships created by two variables such as structure and dialogue. Fern University in Germany and Open University in the UK found that a well-organized online course is the most important factor for effective learning [10]. This draws attention to the fact that, in general, massive online courses such as a type of xMOOC provided by distance education institutions are highly organized and have relatively low dialogue. Peter [10] implied that the lack of interaction can be compensated by a highly organized course. The importance of the course structure in online learning is emphasized even at campus-based universities, not only at distance education institutions.
Available literature about online learning is not univocal about the importance of student–student interaction [11]. Several researchers reported that such interaction has significant impact on student satisfaction, learning, and retention in the process of online learning [4,12,13,14]. In contrast, Eom et al. [4] found no positive relationship between learner interaction and perceived learning outcomes. Similarly, Gray and DiLoreto [5] and Kuo et al. [15] reported that the student–student interaction is not a significant predictor of student satisfaction. As all of these studies were conducted with varying contexts and targets, and their conclusions are inconsistent. Therefore, there remains a need to investigate the complex relationship among critical success factors that can improve the effectiveness of online learning.
Lack of interaction between the instructor and students often becomes a main source of criticism for online learning since it may cause students to feel isolated and result in low rates of completion [6,16]. Online instructors are expected to diminish this psychological isolation and to create opportunities for communication with their students [17]. Related research insists that the most important role of the instructor is to establish his/her presence and personality in the course content, discussion, and activities [18], and the effective facilitation and guidance of the instructor can generate successful outcomes in online learning environments [19]. Key factors such as course structure, student–student interaction and the sense of instructor presence strongly influence the level of student satisfaction and achievement in the online learning process [4]. Also, student engagement can bring mediating effects in the relationships among these factors according to Gray and DiLoreto [5].
Based on the review of relevant literature, this study investigates the structural relationship between four key factors such as the course structure, student–student interaction, instructor presence, student engagement, and two dependent variables such as student satisfaction and academic achievement in asynchronous online courses. The asynchronous online course in this study refers to a type of teaching and learning in which (1) communication among students and the instructor is not present in real time, and (2) the instructor offers pre-recorded lecture content and teaching materials on the learning management system (LMS). This study intends to develop a research model with hypothetical paths among the four key factors and two dependent variables. The validity of this model is verified using the structural equation modeling approach. The results of this study are able to assist online instructors in improving the quality of online courses by suggesting the clear relationship among these important factors.

2. Theoretical Background and Hypotheses

2.1. Theoretical Framework of Online Learning

In general, online learning is classified into two types: synchronous and asynchronous online courses [20]. The synchronous online course is a real-time session delivered through video conferencing systems such as ZOOM and WebEx. The asynchronous online course is not a real-time instruction, and the instructor provides a pre-recorded lecture and learning materials uploaded on an LMS such as CANVAS and Blackboard. Teaching and learning activities are separate from each other in the case of the asynchronous online learning [21]. Thus, it is necessary that a clear course description as well as the centralized teaching role of the instructor are provided to students [22].
The transactional theory of Moore describes the complex phenomena of teaching–learning in online learning environments in terms of two variables, structure and dialogue. Structure is related to the design of online courses as well as teaching organization [23]. Dialogue is related to the level of communication between the instructor and students [5]. Also, Moore discussed three types of interaction in online learning, which are content–student interaction, student–instructor interaction, and student–student interaction [9]. It was assumed that these types of interaction have positive effects on online learning outcomes. Regarding the content–student interaction, many researchers agree that well-organized courses help students to systematize and demonstrate the new knowledge [24]. In the student–instructor interaction, the online instructor performs instructional, facilitative, and organizational roles through interaction with students [22]. Lastly, the student–student interaction is an important part of learning and encourages social presence, which refers to the feeling that other students are also actually in the environment.
Based on Moore’s theory and related literature, this study adopts the following three assumptions. First, the course structure has a positive effect on online learning outcomes by promoting interaction between learning content and students. Second, online instructors can implement instructional activities through interaction with students and improve the sense of instructor presence, which can promote students’ engagement in learning. Third, interaction among students is a factor that can promote their engagement along with the sense of instructor presence.

2.2. Course Structure

The course structure expresses the rigidity or flexibility of learning objectives, teaching strategies, and evaluation methods. It describes the extent to which an educational program can accommodate or be responsive to each student’s individual needs [4]. Quality Matters, which provides criteria for online course quality assurance, emphasizes the importance of course organization and presentation for a successful online course [25]. A student’s experience with the course structure is viewed as interaction with course content and learning materials in Moore’s theory [26]. This implies that a well-organized course facilitates content–student interaction, which is crucial for effective learning [4]. Compared to students in face-to-face class, online students independently and autonomously carry out their learning. For this reason, they need information on clearly stated course objectives, content, schedule, and guidelines.
Recent studies have suggested that a well-organized online course is correlated with student satisfaction and performance. Kuo et al. [15] investigated the relationship between student perception of interaction and blended learning online satisfaction. They revealed that the student–content interaction is the strongest predictor of student satisfaction if online courses contain a small amount of collaborative activities. Alqurashi [3] and Gunawardena et al. [27] showed that course design is a significant predictor of student satisfaction. Grandzol and Grandzol [28] insisted that a consistent and clearly structured course including navigational documents and instructions is vital to student success after reviewing a large amount of literature on online educational practices. On the other hand, Jaggars and Xu [25] reported that the course structure with well-specified learning objectives is desirable, but these qualities are not statistically significant for student grades. Eom et al. [4] examined the determinants of student satisfaction and perceived learning by using structural equation modeling. They revealed that the course structure has an significant effect on student satisfaction, but not on the perceived learning.
Based on the discussion above, the following two hypotheses are adopted in this study.
Hypothesis 1 (H1).
Course structure is positively associated with student satisfaction.
Hypothesis 2 (H2).
Course structure is positively associated with academic achievement.

2.3. Student–Student Interaction

Many researchers have suggested that the student–student interaction, regardless of being formally structured or not, can enrich learning outcomes [29]. Although it is considered an important factor in promoting students’ participation in face-to-face classes, it plays an even more important role in online classes. This is mainly because it can alleviate students’ disconnection from others in the online learning environment. It is important that the online instructor provide students with an opportunity of participating in online activities, and the students should be able to recognize their participation as an important part of learning [14]. There are several ways for instructors to promote interaction among students in both synchronous and asynchronous online courses, such as videoconferencing and chatting for the former and discussion boards and e-mail messaging for the latter.
Jaggars and Xu [25] found that the quality of interpersonal interaction within an online learning environment affects students’ grades, both positively and significantly. Borohoski et al. [30] conducted a meta-analysis on the results of 74 empirical studies. It indicated that student–student interaction can produce a higher impact on achievement than student–instructor interaction. Moreover, it suggests that opportunities for collaboration among students should be provided to students in the course of online learning for effective student–student interaction.
In contrast to the discussion above, some researchers have reported that the student–student interaction is not a significant predictor of student satisfaction and performance. Alqurashi [3] investigated several important factors related to student satisfaction and perceived learning within online learning environments in higher education and concluded that the student–student interaction is not a significant predictor. Gray and DiLoreto [5] examined the indirect effect of student–student interaction on learning outcomes by including student engagement as a mediating variable. They reported from this study that a high level of interaction among students can lead to student engagement, which indirectly affects the perceived learning but not the student satisfaction. This is in contrast with other researchers’ opinions that the student–student interaction is one of the most important considerations in online learning settings.
Considering the discussion above, the following hypothesis is adopted in this study.
Hypothesis 3 (H3).
Student–student interaction is positively associated with student engagement.

2.4. Instructor Presence

In [31], Anderson et al. referred to teaching presence as the design, facilitation, and direction of cognitive and social processes for the realization of personally meaningful and educationally worthwhile learning outcomes. Furthermore, they suggested the following indicators for instructor presence: (1) presenting content and questions, (2) focusing the discussion on specific issues, (3) summarizing the discussion, (4) confirming understanding, (5) diagnosing misperceptions, (6) injecting knowledge from diverse sources, and (7) responding to technical concerns. These teaching activities are consistent with the instructor’s performance to facilitate interaction with students as suggested by Oztok and his colleges [22]. The instructor presence can be established by regular communication with students, consistent feedback, and critical discourse modeled by the instructor [23]. Online instructors can promote student academic performance and retention for a long term by increasing their presence in the online learning environment [25].
Several researchers insisted that there exists an important association between the instructor presence and student satisfaction and performance. Shea et al. [32] analyzed the relationship between interaction types and perceived learning in web-based online learning. The results showed that both the student–instructor interaction and student–student interaction are significant contributors to student learning and satisfaction. The comparison of the two types of interaction demonstrated that the student–instructor interaction has a greater impact on learning outcomes than the student-to-student interaction. In a similar vein, Eom et al. [4] reported that instructor feedback significantly affects perceived learning and student satisfaction. Gray and DiLoreto [5] found that instructor presence is a predictor of student engagement and indirectly affects perceived learning. These results support the assertions of online instructors that the student–instructor interaction is one of the most critical factors in learning outcomes, and instructor feedback should be considered as one of the most important teaching actions.
The following statement is hypothesized from the above discussion:
Hypothesis 4 (H4).
Instructor presence is positively associated with student engagement.

2.5. Student Engagement

Student engagement refers to the time and efforts that students devote to their learning [33]. According to Trowler [34], it requires not only activities but also feeling or sensemaking such as attending lectures, participating with enthusiasm, and showing interest [35]. In its meaning, several researchers have included emotional factors such as attitude toward technology use as well as interest and enthusiasm for learning [36]. Recently, researchers have begun to conceptualize student engagement as a multi-dimensional phenomenon comprising behavioral engagement, emotional engagement, and cognitive engagement [37]. Behavioral engagement refers to the student’s level of participation in learning. Emotional engagement means the student’s emotional reactions to instructors, peer students, and learning. Cognitive engagement focuses on cognitive and self-regulation strategies used in learning. Lee et al. [38] reported that peer collaboration and interaction with instructors are elements reflected in student engagement in online courses. The level of student engagement can be identified by surveying students or gathering indicative data such as the login records and number of participations in a discussion forum.
Carini et al. [39] revealed that student engagement is related to desirable learning outcomes such as critical thinking and high grades. In [37], Lei and Cui performed a meta-analysis and reported a significant correlation between student engagement and academic achievement. Gray and DiLoreto [5] found that student engagement can positively affect not only perceived student learning, but also student satisfaction. From this discussion, the following statements are hypothesized.
Hypothesis 5 (H5).
Student engagement is positively associated with student satisfaction.
Hypothesis 6 (H6).
Student engagement is positively associated with academic achievement.
Furthermore, in [5,23,25] it was reported that students show a tendency to participate in online learning if they are aware of active interaction among students and strong instructor presence. Ma et al. [36] found that the instructor’s role is important for student engagement in online learning environments. They suggested that the main roles of online instructors to improve the student engagement include course preparation activities as well as guidance and assistance for their students. Also, Shea et al. [40] suggested that student satisfaction can be enhanced by students valuing interaction and opportunities for active communication. From this discussion, it can be inferred that the interactions among students and instructor presence have a positive effect on student engagement and may lead to improvement in student satisfaction and achievement. Considering this, the following hypotheses are adopted in this study.
Hypothesis 7 (H7).
Student engagement mediates the relationship of student–student interaction to student satisfaction and academic achievement.
Hypothesis 8 (H8).
Student engagement mediates the relationship of instructor presence to student satisfaction and academic achievement.

2.6. Structural Model

Based on the discussion from Section 2.1, Section 2.2, Section 2.3, Section 2.4, Section 2.5, this study adopts eight hypotheses, which define the relationships among the key factors influencing student satisfaction and academic achievement. In these hypotheses, the course structure and student engagement are considered critical factors influencing student satisfaction and achievement. It is also assumed that the student–student interaction and instructor presence are important factors affecting student engagement and have indirect effects on student satisfaction and academic achievement.
A structural model illustrated in Figure 1 is created by defining paths among the key factors discussed. In this model, the paths of Hypotheses 7 and 8 are not visually expressed as they evaluate indirect effects among the key factors.

3. Methodology

3.1. Survey Data

Survey data utilized in this study were collected from undergraduate students enrolled in two asynchronous online courses offered at Kyung Hee University in Korea in the fall semester of 2020. The authors participated in these two courses as instructional designers and helped the course instructors to design and implement learning materials that can produce greater outcomes. The online survey was distributed and collected from the 7th to 8th week of the entire 16 week period in the fall semester. Among 595 students enrolled in the online courses, 268 students voluntarily participated in the survey. After discarding 18 unreliable responses, a total of 250 survey responses were selected and analyzed in this study. The statistical summary of the survey participants is given in Table 1.

3.2. Measurement Instrument

The survey questions were composed of 25 items, which were designed to measure the key factors such as the course structure, student–student interaction, instructor presence, student engagement, and student satisfaction. They were developed by modifying the survey items utilized in the study of Gary and DiLoreto [5], which were originated from the IDEA (Individual Development and Educational Assessment) student rating systems of Kansas State University [4]. All of the items were rated based on a 5-point Likert scale, which ranges from 1 indicating “strongly disagree” to 5 “strongly agree”. In most previous studies, learning outcomes were measured by perceived learning, reflecting the students’ perceptions of their learning in a specific online course [4,5,7]. In contrast, these ratings were directly evaluated from students’ actual examination scores in this study. Table 2 summarizes the details of the measurement instrument. The representative examples of the survey questions are summarized in Table 3. The value of Cronbach’s alpha for the measurement instrument is 0.875.

3.3. Data Collection and Strategies for Statistical Analysis

In order to explore the construct validity and internal reliability of the measurement instrument, exploratory factor analysis (EFA) with Varimax rotation was performed using SPSS (version 25.0). The Kaiser–Meyer–Olkin (KMO) measure of sampling adequacy (=0.886) and Bartlett’s test of sphericity (=2932.46, df = 1136, p < 0.001) confirmed that the measurement instrument adopted was appropriate for the EFA. Eight survey items with a factor loading less than 0.40 and with multiple cross-loadings, which were CS3, SSI2, IP2, IP4, SE3, SE4, SS3, and SS4, were removed from the original 25 items, and a total of 17 remaining items were considered in the process of subsequent statistical analysis. Five factors were extracted from the 17 items by performing the EFA, and the total variance explained was 75.1%.
Next, descriptive statistics and correlations among the 17 measurement variables were analyzed using SPSS. In order to confirm the convergent and discriminant validity, confirmatory factor analysis (CFA) with maximum likelihood estimation was performed using AMOS (version 22.0). The construct validity was examined by computing the standardized factor loadings of the measurement variables, composite reliability (CR), average variance extracted (AVE), and model fit indices [41]. For checking the goodness-of-fit, minimum sample discrepancy (CMIN), comparative fit index (CFI), Tracker–Lewis index (TLI), and root-mean-square error of approximation (RMSEA) were calculated in this study.
Lastly, path analysis of the structural model was performed using AMOS. The structural model was tested by examining the relationships among the five factors, and the indices of goodness-of-fit (CMIN, CFI, TLI, and RMSEA) to the proposed model were checked.

4. Results and Discussion

4.1. Descriptive Statistics and Correlations

Table 4 shows the descriptive statics and correlations among the measurement variables. It summarizes the values of correlation, mean, standard deviation, skewness, and kurtosis for each measurement variable. The normal distribution of the statistical data was checked from skewness and kurtosis values. It can be seen from the table that the maximum of the absolute values of skewness is 2.86, which is less than 3, and the maximum of the absolute values of kurtosis is 9.41, which is less than 10. This indicates that the assumption for the multivariate normal distribution of data is satisfied with the proposed structural equation model [42,43].

4.2. Validity of the Measurement Model

Table 5 summarizes the results of the CFA performed. It provides the value of the standardized factor loading for each measurement variable as well as the values of Cronbach’s alpha (CA), CR, and AVE of each latent variable.
It can be observed from the table that the standardized factor loadings of all measurement variables are higher than 0.50, which confirms adequate validity of the key factors in the measurement model, as suggested by Hair and his colleagues [44]. The discriminant and convergent validity of the latent variables are confirmed as the AVE and CR values of the latent variables are greater than 0.50 and 0.70, respectively.
The Cronbach’s alpha values of the latent variables range from 0.64 to 0.85, which can be described as reasonable. The internal reliability of the latent variables is reasonable as their Cronbach’s alpha values range from 0.64 to 0.85 [45]. The goodness-of-fit indices shown in Table 6 indicate that the measurement model is a reasonable fit with the collected data (χ2/df = 2.634, CFI = 0.938, TLI = 0.923, RMSEA = 0.080).

4.3. Structural Model and Hypothesis Testing

In order to verify the hypothesized structural model shown in Figure 1, this section examines the goodness-of-fit and statistical significance of the hypothesized paths among the latent variables. The model fit results of the hypothesized structural model are given in Table 7, and their values are χ2/df = 2.589, CFI = 0.931, TLI = 0.917, and RMSEA = 0.080, indicating that the proposed hypothesized model is a good fit. The path coefficients of the hypothesized model were calculated and checked to test Hypotheses 1 to 6 (H1~H6) discussed in Section 2. The computed results show that all of p-values for paths H1 to H5 are less than 0.05 except path H6. This indicates that all paths H1 to H5 are statistically significant, but H6 is not supported. Detailed values are given in Table 8.
Therefore, we considered a new model, in which the path corresponding to H6 was removed from the original hypothesized model, and performed path analysis again on the modified model, denoted as Modified model 1 in Table 7. The results of the path analysis on Modified model 1 indicated that it is also a good fit with χ2/df = 2.584, CFI = 0.931, TLI = 0.917, and RMSEA = 0.080, as reported in Table 7.
Although these results were good, a new model was considered in order to achieve a better goodness-of-fit of Modified model 1. The most popular piece of information for model modification was the modification index (MI) [46]. The modification indices suggested adding various covariances between error terms. The highest modification index (MI = 35.057) was selected from the results of Modified model 1, and the covariance between SSI1 and SSI3 was added. The covariance term is theoretically justifiable because these are strongly related concepts, and it is feasible that these measures have something specific in common that is lacking in other indicators [47]. This new model was denoted as Modified model 2, and path analysis was performed on it again. The model fit results showed that Modified model 2 presented a better fit than Modified model 1 as χ2/df = 2.291, CFI = 0.944, TLI = 0.932, and RMSEA = 0.072, as shown in Table 7. The result of the chi-difference test for comparison between Modified model 1 and Modified model 2 showed that Modified model 2 was found to be significant with the significance level of 0.05(Δχ2(1) = 39.815, p <0.05). Therefore, Modified model 2 was confirmed as the final research model. The modified paths and path coefficients of Modified model 2 are illustrated in Figure 2, and detailed values are given in Table 9.
To verify Hypotheses 7 and 8, the indirect effect of student–student interaction and instructor presence on student satisfaction were examined by performing path analysis with the option of the Bootstrap method in AMOS. The verification of the indirect effect of the two variables on the academic achievement was excluded because the direct effect of student engagement on academic achievement was not statistically significant in the hypothesized model. The results of the new path analysis are given in Table 10, and show that the indirect effect of student–student interaction on student satisfaction is significant, but not robust (β = 0.068, p < 0.05). The indirect effect of the instructor presence is not significant (β = 0.114, p > 0.05). Although the indirect effects of the two variables are all small, they have different results in terms of the significance level of 0.05. This is a result of the difference in the Bootstrap standard errors of the two variables.

4.4. Discussion

From the results discussed in the previous sections, we can draw several important conclusions. First, course structure has significantly positive effects on both student satisfaction and academic achievement in asynchronous online courses. It indicates that course structure is the critical factor for increasing student satisfaction and academic achievement. This coincides with the findings of other researchers such as Alqurashi [3], Gray and DiLoreto [5], Kue et al. [15], Gunawardena et al. [27], and Grandzol and Grandzol [28]. In particular, Kuh et al. suggested that a well-structured course can promote students’ understanding of course content, which can increase the effectiveness of learning, especially when few collaborative activities are required in the online course. Consequently, course design should be done in such a way that learning objectives are clearly stated and detailed guidelines on the tasks and activities required during the class are provided.
Second, both the student–student interaction and instructor presence positively affect the student engagement. This is consistent with previous research results such as Gray and DiLoreto [5], Garrison [23], and Jaggard and Xu [25]. They reported that students actively participate in the learning process when they are highly aware of peer interaction and instructor presence. Dennen et al. [13] pointed out the importance of the instructor’s role in encouraging a meaningful learning experience in the online learning environment. They insisted that the instructor’s understanding of the learning experience of students can enhance their learning outcomes. Feedback provided by instructors can improve the quality of the learning experience and result in meaningful learning [4,5,6,23,25].
Lastly, student engagement has a positive effect on student satisfaction, although it does not have a significant impact on academic achievement. One possible explanation for this is that the relationship between student engagement and academic achievement is influenced by various factors related to the method of reporting student engagement and other individual differences, such as cultural values and age [37]. The participants in this study reported the level of their engagement by themselves and were of various majors and grades. This may have influenced the relationship between student engagement and academic achievement. Contrary to past findings from Gray and DiLoreto [5], student engagement only mediates the effect of student–student interaction on student satisfaction, not that of the instructor presence on student satisfaction. It is important to notice that Bootstrap standard errors statistically may have an effect.
In the context of the growing importance of online teaching and learning in higher education, it is a challenge for online instructors to lead students to successful learning. Student satisfaction and academic achievement are representative indications to gauge the effectiveness of learning in online courses. This study expands upon prior studies on online learning in higher education and confirms the importance of course design as a key role of online instructors.

5. Conclusions

In this study, we investigated the relationships among key factors that influence student satisfaction and academic achievement in asynchronous online courses. A structural model was developed by considering the course structure, student–student interaction, instructor presence, student engagement, student satisfaction and achievement as the key factors. In order to verify the effectiveness of the developed model, we utilized survey data collected from a total of 250 students enrolled in two asynchronous online courses offered at Kyung Hee University in Korea. Then, the collected survey data were analyzed using the structural equation model. From the results of the model verification, the following conclusions were obtained:
  • Course structure has significantly positive effects on both student satisfaction and academic achievement in asynchronous online courses. It is desirable to design the overall organization of online courses such that learning objectives are clearly stated and detailed guidelines on tasks and activities required during the class are provided.
  • Both student–student interaction and instructor presence positively affect student engagement. The quality of students’ learning experiences can be enhanced by providing instructor feedback.
  • Student engagement has a positive effect on student satisfaction although it does not have a significant impact on academic achievement.
  • Student engagement only mediates the effect of student–student interaction on student satisfaction, and not that of instructor presence on student satisfaction. Instructor presence may encourage students to take part in learning activities, but does not have a positive effect on enhancing student satisfaction.
These conclusions should be helpful in providing online instructors with useful instructional strategies for successful online learning. To extend the research performed in this study, the proposed structural model can be verified using survey data collected from various online learning environments such as synchronous online courses. Also, in future research, it may be worthwhile to consider individual characteristics such as motivation and self-direction as well as external environmental factors such as community support and learning management systems.

Author Contributions

Conceptualization, S.K.; methodology, S.K.; software, S.K.; validation, S.K.; formal analysis, S.K.; investigation, S.K. and D.-J.K.; data curation, S.K.; writing—original draft, S.K. and D.-J.K.; writing—review & editing, D.-J.K.; project administration, D.-J.K.; funding acquisition, D.-J.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korean government (Ministry of Science, ICT and Future Planning) (No. 2020R1A2C1014806).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available upon request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. WEF. The Future of Online Education: Lessons from South Korea. Available online: https://www.weforum.org/agenda/2020/11/lessons-from-south-korea-on-the-future-of-online-education (accessed on 18 January 2021).
  2. Williams, J. Applying Cognitive Science to Online Learning. In Proceedings of the NIPS 2013, Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA, 5–8 December 2013; Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2535549 (accessed on 18 January 2021).
  3. AlQurashi, E. Predicting student satisfaction and perceived learning within online learning environments. Distance Educ. 2018, 40, 133–148. [Google Scholar] [CrossRef]
  4. 4Eom, S.B.; Wen, H.J.; Ashill, N. The Determinants of Students’ Perceived Learning Outcomes and Satisfaction in University Online Education: An Empirical Investigation. Decis. Sci. J. Innov. Educ. 2006, 4, 215–235. [Google Scholar] [CrossRef]
  5. Gray, J.A.; DiLoreto, M. The Effects of Student Engagement, Student Satisfaction, and Perceived Learning in Online Learning Environments. Int. J. Educ. Leadersh. Prep. 2016, 11, 1. Available online: https://www.researchgate.net/publication/310672442 (accessed on 21 January 2021).
  6. Sier, A. Accessing the relationship of student-instructor and student-student interaction to student learning and satisfaction in Web-based Online Learning Environment. J. Interact. Online Learn. 2009, 8, 102–120. [Google Scholar]
  7. Swan, K. Virtual interaction: Design factors affecting student satisfaction and perceivedlearning in asynchronous online courses. Distance Educ. 2001, 22, 306–331. [Google Scholar] [CrossRef]
  8. Costa, C.; Cardoso, A.P.; Lima, M.P.; Ferreira, M.; Abrantes, J.L. Pedagogical Interaction and Learning Performance as Determinants of Academic Achievement. Procedia Soc. Behav. Sci. 2015, 171, 874–881. [Google Scholar] [CrossRef]
  9. Moore, M. Recent contributions to the theory of distance education. Open Learn. J. Open Distance e-Learn. 1990, 5, 10–15. [Google Scholar] [CrossRef]
  10. Peters, O. Learning and Teaching in Distance Education: Analyses and Interpretations from an International. Educ. Train. 1999, 41, 384–386. [Google Scholar] [CrossRef]
  11. Abrami, P.C.; Bernard, R.M.; Bures, E.M.; Borokhovski, E.; Tamim, R.M. Interaction in distance education and online learning: Using evidence and theory to improve practice. J. Comput. High. Educ. 2011, 23, 82–103. [Google Scholar] [CrossRef]
  12. LaPointe, D.K.; Gunawardena, C.N. Developing, testing and refining of a model to understand the relationship between peer interaction and learning outcomes in computer-mediated conferencing. Distance Educ. 2004, 25, 83–106. [Google Scholar] [CrossRef]
  13. Dennen, V.P.; Darabi, A.A.; Smith, L.J. Instructor–Learner Interaction in Online Courses: The relative perceived importance of particular instructor actions on performance and satisfaction. Distance Educ. 2007, 28, 65–79. [Google Scholar] [CrossRef]
  14. Hay, A.; Hodgkinson, M.; Peltier, J.W.; Drago, W.A. Interaction and virtual learning. Strat. Chang. 2004, 13, 193–204. [Google Scholar] [CrossRef]
  15. Kuo, Y.C.; Walker, A.E.; Belland, B.R.; Schroder, K.E. A predictive study of student satisfaction in online education programs. Int. Rev. Res. Open Distrib. Learn. 2013, 14, 16–39. [Google Scholar] [CrossRef] [Green Version]
  16. Arbaugh, J.B. Virtual classroom characteristics and student satisfaction with internet-based MBA courses. J. Manag. Educ. 2000, 24, 32–54. [Google Scholar] [CrossRef]
  17. Sorensen, C.; Baylen, D.M. Interaction in Interactive Television Instruction: Perception or Reality. In Proceedings of the Conference of the American Educational Research Association (AERA), Montreal, QC, Canada, 19–23 April 1999. [Google Scholar]
  18. Shea, P.; Li, C.S.; Pickett, A. A study of teaching presence and student sense of learning community in fully online and web-enhanced college courses. Internet High. Educ. 2006, 9, 175–190. [Google Scholar] [CrossRef]
  19. Hill, J.R.; Song, L.; West, R.E. Social Learning Theory and Web-Based Learning Environments: A Review of Research and Discussion of Implications. Am. J. Distance Educ. 2009, 23, 88–103. [Google Scholar] [CrossRef] [Green Version]
  20. Imsa-ard, P. Thai university students’ perceptions towards the abrupt transition to ‘forced’ online learning in the Covid-19 situation. J. Educ. Khon Univ. 2020, 43, 30–44. [Google Scholar]
  21. Simonson, M.; Schlosser, C.; Hanson, D. Theory and distance education: A new discussion. Am. J. Distance Educ. 1999, 13, 60–75. [Google Scholar] [CrossRef]
  22. Oztok, M.; Zingaro, D.; Brett, C.; Hewitt, J. Exploring asynchronous and synchronous tool use in online courses. Comput. Educ. 2013, 60, 87–94. [Google Scholar] [CrossRef] [Green Version]
  23. Garrison, R. Theoretical Challenges for Distance Education in the 21st Century: A Shift from Structural to Transactional Issues. Int. Rev. Res. Open Distrib. Learn. 2000, 1. [Google Scholar] [CrossRef]
  24. Moore, M.G.; Kearsley, G. Distance Education; Wadsworth: Belmont, CA, USA, 1996. [Google Scholar]
  25. Jaggars, S.S.; Xu, D. How do online course design features influence student performance. Comput. Educ. 2016, 95, 270–284. [Google Scholar] [CrossRef] [Green Version]
  26. Paecher, M.; Maier, B.; Maier, D. Students’ expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction. Comput. Educ. 2010, 54, 222–229. [Google Scholar] [CrossRef]
  27. Gunawardena, C.N.; Linder-VanBerschot, J.A.; Lapointe, D.K.; Rao, L. Predictors of Learner Satisfaction and Transfer of Learning in a Corporate Online Education Program. Am. J. Distance Educ. 2010, 24, 207–226. [Google Scholar] [CrossRef]
  28. Grandzol, C.J.; Grandzol, J.R. Best Practices for Online Business Education. Int. Rev. Res. Open Distrib. Learn. 2006, 7, 61–78. [Google Scholar] [CrossRef] [Green Version]
  29. Kuh, G.D. The national survey of student engagement: Conceptual and empirical foundations. New Dir. Inst. Res. 2009, 2009, 5–20. [Google Scholar] [CrossRef]
  30. Borokhovski, E.; Tamim, R.; Bernard, R.M.; Abrami, P.C.; Sokolovskaya, A. Are contextual and designed student–student interaction treatments equally effective in distance education? Distance Educ. 2012, 33, 311–329. [Google Scholar] [CrossRef]
  31. Rourke, L.; Anderson, T.; Garrison, D.R.; Archer, W. Assessing Social Presence in Asynchronous Text-based Computer Conferencing. J. Distance Educ. 1999, 14, 50–71. [Google Scholar]
  32. Shea, P.; Li, C.S.; Swan, K.; Pickett, A. Developing learning community in online asynchronous college courses: The role of teaching presence. Online Learn. 2019, 9, 263–280. [Google Scholar] [CrossRef]
  33. Kuh, G.D. What we ‘re learning about student engagement from MSSE. Change 2003, 35, 24–31. [Google Scholar] [CrossRef]
  34. Trowler, V. Student Engagement Literature Review, The Higher Education Academy. 2010. Available online: https://d1wqtxts1xzle7.cloudfront.net (accessed on 28 January 2021).
  35. ERIC Development Team. ED482269 2003-09-00 Assessing Student Engagement Rates. 2003. Available online: www.eric.ed.gov (accessed on 28 January 2021).
  36. Ma, J.; Han, X.; Yang, J.; Cheng, J. Examining the necessary condition for engagement in an online learning environment based on learning analytics approach: The role of the instructor. Internet High. Educ. 2015, 24, 26–34. [Google Scholar] [CrossRef]
  37. Lei, H.; Cui, Y.; Zhou, W. Relationships between student engagement and academic achievement: A meta-analysis. Soc. Behav. Pers. Int. J. 2018, 46, 517–528. [Google Scholar] [CrossRef]
  38. Lee, J.; Song, H.-D.; Hong, A.J. Exploring Factors, and Indicators for Measuring Students’ Sustainable Engagement in e-Learning. Sustainabilaty 2019, 11, 985. [Google Scholar] [CrossRef] [Green Version]
  39. Carini, R.M.; Kuh, G.D.; Klein, S.P. Student Engagement and Student Learning: Testing the Linkages. Res. High. Educ. 2006, 47, 1–32. [Google Scholar] [CrossRef]
  40. Dziuban, C.; Moskal, P.; Brophy, J.; Shea, P. Student satisfaction with asynchronous learning. Online Learn. 2019, 11, 87–95. [Google Scholar] [CrossRef] [Green Version]
  41. Schumacker, R.E.; Lomax, R.G. A Beginner’s Guide to Structural Equation Modeling, 4th ed.; Routledge: Abingdon, UK, 2016. [Google Scholar]
  42. Dong, Y.; Xu, C.; Chai, C.S.; Zhai, X. Exploring the Structural Relationship Among Teachers’ Technostress, Technological Pedagogical Content Knowledge (TPACK), Computer Self-efficacy and School Support. Asia-Pacific Educ. Res. 2020, 29, 147–157. [Google Scholar] [CrossRef]
  43. Kline, R.B. Principles and Practice of Structural Equation Modeling; Guilford Press: New York, NY, USA, 2015; ISBN 9781606238769. [Google Scholar]
  44. Hair, J.F.; Anderson, R.E.; Tatham, R.L.; Black, W.C. Multivariate Analysis of Variance; Prentice Hall: Hoboken, NJ, USA, 1992. [Google Scholar]
  45. Taber, K.S. The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Res. Sci. Educ. 2018, 48, 1273–1296. [Google Scholar] [CrossRef]
  46. Whittaker, T.A. Using the Modification Index and Standardized Expected Parameter Change for Model Modification. J. Exp. Educ. 2012, 80, 26–44. [Google Scholar] [CrossRef]
  47. Hox, J.J.; Bechger, T.M. An Introduction to Structural Equation Modeling. Fam. Sci. Rev. 1999, 11, 354–373. [Google Scholar]
Figure 1. Hypothesized structural model.
Figure 1. Hypothesized structural model.
Sustainability 13 06734 g001
Figure 2. The final structural model with standardized coefficients. (*** p < 0.001, * p < 0.05).
Figure 2. The final structural model with standardized coefficients. (*** p < 0.001, * p < 0.05).
Sustainability 13 06734 g002
Table 1. Statistical summary on the survey participants. (N = 250).
Table 1. Statistical summary on the survey participants. (N = 250).
Undergraduate YearFrequencyPercentage (%)
Freshman9236.8
Sophomore5823.2
Junior4618.4
Senior5421.6
Total250100
Table 2. Measurement instrument.
Table 2. Measurement instrument.
Key FactorNumber of ItemsScales
Course structure (CS)55-point Likert scale
Student–Student interaction (SSI)6
Instructor presence (IP)5
Student engagement (SE)4
Student satisfaction (SS)5
Academic achievement (AA)-Mid-term score
Total25
Table 3. Representative examples of the survey items.
Table 3. Representative examples of the survey items.
Key FactorExamples of Survey Items
Course structure (CS)‘Course objectives are clearly presented’
‘Course content is logically well-organized’
Student–Student interaction (SSI)‘I frequently interact with other students in this course’
‘There are opportunities for active learning in this course’
Instructor presence (IP)‘The instructor’s feedback on assignment is clearly stated’
‘The instructor provided timely feedback about my progress in the course’
Student engagement (SE)‘I participated in synchronous and/or asynchronous communication with the instructor during the online course’
‘I completed learning activities as assigned during the course’
Student satisfaction (SS)‘I am satisfied with overall experience in this course’
‘I am satisfied with the instructor in the course’
Table 4. Descriptive statistics and correlations. (N = 250).
Table 4. Descriptive statistics and correlations. (N = 250).
VariableCS1CS2CS4CS5SSI1SSI3SSI4SSI5SSI6IP1IP3IP5SE1SE2SS1SS2SS5
CS1-
CS20.726-
CS40.7240.684-
CS50.6180.6180.569-
SSI10.0640.0080.0350.172-
SSI30.0700.0030.0800.1500.789-
SSI40.054−0.0400.0130.0870.7160.770-
SSI50.074−0.0270.0220.1020.7460.7140.863-
SSI60.0600.0130.0670.0750.5690.5710.6220.700-
IP10.3960.4030.4640.3660.1230.1310.0990.1000.221-
IP30.3470.3140.3470.3730.2850.2910.2900.2900.2920.545-
IP50.4300.4260.4190.4130.2500.2340.2320.2600.3210.6580.572-
SE10.1660.1570.1960.1830.5240.4300.4420.5110.4910.3690.3800.411-
SE20.3690.3710.3140.3690.2530.1750.1510.1830.2410.4120.3720.4620.444-
SS10.5180.6030.4640.5640.1250.1460.1270.1310.1240.4890.4580.5360.2450.441-
SS20.5050.5750.5230.501−0.0050.064−0.014−0.0140.0460.4660.3540.4750.1580.3660.718-
SS50.4710.5840.5030.526−0.0010.1010.0090.0450.0950.4200.3980.4630.1770.3680.7360.807-
Mean4.754.824.814.632.612.692.172.192.524.584.154.293.284.004.654.764.71
SD0.4930.4490.4600.6341.161.181.151.111.250.7010.9070.8331.090.5970.5740.5240.571
Skewness−2.05−2.86−2.84−1.790.3410.3690.8550.7700.415−1.87−0.836−1.05−0.336−0.255−1.58−2.38−2.12
Kurtosis4.749.419.063.11−0.510−0.5780.0560.005−0.8373.930.1060.674−0.390−0.4242.185.644.65
CS: Course structure, SSI: Student–Student interaction, IP: Instructor presence, SE: Student engagement, SS: Student satisfaction.
Table 5. Results of the confirmatory factor analysis. (N = 250).
Table 5. Results of the confirmatory factor analysis. (N = 250).
Latent Variable
(Key Factor)
Measurement VariableStandardized Factor LoadingCACRAVE
Course structure
(CS)
CS 10.8490.8720.9650.874
CS 20.855
CS 40.815
CS 50.729
Student–Student interaction
(SSI)
SSI 10.8260.9290.8970.636
SSI 30.828
SSI 40.912
SSI 50.922
SSI 60.719
Instructor presence
(IP)
IP 10.7760.7090.8800.711
IP 30.698
IP 50.839
Student engagement
(SE)
SE 10.7500.6470.7070.550
SE 20.592
Student Satisfaction
(SS)
SS 10.8300.9010.9680.910
SS 20.887
SS 50.893
CA: Cronbach’s alpha, CR: composite reliability, AVE: average variance extracted.
Table 6. Model fit results for the measurement model. (N = 250).
Table 6. Model fit results for the measurement model. (N = 250).
CMIN (χ2)CMIN/dfpdfCFITLIRMSEA
Measurement model287.1392.6340.0001090.9380.9230.080
Criteria >0.90>0.90<0.08
Table 7. Model fit results for the structural models analyzed. (N = 250).
Table 7. Model fit results for the structural models analyzed. (N = 250).
CMIN (χ2)CMIN/dfpdfCFITLIRMSEA
Hypothesized model328.8472.5890.0001270.9310.9170.080
Modified model 1330.7492.5840.0001280.9310.9170.080
Modified model 2290.9342.2910.0001270.9440.9320.072
Criteria >0.90>0.90<0.08
Table 8. Results of the hypothesis and path coefficients of the hypothesized model. (N = 250).
Table 8. Results of the hypothesis and path coefficients of the hypothesized model. (N = 250).
HypothesisPathUnstandardized Coefficient (B)Standard Coefficient (β)SETSupported
H1CS→SS0.7780.6750.0819.607 ***Yes
H2CS→AA10.0850.3202.3014.383 ***Yes
H3SSI→SE0.1500.4010.0295.201 ***Yes
H4IP→SE0.3320.6460.0486.890 ***Yes
H5SE→SS0.2380.1780.0872.729 *Yes
H6SE→AA3.9070.1072.8281.381No
*** p < 0.001, * p < 0.05.
Table 9. Results of path coefficients of the modified model 2. (N = 250).
Table 9. Results of path coefficients of the modified model 2. (N = 250).
PathUnstandardized
Coefficient (B)
Standard Coefficient (β)SEt
CS→SS0.7810.6770.0819.590 ***
CS→AA11.6980.3712.0215.789 ***
SSI→SE0.1530.3930.0305.084 ***
IP→SE0.3380.6580.0486.976 ***
SE→SS 0.2310.1740.0872.652 *
*** p < 0.001, * p < 0.05.
Table 10. Effect decomposition of Modified model 2. (N = 250).
Table 10. Effect decomposition of Modified model 2. (N = 250).
PathStandard Coefficient (β)
Direct EffectIndirect EffectTotal
SSI→SE0.393 ***-0.393 ***
SSI→SS (through SE)-0.068 *0.068 *
IP→SE0.658 ***-0.658 ***
IP→SS (through SE)-0.1140.114
SE→SS0.174 *-0.174 *
*** p < 0.001, * p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kim, S.; Kim, D.-J. Structural Relationship of Key Factors for Student Satisfaction and Achievement in Asynchronous Online Learning. Sustainability 2021, 13, 6734. https://doi.org/10.3390/su13126734

AMA Style

Kim S, Kim D-J. Structural Relationship of Key Factors for Student Satisfaction and Achievement in Asynchronous Online Learning. Sustainability. 2021; 13(12):6734. https://doi.org/10.3390/su13126734

Chicago/Turabian Style

Kim, Sohee, and Dae-Jin Kim. 2021. "Structural Relationship of Key Factors for Student Satisfaction and Achievement in Asynchronous Online Learning" Sustainability 13, no. 12: 6734. https://doi.org/10.3390/su13126734

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop