Previous Article in Journal
Examining the Impact of a Behavior Modification Program on Disease Prevention Behaviors among Individuals at Risk of Diabetes: A Quasi-Experimental Investigation
Previous Article in Special Issue
Comparative Analysis of Artificial Intelligence Virtual Assistant and Large Language Models in Post-Operative Care
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Moderating Effects of Gender and Study Discipline in the Relationship between University Students’ Acceptance and Use of ChatGPT

by
Ibrahim A. Elshaer
1,2,
Ahmed M. Hasanein
1,3 and
Abu Elnasr E. Sobaih
1,3,*
1
Management Department, College of Business Administration, King Faisal University, Al-Ahsa 31982, Saudi Arabia
2
Faculty of Tourism and Hotel Management, Suez Canal University, Ismailia 41522, Egypt
3
Faculty of Tourism and Hotel Management, Helwan University, Cairo 12612, Egypt
*
Author to whom correspondence should be addressed.
Eur. J. Investig. Health Psychol. Educ. 2024, 14(7), 1981-1995; https://doi.org/10.3390/ejihpe14070132 (registering DOI)
Submission received: 23 May 2024 / Revised: 23 June 2024 / Accepted: 5 July 2024 / Published: 8 July 2024

Abstract

:
The intensive adoption of ChatGPT by university students for learning has encouraged many scholars to test the variables that impact on their use of such AI in their learning. This study adds to the growing body of studies, especially in relation to the moderating role of students’ gender and their study discipline in their acceptance and usage of ChatGPT in their learning process. This study expanded the Unified Theory of Acceptance and Use of Technology (UTAUT) by integrating gender as well as study disciplines as moderators. The study collected responses from students in Saudi universities with different study disciplines and of different genders. The results of a structural model using Smart PLS showed a significant moderating effect of gender on the relationship between performance expectancy and ChatGPT usage. The results confirmed that the impact of performance expectancy in fostering ChatGPT usage was stronger in male than in female students. Moreover, social influence was shown to significantly affect males more than females in relation to ChatGPT usage. In addition, the findings showed that study discipline significantly moderates the link between social influence and ChatGPT usage. In the same vein, social influence significantly influences ChatGPT use in social sciences more than in applied sciences. Hence, the various implications of the study were discussed.

1. Introduction

Artificial intelligence (AI) has recently become a research theme in many disciplines, including risk management, accounting, finance, management, and education [1,2,3]. Studies that have concentrated on the impact of AI on education have discussed many positive facets of using AI in higher education. These facets include increasing the quality of methods and instruments used by university lecturers and professors [4]. Moreover, other studies have concentrated on student use of AI, especially ChatGPT, in their essay and/or thesis writing, their activities in lectures and tutorials, and as an analytical tool in many disciplines [4]. Further, Hasanein and Sobaih [5] explained that AI can create and help to adapt new innovative teaching methodologies and can change how knowledge is transmitted and absorbed drastically. Having said this, there have been several attempts to study and understand the role of AI in educational sector; however, these early endeavors represent early studies and still there are many issues that have not yet been addressed in the literature [4,5,6]. One of these gaps is the current study’s focus on gender impact on the acceptance and usage of AI platforms in educational institutions. To find out what people’s opinions are regarding the factors that motivate the usage of AI platforms, e.g., ChatGPT in education, Hasanein and Sobaih [5] conducted a qualitative study with a variety of educational stakeholders, including students. Twelve factors were found to impact students’ perception of using chatbots for educational functions. These factors included issues like usability, help with homework, prompt response, language proofreading, troubleshooting, studying for exams, analysis of data and research assistance, self-learning, concept definition, learning materials, and evaluation tools. Strzelecki [6], adopting the Unified Theory of Adoption and Usage of Technology (UTAUT), evaluated the variables affecting the adoption and usage of ChatGPT amongst higher education Polish students. However, Strzelecki’s [6] study also highlighted the importance of future research in evaluating variations in ChatGPT usage among students, taking into account factors like gender and discipline. This is essentially the field of investigation that the current research wants to address.
The research rationale of the study is centered on the nuanced exploration of gender and disciplinary variations in the utilization of ChatGPT within higher education. Several studies (e.g., [7,8,9,10]) have acknowledged the potential distinctions between male and female students and across diverse academic disciplines in the adoption of and engagement with e-learning, i.e., AI. However, there exists a need for a more comprehensive understanding of these differences regarding ChatGPT in particular. Moreover, studies (i.e., [6,11,12,13]) have suggested that ChatGPT has played a pivotal role in diminishing the technological gap between males and females. This study further explores the unique ways in which students, grouped by gender and academic field, engage with and exploit ChatGPT in the higher education setting. By examining these differences, this study attempts to give insights that might drive specific ways of enhancing the adoption of ChatGPT in educational contexts, providing acceptance, efficiency, and relevance among varying student and disciplinary groups. In light of the growing interest in employing ChatGPT for academic functions, the current study investigates whether Saudi Arabian students in higher education institutions accept it with open arms. Through an investigation of the factors impacting the perception of students and their utilization of AI platforms, i.e., ChatGPT, in the classroom, scholars and educational establishments can acquire a more profound comprehension of these occurrences and enhance their ability to regulate the ways in which students use artificial intelligence technologies into their lectures. In order to examine students’ perceptions towards using AI platforms for educational purposes, the conceptual framework of UTAUT has been adopted for use on school of business students in Saudi Arabia. In such culturally segregated nations, e.g., Saudi Arabia, which prohibit gender interaction between men and women, the current research also seeks to explore the role of gender in the acceptance and usage of AI tools, i.e., ChatGPT, for educational purposes. Moreover, the current research aims to explore the role of study disciplines (e.g., business, education, humanities, and social sciences) affecting students’ acceptance and usage of AI platforms.

2. Literature Review

2.1. Theoretical Framework

The conceptual framework of UTAUT has been adopted due to its comprehensive framework of acceptance and usage of AI platforms in different contexts, especially for educational purposes [14,15,16]. The core aspects of the UTAUT framework, which mainly affect users’ behavioral intentions, are performance expectancy (PE), effort expectancy (EE), social influence (SI), and facilitating conditions (FC) [15,17]. Performance expectancy (PE) tends to explore students’ perception of using AI to enhance their educational proficiency [14]. As mentioned by several studies (e.g., [18,19,20,21,22,23]), students mainly rely on using AI in their hard educational activities because they believe it may assist them in critical activities and enhance their performance. In terms of EE, this indicates students’ perceptions of how simple or difficult it is to use the technology. Students’ perception of AI tools like ChatGPT being intuitive, user-friendly, and effortlessly incorporated into regular educational activities improves their behavioral intention (BI) [19]. Elements like user interface design, general user experience, and simplicity of engagement all have an impact on students’ impressions [6,23,24,25]. Considering ChatGPT to involve minimum effort enhances the possibility that students would incorporate it into their usual learning routines [5,24,26].
SI investigates how educators and fellow students influence students’ attitudes toward ChatGPT [16,24]. This effect may be shown in how students perceive others’ attitudes, beliefs, and actions about the use of ChatGPT in the classroom [15,17]. The findings of empirical studies (e.g., [27,28,29]) have shown that when classmates utilize ChatGPT for learning purposes, it has the potential to enhance the performance of other students’ BI. FC evaluates the availability of resources required for efficient use [16]. The FC element includes technical mobility, access to appropriate instruction and tools, and broad incentive programs for integration [6,27,30]. Students’ BI refers to their intention to utilize AI learning platforms, e.g., ChatGPT. This is highly impacted by their view that the learning environment provides the resources and help required for its successful implementation [5,31]. A study conducted by Al-Emran et al. [23] deepened the emphasis of FC over technological facilities and improved students’ ability to interact with technology by highlighting the necessity for a favorable environment that supports students’ navigation in the effective usage of ChatGPT. Thus, we are prompted to develop the following hypotheses:
Hypothesis 1–4.
PE, EE, SI, and FC considerably and positively affect students’ BI toward usage of ChatGPT.
Both PE and EE explore the students’ interaction e.g., perceived value, efficiency, simplicity, and appropriateness towards their actual usage of integrated platforms of AI, focusing on ChatGPT (ex., [25,26,27]). In addition, enhancing students’ contributions, completing tasks, and academic performance are considered the most crucial facets of PE in using AI in higher education [21,27]. EE incorporates several beneficial aspects, such as flexibility, ease of access, and ability to complete routine tasks, which positively influence students’ intention to use AI platforms [3]. In terms of SI, it is simply related to the previous experiences of colleagues and recommendations towards intention to use AI tools for educational purposes (ex., [24,25,26,27,28]). The choice of students to actively integrate ChatGPT into their regular educational activities is also impacted by the encouragement and favorable experiences that colleagues provide [5,23,27]. The significant influence of FC on adoption and actual usage has been highlighted by earlier studies (ex., [32,33]) evaluating ChatGPT’s adaptability in education. Menon and Shilpa’s research [27] revealed that FC, comprising a mobile device, steady connection to the internet, and technical help and assistance, are essential elements dramatically determining ChatGPT adoption. Therefore, we hypothesize that:
Hypothesis 5–8.
PE, EE, SI, and FC considerably and positively affect students’ usage of ChatGPT.
One of the most pivotal roles in comprehending the beneficial characteristics of using AI tools is to explore the link between students’ behavioral intention to use AI platforms in educational themes [34]. The behavioral intentions of users reflect their alignment toward accepting and using a new innovative technology. e.g., AI platforms [16]. The positive behavioral intention towards students’ usage of AI applications for educational purposes is considered a crucial motive for their actual usage during their daily educational tasks (ex., [35,36]). Recent studies have argued that a strong positive correlation exists between students’ BI and the actual use of AI in an educational context due to the critical help needed to complete their educational activities [17,32]. Thus, drawing upon these insights, we are driven to construct this hypothesis:
Hypothesis 9.
Students’ BI considerably and positively affects students’ usage of ChatGPT.

2.2. The Role of Gender and Discipline in Students’ Perceptions, Acceptance, and Use of ChatGPT

Saudi Arabia adheres to socio-religious beliefs that incorporate gender segregation, a practice evident in higher education institutions [7]. This segregation extends to virtual environments due to the sensitivity and significance of avoiding gender mixing in Saudi society [8,9]. According to Alhazmi and Nyland [10], female students are completely isolated from their male peers during their academic career, even while they are interacting with tutors or lecturers. E-learning improves females’ access to higher education, according to studies on cultures with gender-based segregation, such as Saudi Arabia [11,12]. Because of their e-learning experiences, female students may therefore be more likely than male students to use AI chatbots, such as ChatGPT [10]. Alotabibi and Alshehri [13] argued that there are variations in the adoption and utilization of ChatGPT by students across various fields in higher education. According to Alotaibi and Alshehri’s [13] study, technical fields like computer science and engineering would be more receptive to ChatGPT, seeing it as a useful means for analysis of data and tackling issues. Jabeur et al. [37] have observed that while students studying the arts and social sciences may use it for language and text analysis tasks, business students may emphasize its usage in decision-making processes. The numerous uses of ChatGPT, including its ability to adapt to the unique requirements of integrated areas, may be highlighted in interdisciplinary courses. Alotaibi and Alshehri [13] also mentioned that these variations demonstrate the importance of considering disciplinary situations while using ChatGPT for educational purposes. Strzelecki and ElArabawy [38] conducted a recent study in which they investigated the role of gender and level of education on Egyptian and Polish undergraduate students’ adoption and use of generative AI platforms (e.g., ChatGPT). The main conclusions stated that, in both nations, the influence of students’ acceptance (i.e., effort anticipation, social influence, and conducive settings) on behavioral intention and usage of AI in educational contexts was moderated by gender and study field. Building upon these discussions, we postulate these hypotheses:
Hypothesis 10–13.
Gender plays a moderating role in the effects of PE, EE, SI, and FC on students’ usage of ChatGPT.
Hypothesis 14–17.
Discipline plays a moderating role in the effect of PE, EE, SI, and FC on students’ usage of ChatGPT.
A summary of all research hypotheses is presented in the study model (Figure 1).

3. Methods

3.1. Participants

The population studied by this research comprised all undergraduate students in Saudi universities who use ChatGPT for learning purposes. The sample included students at public universities in different Saudi regions, including eastern, western, northern, and southern. Therefore, we had good participation of students from seven universities. There were about 70 participants from each university. We were able to collect 500 completed questionnaires that could be used for data analysis. Data collection with 500 participants is considered sufficient for conducting PLS-SEM models and meets all the suggested requirements. Among the requirements, the most important preconditions to use in the process of defining a PLS-SEM analytical model included the determination of the minimum sample size. The minimum sample size of respondents can be calculated by the “ten-times rule” method proposed by Hair et al. [39], in which the sample size must be ten times more than the number of the constructs’ variables in the model. Specifically, there are six latent factors, with twenty-one formative items and two moderators in the presented model. Therefore, applying the rule ten times, the minimum sample size required would be 230. The target population included 500 participants, which exceeded the minimum number. In addition, the sample of 500 was larger than the recommended sample size for SEM, which ranges between 100 and 150 cases if we desire to obtain reliable results [39], and the minimum sample size of 384 if the population was greater than 100,000, as suggested by Krejcie and Morgan (40). Out of these collected forms, there was more participation from males (306) than females (194) (see Table 1). In terms of students’ age groups, the majority of students (52.2%) were in the category from 20 to 25 years of age. Additionally, students’ participation in the social sciences and humanities was slightly higher. This included 262 participants from the Colleges of Art, Education, and Management, compared to 238 natural, applied, and basic sciences students (i.e., Colleges of Science, Medicine, Pharmacy and Engineering).

3.2. Instrument

This study used a pre-examined questionnaire to gather data from students. The questionnaire form had four main parts. The first page of the questionnaire included some information about the topic, the purpose of the study, and a request for the participants’ consent to contribute to the study. Part one included questions related to participant demographics, e.g., gender and study discipline. Part two had questions about PE, EE, SI, and FC. The questions in this part adopted a five-point Likert scale. All items in this part had been tested in previous studies [6,38] and were originally developed from UTAUT framework [15,16]. Part three also used pre-tested five-point Likert scales about the intention and use of ChatGPT for learning. Items were taken from previous studies [6,38]. There was also a space for participants to add further comments in part four. The questionnaire form was checked for content and face validity by 10 professors, and minor edits were made to the format and contents. The research items used in this study are presented in the Appendix A. Appendix A shows the complete scale of the study variables.

3.3. Procedures

The research team self-administered the questionnaire forms to students at the seven public universities. The procedures of data collection started with approval of the questionnaire and procedures of data collection by the ethical committee at King Faisal University. Once the instrument and procedures were approved, we contacted several universities to address their students for participation in our study. Contacts were made with the Deans of Students Affairs at the universities. The researchers then visited universities and questionnaire forms were distributed to students individually at campuses. The purpose of the study was explained to each participant, and they were all assured that the data collection was for study purposes. Their participation was anonymous; thus, no personal information was collected. Each participant gave his/her consent for participation in the study. Students were informed that their responses would not be identified nor shared with their tutors nor their university administration, in order to avoid any power bias.

3.4. Data Analysis

The PLS-SEM approach was adopted as the main data analysis process. Hair et al. [39] argued that PLS-SEM represents another method for dealing with traditional covariance-based SEM [CB-SEM]. PLS-SEM and has become more reliable, especially in prediction and exploration-focused research [40,41]. PLS-SEM works well with both small and large samples because it is not dependent on the assumption that the sampling has a normal distribution [39]. SmartPLS 4 software was utilized to analyze the PLS [41]. The bootstrapping process, using reflective mode and n = 5000 resamples, was conducted to estimate the model [42]. As discussed by [41], we adopted two steps in PLS-SEM processing: (1) assessing the outer model or measurement model for construct validity and reliability, and (2) assessing the inner or structural model (for hypotheses testing). Additionally, Harman’s one-factor test was undertaken to deal with common method variance (CMV) as proposed by Podsakoff et al. [43]. All the questions were submitted to the exploratory factor analysis (EFA), and the first component contributed 42% of the total variation. Consequently, the abovementioned result indicates that the CMV was not a major problem in this research. Furthermore, all the VIF values were below 0.5, showing that there was no significant multicollinearity (see Table 2).

4. Results

The assessment of the outer model, specifically the measurement model, involved scrutinizing the psychometric characteristics of diverse scales, applying criteria such as Cronbach’s α, composite reliabilities (CR), and average variance extracted (AVE]. All items within the scales exhibited standardized loadings equal to or exceeding 0.7, indicating commendable convergent validity. The values for both Cronbach’s α and CR exceeded the established minimum threshold of 0.7, affirming the internal consistency of both items and constructs (refer to Table 2). Furthermore, the AVE values for all constructs surpassed the suggested threshold of 0.5, as outlined by Fornell & Larcker [44]. Hence, the convergent validity was approved as satisfactory, as all AVEs were 0.5 or higher.
Adhering to the methodology proposed by Fornell and Larcker [44], we verified discriminant validity by confirming that the square root of the AVE for each construct (values highlighted in bold in Table 3) surpassed the correlations between that specific construct and all other constructs (refer to Table 2). Furthermore, to enhance the assessment of discriminant validity, we employed the heterotrait-monotrait (HTMT) ratio of correlations, recognized as a more robust method compared to Fornell and Larcker’s [44]. The potential for concerns regarding discriminant validity arises when HTMT values (enclosed in brackets in Table 3) surpass 0.9. As depicted in Table 2, all ratios fell below the designated threshold of 0.9, thereby confirming the discriminant validity of the measurements for the constructs.
The bootstrapped R2 values, illustrated in Figure 2, revealed that the combined impact of UTAUT dimensions (performance expectancy, effort expectancy, social influence, and facilitating conditions) accounted for 36.3% of the variance in the intention to use ChatGPT. Additionally, when considering both the UTAUT dimensions and the intention to use ChatGPT, the collective explanatory power increased to 66.9% for the actual usage of ChatGPT.
Examining the bootstrapped path coefficients (Table 4), it was observed that student behavioral intention to use ChatGPT was significantly and positively impacted by performance expectancy (β = 0.179, t = 5.083, p < 0.001), effort expectancy (β = 0.084, t = 2.085, p < 0.05), and social influence (β = 0.556, t = 9.570, p < 0.001), supporting H1, H2, and H3. However, the results revealed that facilitating conditions negatively and significantly impacted student behavior in relation to using ChatGPT (β = −0.196, t = 4.758, p < 0.001), rejecting H4. Furthermore, the SEM-PLS findings provided evidence that the student’s actual usage of ChatGPT was positively and significantly impacted by performance expectancy (β = 0.099, t = 2.213, p < 0.05) and social influence (β = 0.132, t = 2.390, p < 0.05), supporting H5 and H7. However, effort expectancy (β = −0.051, t = 1.073, p = 0.283) and facilitating conditions (β = 0.030, t = 534, p ≤ 0.593) failed to influence the students’ actual usage of ChatGPT positively and significantly, rejecting H6 and H8. Finally, the behavioral intention to use ChatGPT was found to have a high positive and significant impact on the students’ actual usage of ChatGPT (β = 0.743, t = 20.283, p < 0.001), supporting H9.
To test the moderating impacts of gender and study discipline on the variables within the tested model, the Smart PLS-SEM v4 program was used to split the data and categorize responses according to gender (males coded as one, females coded as zero) and study discipline (social sciences coded as one, natural sciences coded as zero). As illustrated in Table 4, gender (male/female) as a moderator failed to demonstrate any significant differences in the impact of effort expectancy on ChatGPT use (β = 0.004, t = 0.076, p = 0.940), rejecting H11. Similarly, gender as a moderator failed to demonstrate any significant differences in the impact of facilitating conditions on ChatGPT use (β = −0.030, t = 0.538, p = 0.591), rejecting H13. Furthermore, discipline (social science/natural science) as a moderator failed to demonstrate any significant differences in the impact of performance expectancy on ChatGPT use (β = −0.034, t = 0.538, p = 0.591), effort expectancy on ChatGPT use (β = 0.021, t = 0.402, p = 0.688), and to make any significant differences in the impact of facilitating conditions on ChatGPT use (β = 0.007, t = 0.107, p = 0.915) rejecting H14, H15, and H17.
On the other hand, as shown in Figure 3, the results revealed a significant moderating role of gender in the link between performance expectancy and use of ChatGPT. The plot shows a steeper and positive gradient for males compared to females. Thus, this shows that the impact of performance expectancy in fostering ChatGPT usage is stronger in males as compared to females, supporting H10. Moreover, the findings demonstrated that gender significantly modified the association between behavioral intention and social impact. In comparison to the male plot, the female plot displays a steeper and more positive gradient. This supports H12 by demonstrating that social influence has a greater effect on females than on males in promoting ChatGPT usage. The research discipline significantly moderated the link between social influence and ChatGPT use, as the data showed. In comparison to the natural sciences, the social science subject was represented by a plot with a steeper and more positive gradient. This demonstrates that social influence has a greater influence on ChatGPT use in social sciences than in natural sciences, which supports H16.

5. Discussions

This research adopted the UTAUT framework to test the variables that influence students’ use of ChatGPT in learning. This study focused on how gender and academic discipline moderate the relationship between students’ approval and use of ChatGPT for learning. The findings verified that PE, EE, and SI greatly and favorably influenced the desire of students to adopt ChatGPT for learning. These data support H1, H2, and H3, respectively. These results align with the hypotheses proposed by the UTAUT structure [15,16], which verified a statistically significant impact of the three factors (PE, EE, and SI) on the behavioral intention to adopt ChatGPT for e-learning. The data confirmed that since students found ChatGPT to be an acceptable instrument for their academic pursuits, it encourages them to attain their academic objectives, boosts their productivity, and elevates their academic performance. The results of this study validate the claims stated by earlier research [6,21,22,23,38], showing that PE positively affects the behavioral intention to adopt ChatGPT for learning. The current study also confirmed that students found that ChatGPT does not require much effort to learn how to use, hence showing positive intention to adopt it for learning. These findings are supported by previous studies (e.g., [6,25,26,27]) which have shown that when users find that an AI tool is user-friendly and easy to comprehend, they express positive intention to adopt the tool, such as with ChatGPT for learning. Furthermore, this study has supported previous studies [15,17] in the assertion that SI shaped by colleagues and tutors positively impacts behavioral intentions to embrace ChatGPT for learning.
However, the findings showed that FC negatively and significantly impacts on students’ behaviour in terms of using ChatGPT, rejecting H4. This finding does not support the UTAUT theory [15,16], nor previous research, which has confirmed that FC significantly influences students’ behaviour towards the adoption of ChatGPT [23,31]. Previous studies have confirmed that FC variables, such as technology accessibility, providing of essential facilities, and support, positively drive students’ intentions to adopt ChatGPT for learning. The negative impact found in this study was because the quality of support and resources surrounding the use of AI tools, including ChatGPT, in learning did not meet students’ expectations. Since students did not receive quality support from their institutions or other external sources as expected, they expressed a negative intention to adopt this AI instrument for learning. H5 and H7 were supported by the SEM-PLS findings, which demonstrated that PE and SI had a direct, favorable, and significant impact on students’ usage of ChatGPT. These findings supported the UTAUT framework [15,16] and previous studies (e.g., [6,27]), in which PE and SI stand out as key factors influencing students’ usage of ChatGPT for educational purposes. However, the findings showed that EE and FC failed to positively and significantly influence the usage of ChatGPT, rejecting H6 and H8. This contradicts the UTAUT framework [15,16] and previous studies [23,26,27,31], which have confirmed the significant positive impact of EE and FC on the usage of ChatGPT for learning. Students did not have the quality support and resources from their institutions as expected; while they found that ChatGPT is user-friendly, this was not enough to ensure the usage of ChatGPT for learning. Furthermore, the behavioral intention to use ChatGPT was found to have a highly positive and significant impact on student usage of ChatGPT for learning, supporting H9. This is consistent with UTAUT theory [15,16] and previous studies [17,32]. This means that when students decided to use ChatGPT for learning, they continued their usage and found that it positively impacted their performance [45]. However, it is important that students recognize the ethical concerns related to the use of AI tools in their learning in order to maintain a sustainable impact on their performance [45,46].
The results confirmed a significant moderating effect of gender in the link between PE and using ChatGPT for learning. The findings confirmed that PE fosters ChatGPT usage more strongly in males compared to females, supporting H10. Additionally, the findings revealed a significant moderating role of gender on the relationship between SI and use of ChatGPT. The findings showed that the impact of SI in fostering the use of ChatGPT was stronger in females as compared to males, supporting H12. However, there was no moderating role of gender in the relationship between EE, FC, and the use of ChatGPT for learning. Previous studies in the Saudi context confirmed significant variance between males and females in their acceptance and adoption of e-learning [7,10]. These studies found that female students exhibited greater acceptance and use of e-learning because they have less direct contact with their tutors and often use learning management systems for communication. Similarly, in this research, it was revealed that female students found ChatGPT to be a more valuable tool that enhances their productivity and elevates their performance moreso than their male colleagues, and hence they are more likely to use it than male students. Female students are more likely to be affected by their peers, and hence they are more likely to use ChatGPT for learning than their male colleagues.
The results confirmed a significant moderating role of study discipline on the link between SI and use of ChatGPT. This study showed that the impact of SI in fostering ChatGPT usage was stronger in the social sciences discipline as compared to the natural sciences discipline, supporting H16. Social sciences students were found to be more affected by their peers in relation to the use of ChatGPT for learning than students in the natural sciences. There were no differences between students in different sciences regarding the effects of PE, EE, and FC on the use of ChatGPT for learning.
This study has significant implications for scholars and higher education policy makers. It revealed the variables that impact on both students’ intention and usage of AI instruments, e.g., ChatGPT. The study confirmed that FC failed to directly and indirectly affect ChatGPT use for learning. In fact, it was found that it had a significant negative impact on behavioral intention. These findings demonstrate the lack of quality support given to students in relation to the use of ChatGPT in learning. Students are using ChatGPT for learning, but institution leaders are not encouraged to integrate AI tools in learning [5], leading to a lack of quality support. The negative impact of this on behavioral intention and its insignificant impact on usage requires developing a policy and procedures for integrating AI tools in learning. A support unit should be established to manage this process.
The moderating effect of gender in the association between PE, SI, and ChatGPT use for learning reflects a shift in students’ use of AI tools for learning in Saudi Arabia. This is because earlier research [7,10] confirmed that female students use e-learning more than their male counterparts. This study confirms that male students found AI tools, i.e., ChatGPT, more valuable for their academic pursuits than their female counterparts. They are more likely to be affected by their peers when using ChatGPT. In addition, students in social sciences in Saudi Arabia are more likely to be affected by their colleagues than those in natural sciences regarding their use of ChatGPT for learning. This provides the opportunity for more studies to be conducted to understand the differences between students in various disciplines regarding the use of AI tools for learning.

6. Limitations of the Study

This study used a self-report survey to collect data. Hence, a longitudinal study could be adopted to examine the relationships explored in this research. The study’s focus on a specific cultural (Saudi Arabia) and institutional context (university/higher education students) may limit its applicability to diverse educational settings. Cultural nuances and institutional variations could significantly affect students’ acceptance and utilization of ChatGPT. The reliance on self-reported data, particularly in surveys, introduces response bias. Participants may provide socially desirable responses, affecting the potential accuracy of the reported attitudes and behaviors toward ChatGPT. Future studies could adopt a longitudinal approach to explore the temporal dynamics of students’ adoption of AI tools. This would allow for a more nuanced understanding of how these relationships evolve over an extended period. This study has one more limitation, as it did not explore other possible variables that might shape ChatGPT acceptance and usage, such as prior exposure to AI tools, access to technology, and socio-economic status. The inclusion of these controls and variables would enhance our understanding of the evaluated relationships. Therefore, considering such limitations and conducting future studies would contribute to a more comprehensive and nuanced understanding of the moderating roles of gender and study discipline in the acceptance and usage of ChatGPT among university students.

Author Contributions

Conceptualization, A.E.E.S., I.A.E. and A.M.H., methodology, I.A.E., A.E.E.S. and A.M.H., software, I.A.E., validation, A.E.E.S. and I.A.E., formal analysis, I.A.E. and A.E.E.S., investigation A.E.E.S., A.M.H. and I.A.E., resources, A.E.E.S., data curation, A.E.E.S. and I.A.E., writing: original draft preparation, I.A.E., A.E.E.S. and A.M.H., writing: review and editing, A.E.E.S. and I.A.E., visualization, A.M.H. and I.A.E., supervision, I.A.E., project administration, A.E.E.S., I.A.E. and A.M.H., funding acquisition, A.E.E.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia, grant number GRANTA164.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Deanship of the Scientific Research Ethical Committee, King Faisal University (project number: GRANTA164).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available upon request from researchers who meet the eligibility criteria. Kindly contact the first author privately through e-mail.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A. The Employed Measures

Factors/CodeFull Sentence
Performance Expectancy
PE1“ChatGPT is an invaluable asset for enhancing my academic endeavors”
PE2“Employing ChatGPT significantly increases the likelihood of achieving crucial objectives in academic pursuits”
PE3“ ChatGPT optimizes productivity in academic endeavors by streamlining task and project completion”
PE4“Engaging with ChatGPT has the potential to enhance my academic performance”
Effort Expectancy
EE1“I perceive learning to use ChatGPT as straightforward”
EE2“The interaction with ChatGPT is clear and easily understandable”
EE3“ChatGPT boasts a user-friendly and intuitive interface”
EE4“I effortlessly develop proficiency in utilizing ChatGPT”
Social Influence
SI1“The individuals who hold significant influence in my life strongly advocate for the use of ChatGPT”
SI2“The people who influence my actions endorse the utilization of ChatGPT”
SI3“The perspectives of those whom I deeply respect indicate a recommendation for incorporating ChatGPT into my activities”
Facilitating Conditions
FC1“I possess sufficient resources to effectively utilize ChatGPT”
FC2“I have acquired the necessary skills to proficiently use ChatGPT”
FC3“ChatGPT aligns with the technological tools I employ”
FC4“In the event of challenges with ChatGPT, external support and assistance are readily available”
Behaviour Intention [mediating variable]
M1“I have made the decision to persist in using ChatGPT going forward”
M2“I am fully committed to employing ChatGPT as an integral tool for my academic endeavors”
M3“I am determined to maintain a consistent usage of ChatGPT”
Usage [dependent varaiable]
Y1“I plan to apply the knowledge and skills gained from ChatGPT in my educational pursuits”
Y2“The knowledge and skills acquired through ChatGPT will prove beneficial to my classroom endeavors”
Y3“Utilizing ChatGPT has contributed to enhancing my academic performance”

References

  1. Metwally, A.B.; Ali, S.A.; Mohamed, A.T. Thinking Responsibly About Responsible AI in Risk Management: The Darkside of AI in RM. In Proceedings of the 2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS), Manama, Bahrain, 28–29 January 2024; pp. 1–5. [Google Scholar]
  2. Ali, S.A.; Metwally, A.B.; Mohamed, A.T. Enhancing AIS Reliability: Suggested Framework for the Role of Trust Service and Artificial Intelligence. In Proceedings of the 2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS), Manama, Bahrain, 28–29 January 2024; pp. 520–525. [Google Scholar]
  3. Benuyenah, V. Commentary: ChatGPT use in higher education assessment: Prospects and epistemic threats. J. Res. Innov. Teach. Learn. 2023, 16, 134–135. [Google Scholar] [CrossRef]
  4. Rasul, T.; Nair, S.; Kalendra, D.; Robin, M.; Santini, F.D.O.; Ladeira, W.J.; Sun, M.; Day, I.; Rather, R.A.; Heathcote, L. The role of ChatGPT in higher education: Benefits, challenges, and future research directions. J. Appl. Learn. Teach. 2023, 6, 41–56. [Google Scholar] [CrossRef]
  5. Hasanein, A.M.; Sobaih, A.E.E. Drivers and Consequences of ChatGPT Use in Higher Education: Key Stakeholder Perspectives. Eur. J. Investig. Health Psychol. Educ. 2023, 13, 2599–2614. [Google Scholar] [CrossRef]
  6. Strzelecki, A. To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interact. Learn. Environ. 2023, 1–14. [Google Scholar] [CrossRef]
  7. Alyahya, M.A.; Elshaer, I.A.; Abunasser, F.; Hassan, O.H.M.; Sobaih, A.E.E. E-learning experience in higher education amid COVID-19: Does gender really matter in a gender-segregated culture? Sustainability 2022, 14, 3298. [Google Scholar] [CrossRef]
  8. Alhazmi, A.; Nyland, B. Contextualization of Saudi international students’ experience in facing the challenge of moving to mixed gender environments. Am. Int. J. Contemp. Res. 2015, 5, 87–97. [Google Scholar]
  9. Achoui, M.M. The Saudi society: Tradition and change. In Families Across Cultures: A 30 Nation Psychological Study; Cambridge University Press: Cambridge, MA, USA, 2006; p. 435. [Google Scholar]
  10. Alhazmi, A.; Nyland, B. The Saudi Arabian international student experience: From a gender-segregated society to studying in a mixed-gender environment. Comp. J. Comp. Int. Educ. 2013, 43, 346–365. [Google Scholar] [CrossRef]
  11. Yilmaz, H.; Maxutov, S.; Baitekov, A.; Balta, N. Student attitudes towards chat GPT: A technology acceptance Model survey. Int. Educ. Rev. 2023, 1, 57–83. [Google Scholar] [CrossRef]
  12. Sakirin, T.; Said, R.B. User preferences for ChatGPT-powered conversational interfaces versus traditional methods. Mesopotamian J. Comput. Sci. 2023, 2023, 24–31. [Google Scholar] [CrossRef]
  13. Alotaibi, N.S.; Alshehri, A.H. Prospers and Obstacles in Using Artificial Intelligence in Saudi Arabia Higher Education Institutions—The Potential of AI-Based Learning Outcomes. Sustainability 2023, 15, 10723. [Google Scholar] [CrossRef]
  14. Magsamen-Conrad, K.; Upadhyaya, S.; Joa, C.Y.; Dowd, J. Bridging the divide: Using UTAUT to predict multigenerational tablet adoption practices. Comput. Hum. Behav. 2015, 50, 186–196. [Google Scholar] [CrossRef] [PubMed]
  15. Venkatesh, V. Adoption and use of AI tools: A research agenda grounded in UTAUT. Ann. Oper. Res. 2022, 308, 641–652. [Google Scholar] [CrossRef]
  16. Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User acceptance of information technology: Toward a unified view. MIS Q. 2003, 27, 425–478. [Google Scholar] [CrossRef]
  17. Shahsavar, Y.; Choudhury, A. User Intentions to Use ChatGPT for Self-Diagnosis and Health-Related Purposes: Cross-sectional Survey Study. JMIR Hum. Factors 2023, 10, e47564. [Google Scholar] [CrossRef] [PubMed]
  18. Fagan, M.; Kilmon, C.; Pandey, V. Exploring the adoption of a virtual reality simulation: The role of perceived ease of use, perceived usefulness and personal innovativeness. Campus-Wide Inf. Syst. 2012, 29, 117–127. [Google Scholar] [CrossRef]
  19. Kasilingam, D.L. Understanding the attitude and intention to use smartphone chatbots for shopping. Technol. Soc. 2020, 62, 101280. [Google Scholar] [CrossRef]
  20. Brachten, F.; Kissmer, T.; Stieglitz, S. The acceptance of chatbots in an enterprise context—A survey study. Int. J. Inf. Manag. 2021, 60, 102375. [Google Scholar] [CrossRef]
  21. Mogaji, E.; Balakrishnan, J.; Nwoba, A.C.; Nguyen, N.P. Emerging-market consumers’ interactions with banking chatbots. Telemat. Inform. 2021, 65, 101711. [Google Scholar] [CrossRef]
  22. Bin-Nashwan, S.A.; Sadallah, M.; Bouteraa, M. Use of ChatGPT in academia: Academic integrity hangs in the balance. Technol. Soc. 2023, 75, 102370. [Google Scholar] [CrossRef]
  23. Al-Emran, M.; AlQudah, A.A.; Abbasi, G.A.; Al-Sharafi, M.A.; Iranmanesh, M. Determinants of using AI-based chatbots for knowledge sharing: Evidence from PLS-SEM and fuzzy sets (fsQCA). IEEE Trans. Eng. Manag. 2023, 71, 4985–4999. [Google Scholar] [CrossRef]
  24. Foroughi, B.; Senali, M.G.; Iranmanesh, M.; Khanfar, A.; Ghobakhloo, M.; Annamalai, N.; Naghmeh-Abbaspour, B. Determinants of intention to use ChatGPT for educational purposes: Findings from PLS-SEM and fsQCA. Int. J. Hum.—Comput. Interact. 2023, 1–20. [Google Scholar] [CrossRef]
  25. Shaengchart, Y.; Bhumpenpein, N.; Kongnakorn, K.; Khwannu, P.; Tiwtakul, A.; Detmee, S. Factors influencing the acceptance of ChatGPT usage among higher education students in Bangkok, Thailand. Adv. Knowl. Exec. 2023, 2, 1–14. [Google Scholar]
  26. Tiwari, C.K.; Bhat, M.A.; Khan, S.T.; Subramaniam, R.; Khan, M.A.I. What drives students toward ChatGPT? An investigation of the factors influencing adoption and usage of ChatGPT. Interact. Technol. Smart Educ. 2023. ahead-of-print. [Google Scholar] [CrossRef]
  27. Menon, D.; Shilpa, K. “Chatting with ChatGPT”: Analyzing the factors influencing users’ intention to Use the Open AI’s ChatGPT using the UTAUT model. Heliyon 2023, 9, e20962. [Google Scholar] [CrossRef] [PubMed]
  28. Jo, H. Understanding AI tool engagement: A study of ChatGPT usage and word-of-mouth among university students and office workers. Telemat. Inform. 2023, 85, 102067. [Google Scholar] [CrossRef]
  29. Ma, X.; Huo, Y. Are users willing to embrace ChatGPT? Exploring the factors on the acceptance of chatbots from the perspective of AIDUA framework. Technol. Soc. 2023, 75, 102362. [Google Scholar] [CrossRef]
  30. Oye, N.D.; Iahad, N.A.; Rahim, N.A. The history of UTAUT model and its impact on ICT acceptance and usage by academicians. Educ. Inf. Technol. 2014, 19, 251–270. [Google Scholar] [CrossRef]
  31. Ivanov, S.; Soliman, M. Game of algorithms: ChatGPT implications for the future of tourism education and research. J. Tour. Futures 2023, 9, 214–221. [Google Scholar] [CrossRef]
  32. Chan, C.K.Y.; Zhou, W. Deconstructing Student Perceptions of Generative AI (GenAI) through an Expectancy Value Theory (EVT)-based Instrument. arXiv 2023, arXiv:2305.01186. [Google Scholar]
  33. Duong, C.D.; Vu, T.N.; Ngo, T.V.N. Applying a modified technology acceptance model to explain higher education students’ usage of ChatGPT: A serial multiple mediation model with knowledge sharing as a moderator. Int. J. Manag. Educ. 2023, 21, 100883. [Google Scholar] [CrossRef]
  34. Terblanche, N.; Kidd, M. Adoption factors and moderating effects of age and gender that influence the intention to use a non-directive reflective coaching chatbot. SAGE Open 2022, 12, 21582440221096136. [Google Scholar] [CrossRef]
  35. Anayat, S.; Rasool, G.; Pathania, A. Examining the context-specific reasons and adoption of artificial intelligence-based voice assistants: A behavioural reasoning theory approach. Int. J. Consum. Stud. 2023, 47, 1885–1910. [Google Scholar] [CrossRef]
  36. Ge, H.; Wu, Y. An Empirical Study of Adoption of ChatGPT for Bug Fixing among Professional Developers. Innov. Technol. Adv. 2023, 1, 21–29. [Google Scholar] [CrossRef]
  37. Jabeur, S.B.; Ballouk, H.; Mefteh-Wali, S.; Omri, A. Forecasting the macrolevel determinants of entrepreneurial opportunities using artificial intelligence models. Technol. Forecast. Soc. Change 2022, 175, 121353. [Google Scholar] [CrossRef]
  38. Strzelecki, A.; ElArabawy, S. Investigation of the moderation effect of gender and study level on the acceptance and use of generative AI by higher education students: Comparative evidence from Poland and Egypt. Br. J. Educ. Technol. 2024, 55, 1209–1230. [Google Scholar] [CrossRef]
  39. Hair, J.F., Jr.; Matthews, L.M.; Matthews, R.L.; Sarstedt, M. PLS-SEM or CB-SEM: Updated guidelines on which method to use. Int. J. Multivar. Data Anal. 2017, 1, 107–123. [Google Scholar] [CrossRef]
  40. Henseler, J.; Ringle, C.M.; Sinkovics, R.R. The Use of Partial Least Squares Path Modeling in International Marketing. In Advances in International Marketing; Sinkovics, R.R., Ghauri, P.N., Eds.; Emerald Group Publishing Limited: Bingley, UK, 2009; Volume 20, pp. 277–319. ISBN 978-1-84855-468-9. [Google Scholar]
  41. Ringle, C.M.; Sarstedt, M.; Mitchell, R.; Gudergan, S.P. Partial Least Squares Structural Equation Modeling in HRM Research. Int. J. Hum. Resour. Manag. 2020, 31, 1617–1643. [Google Scholar] [CrossRef]
  42. Do Valle, P.O.; Assaker, G. Using Partial Least Squares Structural Equation Modeling in Tourism Research: A Review of Past Research and Recommendations for Future Applications. J. Travel Res. 2016, 55, 695–708. [Google Scholar] [CrossRef]
  43. Podsakoff, P.M.; MacKenzie, S.B.; Lee, J.-Y.; Podsakoff, N.P. Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies. J. Appl. Psychol. 2003, 88, 879. [Google Scholar] [CrossRef]
  44. Fornell, C.; Larcker, D.F. Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. J. Mark. Res. 1981, 18, 382–388. [Google Scholar] [CrossRef]
  45. Sobaih, A.E.E.; Elshaer, I.A.; Hasanein, A.M. Examining Students’ Acceptance and Use of ChatGPT in Saudi Arabian Higher Education. Eur. J. Investig. Health Psychol. Educ. 2024, 14, 709–721. [Google Scholar] [CrossRef] [PubMed]
  46. Sobaih, A.E.E. Ethical concerns for using artificial intelligence chatbots in research and publication: Evidences from Saudi Arabia. J. Appl. Learn. Teach. 2024, 7, 1–11. [Google Scholar] [CrossRef]
Figure 1. The study model.
Figure 1. The study model.
Ejihpe 14 00132 g001
Figure 2. The examined relationships.
Figure 2. The examined relationships.
Ejihpe 14 00132 g002
Figure 3. The moderation effects. Gender: males coded as one, females coded as zero. Discipline: social sciences coded as one, natural sciences coded as zero.
Figure 3. The moderation effects. Gender: males coded as one, females coded as zero. Discipline: social sciences coded as one, natural sciences coded as zero.
Ejihpe 14 00132 g003aEjihpe 14 00132 g003b
Table 1. Students’ profiles (N = 500).
Table 1. Students’ profiles (N = 500).
ProfileFreq.%
GenderMale30661.2
Female19438.8
AgeLess than 20 years19639.2
20 to 25 years26152.2
26 to 30 years438.6
Study disciplineSocial sciences15631.2
Humanities10621.2
Natural sciences11122.2
Applied sciences8116.2
Basic sciences469.2
Table 2. Factors and psychometric properties.
Table 2. Factors and psychometric properties.
LoadingsαC.R.AVEVIF
Performance Expectancy0.8750.9070.712
PE10.732 3.525
PE20.740 3.306
PE30.936 2.537
PE40.943 2.372
Effort Expectancy0.9400.9560.846
EE10.919 3.737
EE20.923 4.450
EE30.932 3.947
EE40.905 3.587
Social Influence0.8420.9050.763
SI10.941 4.183
SI20.945 4.285
SI30.715 1.419
Facilitating Conditions0.9410.9530.835
FC10.877 4.678
FC20.873 4.406
FC30.959 3.963
FC40.944 4.186
Behaviour Intention (mediating variable)0.7520.8590.672
M10.844 1.879
M20.896 2.001
M30.708 1.269
Usage (dependent varaiables)0.9280.9540.874
Y10.948 4.130
Y20.928 3.325
Y30.928 3.734
Table 3. Discriminant validity based on the Fornell and Larcker and HTMT methods.
Table 3. Discriminant validity based on the Fornell and Larcker and HTMT methods.
BIEEFCPESIChatGPT Usage
BI0.820
EE−0.060 [0.095]0.920
FC−0.196 [0.195]0.487 [0.547]0.914
PE0.148 [0.195]0.016 [0.028]−0.048 [0.061]0.844
SI0.546 [0.688]−0.094 [0.112]−0.059 [0.059]−0.076 [0.158]0.874
ChatGPT Usage0.800 [0.829]−0.082 [0.085]−0.162 [0.142]0.223 [0.233]0.486 [0.532]0.935
Note: old values refers to the square root of the AVE for each construct.
Table 4. Hypotheses results.
Table 4. Hypotheses results.
Hypothesesβtp ValuesResults
Performance Expectancy -> Behavioral Intention0.1795.0830.000Support H1
Effort Expectancy -> Behavioral Intention0.0842.0850.037Support H2
Social Influence -> Behavioral Intention0.5569.5700.000Support H3
Facilitating Conditions -> Behavioral Intention−0.1964.7580.000Reject H4
Performance Expectancy -> Use ChatGPT0.0992.2130.027Support H5
Effort Expectancy -> Use ChatGPT−0.0511.0730.283Reject H6
Social Influence -> Use ChatGPT0.1322.3900.017Support H7
Facilitating Conditions -> Use ChatGPT0.0300.5340.593Reject H8
Behavioral Intention -> Use ChatGPT0.74320.2830.000Support H9
Moderation
Gender x Performance Expectancy -> Use ChatGPT0.0961.9600.050Support H10
Gender x Effort Expectancy -> Use ChatGPT0.0040.0760.940Reject H11
Gender x Social Influence -> Use ChatGPT−0.1461.9620.049Support H12
Gender x Facilitating Conditions -> Use ChatGPT−0.0300.5380.591Reject H13
Discipline x Performance Expectancy -> Use ChatGPT−0.0340.7180.473Reject H14
Discipline x Effort Expectancy -> Use ChatGPT0.0210.4020.688Reject H15
Discipline x Social Influence -> Use ChatGPT0.0931.9610.050Support H16
Discipline x Facilitating Conditions -> Use ChatGPT0.0070.1070.915Reject H17
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Elshaer, I.A.; Hasanein, A.M.; Sobaih, A.E.E. The Moderating Effects of Gender and Study Discipline in the Relationship between University Students’ Acceptance and Use of ChatGPT. Eur. J. Investig. Health Psychol. Educ. 2024, 14, 1981-1995. https://doi.org/10.3390/ejihpe14070132

AMA Style

Elshaer IA, Hasanein AM, Sobaih AEE. The Moderating Effects of Gender and Study Discipline in the Relationship between University Students’ Acceptance and Use of ChatGPT. European Journal of Investigation in Health, Psychology and Education. 2024; 14(7):1981-1995. https://doi.org/10.3390/ejihpe14070132

Chicago/Turabian Style

Elshaer, Ibrahim A., Ahmed M. Hasanein, and Abu Elnasr E. Sobaih. 2024. "The Moderating Effects of Gender and Study Discipline in the Relationship between University Students’ Acceptance and Use of ChatGPT" European Journal of Investigation in Health, Psychology and Education 14, no. 7: 1981-1995. https://doi.org/10.3390/ejihpe14070132

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop