The Usage of AI in Teaching and Students’ Creativity: The Mediating Role of Learning Engagement and the Moderating Role of AI Literacy
Abstract
:1. Introduction
2. Hypothesis Development
2.1. The Usage of AI in Teaching and Student Creativity
2.2. The Mediating Role of Learning Engagement
2.3. The Moderating Role of AI Literacy
3. Methods
3.1. Participants and Sampling
3.2. Measurements
3.3. Data Analysis Strategy
4. Results
4.1. Common Method Bias Test
4.2. Descriptive Statistical Analysis
4.3. Confirmatory Factor Analysis
4.4. Hypothesis Testing
5. Discussion
5.1. Theoretical Contributions
5.2. Practical Contributions
5.3. Research Limitations and Future Directions
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
- Items of the usage of AI in teaching
- My teacher frequently used AI tools to carry out most teaching tasks.
- Most of the class time involved my teacher working with AI tools.
- My teacher used AI tools to support major teaching decisions.
- Items of Learning Engagement
- Making sure to study on a regular basis
- Putting forth effort
- Staying up on the readings
- Looking over class notes between getting class to make sure I understand the material
- Being organized
- Taking good notes over readings, PowerPoints, or video lectures
- Listening/reading carefully
- Finding ways to make the course material relevant to my life
- Applying course material to my life
- Finding ways to make the course interesting to me
- Really desiring to learn the material
- Having fun in chats, discussions with the instructor or other students
- Participating actively in small-group discussion forums
- Helping fellow students
- Getting a good grade
- Doing well on the tests/quizzes
- Engaging in conversations
- Posting in the discussion forum regularly
- Getting to know other students in the class
- Items of Student Creativity
- I have generated innovative solutions or ideas during my studies that have helped me solve complex problems or challenges in my coursework.
- I have applied concepts or skills learned in class to create new ideas, projects, or solutions outside of the classroom setting.
- I have produced original work (e.g., essays, presentations, or projects) in my coursework that was recognized for its creativity by peers or instructors.
- I have contributed creative ideas or solutions during group work or collaborative projects, enhancing the overall outcome of the project.
- I have used the knowledge and skills gained in my education to develop creative solutions to real-world problems or challenges, demonstrating practical application of learning.
- Items of AI Literacy
- My teacher can distinguish between smart devices and non-smart devices.
- My teacher knows how AI technology can help in teaching and learning.
- My teacher can identify the AI technology used in the educational tools and platforms they utilize.
- My teacher can skillfully use AI applications or products to support their teaching and enhance student learning.
- It is usually hard for my teacher to learn to use a new AI application or product.
- My teacher uses AI applications or products to improve teaching efficiency and effectiveness.
- My teacher can evaluate the capabilities and limitations of an AI application or product after using it for a while.
- My teacher can choose a proper solution from various AI-driven tools or platforms available.
- My teacher can select the most appropriate AI application or product for specific tasks in the classroom.
- My teacher always complies with ethical principles when using AI applications or products in their teaching.
- My teacher is always aware of privacy and information security issues when using AI applications or products.
- My teacher is always alert to the potential abuse of AI technology in the classroom.
References
- Al Darayseh, A. (2023). Acceptance of artificial intelligence in teaching science: Science teachers’ perspective. Computers and Education: Artificial Intelligence, 4, 100132. [Google Scholar] [CrossRef]
- Ali, Z. (2020). Artificial intelligence (AI): A review of its uses in language teaching and learning. IOP Conference Series Materials Science and Engineering, 769(1), 012043. [Google Scholar]
- Almatrafi, O., Johri, A., & Lee, H. (2024). A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023). Computers and Education Open, 6, 100173. [Google Scholar] [CrossRef]
- Appleton, J. J., Christenson, S. L., & Furlong, M. J. (2008). Student engagement with school: Critical conceptual and methodological issues of the construct. Psychology in the Schools, 45(5), 369–386. [Google Scholar] [CrossRef]
- Balacheff, N. (1993). Artificial intelligence and real teaching. In C. Keitel, & K. Ruthven (Eds.), Learning from computers: Mathematics education and technology (pp. 131–158). Springer. [Google Scholar]
- Bewersdorff, A., Hornberger, M., Nerdel, C., & Schiff, D. S. (2025). AI advocates and cautious critics: How AI attitudes, AI interest, use of AI, and AI literacy build university students’ AI self-efficacy. Computers and Education: Artificial Intelligence, 8, 100340. [Google Scholar] [CrossRef]
- Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616–630. [Google Scholar] [CrossRef]
- Chan, S. L., Lin, C. C., Chau, P. H., Takemura, N., & Fung, J. T. C. (2021). Evaluating online learning engagement of nursing students. Nurse Education Today, 104, 104985. [Google Scholar] [CrossRef]
- Chen, I. S. (2017). Computer self-efficacy, learning performance, and the mediating role of learning engagement. Computers in Human Behavior, 72, 362–370. [Google Scholar] [CrossRef]
- Conrad, D., & Openo, J. (2018). Assessment strategies for online learning: Engagement and authenticity. Athabasca University Press. [Google Scholar]
- Dixson, M. D. (2015). Measuring student engagement in the online course: The Online Student Engagement scale (OSE). Online Learning, 19(4), n4. [Google Scholar] [CrossRef]
- Druga, S., Vu, S. T., Likhith, E., & Qiu, T. (2019, March 9–10). Inclusive AI literacy for kids around the world. FabLearn 2019 (pp. 104–111), New York, NY, USA. [Google Scholar]
- Eguchi, A., Okada, H., & Muto, Y. (2021). Contextualizing AI education for K-12 students to enhance their learning of AI literacy through culturally responsive approaches. KI-Künstliche Intelligenz, 35(2), 153–161. [Google Scholar] [CrossRef]
- Ertmer, P. A., & Newby, T. J. (1993). Behaviorism, cognitivism, constructivism: Comparing critical features from an instructional design perspective. Performance Improvement Quarterly, 6(4), 50–72. [Google Scholar] [CrossRef]
- Fahimirad, M., & Kotamjani, S. S. (2018). A review on application of artificial intelligence in teaching and learning in educational contexts. International Journal of Learning and Development, 8(4), 106–118. [Google Scholar] [CrossRef]
- Halbesleben, J. R. B., Neveu, J.-P., Paustian-Underdahl, S. C., & Westman, M. (2014). Getting to the “COR” understanding the role of resources in conservation of resources theory. Journal of Management, 40(5), 1334–1364. [Google Scholar] [CrossRef]
- Halverson, L. R., & Graham, C. R. (2019). Learner engagement in blended learning environments: A conceptual framework. Online Learning, 23(2), 145–178. [Google Scholar] [CrossRef]
- Hobfoll, S. E., & Shirom, A. (2000). Conservation of resources theory: Applications to stress and management in the workplace. Handbook of Organization Behavior, 2, 57–81. [Google Scholar]
- Hong, J., & Kim, K. (2024). Impact of AIoT education program on digital and AI literacy of elementary school students. Education and Information Technologies, 1–24. [Google Scholar] [CrossRef]
- Jahnke, I., Haertel, T., & Wildt, J. (2017). Teachers’ conceptions of student creativity in higher education. Innovations in Education and Teaching International, 54(1), 87–95. [Google Scholar] [CrossRef]
- Kaplan-Rakowski, R., Grotewold, K., Hartwick, P., & Papin, K. (2023). Generative AI and teachers’ perspectives on its implementation in education. Journal of Interactive Learning Research, 34(2), 313–338. [Google Scholar]
- Ke, F., Xie, K., & Xie, Y. (2016). Game-based learning engagement: A theory-and data-driven exploration. British Journal of Educational Technology, 47(6), 1183–1201. [Google Scholar] [CrossRef]
- Kim, J., Merrill, K., Xu, K., & Sellnow, D. D. (2020). My teacher is a machine: Understanding students’ perceptions of AI teaching assistants in online education. International Journal of Human–Computer Interaction, 36(20), 1902–1911. [Google Scholar] [CrossRef]
- Kong, S.-C., Cheung, M.-Y. W., & Tsang, O. (2024). Developing an artificial intelligence literacy framework: Evaluation of a literacy course for senior secondary students using a project-based learning approach. Computers and Education: Artificial Intelligence, 6, 100214. [Google Scholar] [CrossRef]
- Kshirsagar, P. R., Jagannadham, D. B. V., Alqahtani, H., Noorulhasan Naveed, Q., Islam, S., Thangamani, M., & Dejene, M. (2022). Human intelligence analysis through perception of AI in teaching and learning. Computational Intelligence and Neuroscience, 2022(1), 9160727. [Google Scholar] [CrossRef] [PubMed]
- Lee, I., Ali, S., Zhang, H., DiPaola, D., & Breazeal, C. (2021, March 13–20). Developing middle school students’ AI literacy. 52nd ACM Technical Symposium on Computer Science Education (pp. 191–197), Virtual. [Google Scholar]
- Lee, J., Park, T., & Davis, R. O. (2022). What affects learner engagement in flipped learning and what predicts its outcomes? British Journal of Educational Technology, 53(2), 211–228. [Google Scholar] [CrossRef]
- Li, J. M., Wu, T. J., Wu, Y. J., & Goh, M. (2023). Systematic literature review of human–machine collaboration in organizations using bibliometric analysis. Management Decision, 61(10), 2920–2944. [Google Scholar] [CrossRef]
- Li, J. M., Zhang, L. X., & Mao, M. Y. (2025). How does human-AI interaction affect employees’ workplace procrastination? Technological Forecasting and Social Change, 212, 123951. [Google Scholar] [CrossRef]
- Li, J. M., Zhang, R. X., Wu, T. J., & Mao, M. (2024). How does work autonomy in human-robot collaboration affect hotel employees’ work and health outcomes? Role of job insecurity and person-job fit. International Journal of Hospitality Management, 117, 103654. [Google Scholar] [CrossRef]
- Long, D., & Magerko, B. (2020, April 25–30). What is AI literacy? Competencies and design considerations. 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–16), Honolulu, HI, USA. [Google Scholar]
- Martin, F., & Borup, J. (2022). Online learner engagement: Conceptual definitions, research themes, and supportive practices. Educational Psychologist, 57(3), 162–177. [Google Scholar] [CrossRef]
- Medcof, J. W. (1996). The job characteristics of computing and non-computing work activities. Journal of Occupational and Organizational Psychology, 69(2), 199–212. [Google Scholar] [CrossRef]
- Mercer, S. (2019). Language learner engagement: Setting the scene. In Second handbook of English language teaching (pp. 643–660). Springer. [Google Scholar]
- Mertala, P., Fagerlund, J., & Calderon, O. (2022). Finnish 5th and 6th grade students’ pre-instructional conceptions of artificial intelligence (AI) and their implications for AI literacy education. Computers and Education: Artificial Intelligence, 3, 100095. [Google Scholar] [CrossRef]
- Nazaretsky, T., Ariely, M., Cukurova, M., & Alexandron, G. (2022). Teachers’ trust in AI-powered educational technology and a professional development program to improve it. British Journal of Educational Technology, 53(4), 914–931. [Google Scholar] [CrossRef]
- Ng, D. T. K., Lee, M., Tan, R. J. Y., Hu, X., Downie, J. S., & Chu, S. K. W. (2023). A review of AI teaching and learning from 2000 to 2020. Education and Information Technologies, 28(7), 8445–8501. [Google Scholar] [CrossRef]
- Ng, D. T. K., Leung, J. K. L., Chu, K. W. S., & Qiao, M. S. (2021). AI literacy: Definition, teaching, evaluation and ethical issues. Proceedings of the Association for Information Science and Technology, 58(1), 504–509. [Google Scholar] [CrossRef]
- Ng, D. T. K., Leung, J. K. L., Su, M. J., Yim, I. H. Y., Qiao, M. S., & Chu, S. K. W. (2022). AI education and AI literacy. In AI literacy in K-16 classrooms (pp. 9–19). Springer. [Google Scholar]
- Nkhoma, M., Sriratanaviriyakul, N., Pham Cong, H., & Khai Lam, T. (2014). Examining the mediating role of learning engagement, learning process and learning experience on the learning outcomes through localized real case studies. Education+ Training, 56(4), 287–302. [Google Scholar] [CrossRef]
- Noe, R. A., Tews, M. J., & McConnell Dachner, A. (2010). Learner engagement: A new perspective for enhancing our understanding of learner motivation and workplace learning. The Academy of Management Annals, 4(1), 279–315. [Google Scholar] [CrossRef]
- Ogunleye, B., Zakariyyah, K. I., Ajao, O., Olayinka, O., & Sharma, H. (2024). A systematic review of generative AI for teaching and learning practice. Education Sciences, 14(6), 636. [Google Scholar] [CrossRef]
- Park, Y.-S., & Yi, Y. (2021). The education model of liberal arts to improve the artificial intelligence literacy competency of undergraduate students. Journal of The Korean Association of Information Education, 25(2), 423–436. [Google Scholar] [CrossRef]
- Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40(3), 879–891. [Google Scholar] [CrossRef]
- Richardson, C., & Mishra, P. (2018). Learning environments that support student creativity: Developing the SCALE. Thinking skills and creativity, 27, 45–54. [Google Scholar] [CrossRef]
- Rong, Q., Lian, Q., & Tang, T. (2022). Research on the influence of AI and VR technology for students’ concentration and creativity. Frontiers in Psychology, 13, 767689. [Google Scholar] [CrossRef] [PubMed]
- Sengewald, J., Wilz, M., & Lackes, R. (2024, June 13–19). AI-assisted learning feedback: Should Gen-AI feedback be restricted to improve learning success? A pilot study in a SQL lecture. European Conference on Information Systems 2024 Proceedings, Paphos, Cyprus. [Google Scholar]
- Sengewald, T., & Tremmel, A. (2024, May 29–June 1). Teaching AI literacy for innovation: Work in progress. 2024 Computers and People Research Conference (pp. 1–4), Murfreesboro, TN, USA. [Google Scholar]
- Singh, S. V., & Hiran, K. K. (2022). The impact of AI on teaching and learning in higher education technology. Journal of Higher Education Theory & Practice, 12(13), 135–148. [Google Scholar]
- Snyder, H. T., Hammond, J. A., Grohman, M. G., & Katz-Buonincontro, J. (2019). Creativity measurement in undergraduate students from 1984–2013: A systematic review. Psychology of Aesthetics, Creativity, and the Arts, 13(2), 133. [Google Scholar] [CrossRef]
- Southworth, J., Migliaccio, K., Glover, J., Reed, D., McCarty, C., Brendemuhl, J., & Thomas, A. (2023). Developing a model for AI Across the curriculum: Transforming the higher education landscape via innovation in AI literacy. Computers and Education: Artificial Intelligence, 4, 100127. [Google Scholar] [CrossRef]
- Van Slyke, C., Johnson, R. D., & Sarabadani, J. (2023). Generative artificial intelligence in information systems education: Challenges, consequences, and responses. Communications of the Association for Information Systems, 53(1), 1–21. [Google Scholar] [CrossRef]
- Wang, B., Rau, P.-L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour & Information Technology, 42(9), 1324–1337. [Google Scholar]
- Wang, M., & Kang, M. (2006). Cybergogy for engaged learning: A framework for creating learner engagement through information and communication technology. In Engaged learning with emerging technologies (pp. 225–253). Springer. [Google Scholar]
- Westman, M., Hobfoll, S. E., Chen, S., Davidson, O. B., & Laski, S. (2004). Organizational stress through the lens of conservation of resources (COR) theory. In P. L. Perrewe, & D. C. Ganster (Eds.), Exploring interpersonal dynamics (Vol. 4, pp. 167–220). Research in occupational stress and well being. Emerald Group Publishing Limited. [Google Scholar]
- Wu, T. J., Li, J. M., Wang, Y. S., & Zhang, R. X. (2023). The dualistic model of passion and the service quality of five-star hotel employees during the COVID-19 pandemic. International Journal of Hospitality Management, 113, 103519. [Google Scholar] [CrossRef] [PubMed]
- Wu, T. J., Liang, Y., & Wang, Y. (2024). The buffering role of workplace mindfulness: How job insecurity of human-artificial intelligence collaboration impacts employees’ work–life-related outcomes. Journal of Business and Psychology, 39(6), 1395–1411. [Google Scholar] [CrossRef]
- Wu, T. J., Zhang, R. X., & Zhang, Z. (2025). Navigating the human-artificial intelligence collaboration landscape: Impact on quality of work life and work engagement. Journal of Hospitality and Tourism Management, 62, 276–283. [Google Scholar] [CrossRef]
- Zimmerman, M. (2018). Teaching AI: Exploring new frontiers for learning. International Society for Technology in Education. [Google Scholar]
Variable | Mean | Mode | SD | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
---|---|---|---|---|---|---|---|---|---|---|
1 Gender | 1.25 | 1 | 0.44 | 1 | ||||||
2 Age | 20.22 | 23 | 3.34 | 0.013 | 1 | |||||
3 AI Literacy | 3.64 | 3 | 1.63 | 0.28 | 0.35 | 1 | ||||
4 Learning Engagement | 4.14 | 4 | 1.48 | 0.46 | 0.23 | 0.28 ** | 1 | |||
5 Student Creativity | 2.31 | 3 | 0.86 | −0.23 | 0.13 * | 0.34 ** | 0.28 *** | 1 | ||
6 The usage of AI | 4.12 | 4 | 1.23 | 0.12 | 0.03 | 0.17 ** | 0.28 ** | 0.23 ** | 1 |
Model | χ2/df | CFI | TLI | RMSEA |
---|---|---|---|---|
Four-factor model | 2.22 | 0.96 | 0.94 | 0.06 |
Three-factor model | 6.97 | 0.74 | 0.66 | 0.12 |
Two-factor model | 10.23 | 0.72 | 0.51 | 0.16 |
One-factor model | 13.43 | 0.44 | 0.41 | 0.20 |
Variable | Effect | SE | Lower Limit of 95% Confidence Interval | Higher Limit of 95% Confidence Interval |
---|---|---|---|---|
Mean − 1 SD | 0.23 | 0.03 | 0.07 | 0.29 |
Mean + 1 SD | 0.15 | 0.33 | −0.14 | 0.19 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zhou, M.; Peng, S. The Usage of AI in Teaching and Students’ Creativity: The Mediating Role of Learning Engagement and the Moderating Role of AI Literacy. Behav. Sci. 2025, 15, 587. https://doi.org/10.3390/bs15050587
Zhou M, Peng S. The Usage of AI in Teaching and Students’ Creativity: The Mediating Role of Learning Engagement and the Moderating Role of AI Literacy. Behavioral Sciences. 2025; 15(5):587. https://doi.org/10.3390/bs15050587
Chicago/Turabian StyleZhou, Min, and Song Peng. 2025. "The Usage of AI in Teaching and Students’ Creativity: The Mediating Role of Learning Engagement and the Moderating Role of AI Literacy" Behavioral Sciences 15, no. 5: 587. https://doi.org/10.3390/bs15050587
APA StyleZhou, M., & Peng, S. (2025). The Usage of AI in Teaching and Students’ Creativity: The Mediating Role of Learning Engagement and the Moderating Role of AI Literacy. Behavioral Sciences, 15(5), 587. https://doi.org/10.3390/bs15050587