Advancing STEM Education for Sustainability: The Impact of Graphical Knowledge Visualization and User Experience on Continuance Intention in Mixed-Reality Environments
Abstract
:1. Introduction
2. Theoretical Background and Hypothesis Development
2.1. The Stimulus–Organism–Response Framework in Immersive Learning Technologies
2.2. Graphical Visualization of Knowledge Structure in MRLEs
2.2.1. KV-Based MR Learning System Features
2.2.2. KV-Based MR Learning System Usability
2.3. User Experience
2.4. STEM Continuance Intention in Immersive Learning Environments
2.5. Research Model and Hypotheses
3. Methods
3.1. Design of KV-Based MR Learning System
- Concept node highlighting. The specific nodes situated at the outermost level of the multi-hierarchical concept map are initially locked, necessitating learners unlock them by engaging in hands-on experiments within the MR learning space that seamlessly integrates virtual and physical elements, as illustrated in Figure 3.
- MR Scenario Entering. Specifically, each locked concept node in the concept map corresponds to a dedicated main MR learning scenario. By clicking on a concept node, learners enter the associated main MR environment, which consists of 2 to 4 sub-scenarios. These MR sub-scenarios are designed based on the principles of the controlled variable method. For instance, by altering a specific variable, such as the roughness of a tabletop, students manipulate virtual elements to change the motion of an object, observe the resulting phenomena, and thereby explore the physical concept, as illustrated in Figure 4.
- MR interaction and knowledge check. In each sub-scenario, as illustrated in Figure 5:
- Learners use a virtual joystick (bottom left of the screen) to apply virtual forces to an object on a mixed-reality surface.
- Visualized force vectors, representing all individual forces acting on the object (e.g., friction, gravity, normal force, applied force), are superimposed on the virtual objects to enable intuitive observation of dynamic interactions. The system status panel, located at the top left of the screen, provides real-time feedback on object displacement and velocity.
- Learners observe these dynamics and complete a knowledge-check test (top right). If the answer is incorrect, they must repeatedly experiment until the correct conceptual understanding is formed and the test is passed.
- Concept node unlocking. Once all knowledge-check tests associated with a concept node are successfully completed, the node is unlocked on the concept map, visually confirming the learner’s mastery, as illustrated in Figure 6.
- Science. The MR system is centered on the study of frictional physics, aligning directly with the science dimension of STEM education. Learners are required to understand fundamental physical principles related to concept nodes through the immersive presence and authentic visualization of abstract concepts within the MR environment, fostering a spirit of scientific inquiry.
- Technology. The MR technology provides learners with an innovative and immersive learning experience in high school subjects. By leveraging the capabilities of computer vision, computer graphics, and multi-sensor fusion technologies, the system ensures precise registration and dynamic tracking, allowing for real-time spatial awareness and seamless interaction with virtual elements.
- Engineering. In order to unlock the outermost concept node, learners must complete knowledge quizzes that relate the learned concepts to real-life applications of friction, especially the impact of friction in engineering applications. The knowledge-check-based design facilitates active learning by reinforcing the connection between theoretical concepts and practical applications, ensuring that learners can integrate and apply their understanding of friction in real-world engineering contexts [94].
- Mathematics. The motion and force states of the virtual objects in this MR system are dynamically calculated using mathematical formulas from physics. This real-time visualization, grounded in mathematical principles, helps learners intuitively grasp friction and force concepts by explicitly visualizing the forces acting on objects, providing a clearer and more interactive learning experience, as shown in Figure 5.
3.2. Population and Experiment Procedure
3.3. Instruments and Measures
4. Results
4.1. Common Method Bias
4.2. Measurement Model Assessment
4.3. Structural Model Assessment
4.4. Mediation Analysis
5. Discussion
5.1. Theoretical Implication
5.2. Practical Implication
5.3. Limitations and Directions for Future Research
6. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Loyalka, P.; Liu, O.L.; Li, G.; Kardanova, E.; Chirikov, I.; Hu, S.; Yu, N.; Ma, L.; Guo, F.; Beteille, T.; et al. Skill levels and gains in university STEM education in China, India, Russia and the United States. Nat. Hum. Behav. 2021, 5, 892–904. [Google Scholar] [CrossRef] [PubMed]
- Ma, Y. Reconceptualizing STEM Education in China as Praxis: A Curriculum Turn. Sustainability 2021, 13, 4961. [Google Scholar] [CrossRef]
- Sharma, J.; Yarlagadda, P.K.D.V. Perspectives of ‘STEM education and policies’ for the development of a skilled workforce in Australia and India. Int. J. Sci. Educ. 2018, 40, 1999–2022. [Google Scholar] [CrossRef]
- Beheshti, M.; Shah, S.A.; Zhang, H.; Barnett, M.; Hira, A. Affordances of Technology for Sustainability-Oriented K–12 Informal Engineering Education. Sustainability 2024, 16, 6719. [Google Scholar] [CrossRef]
- Cheng, K.H.; Tsai, C.C. Affordances of Augmented Reality in Science Learning: Suggestions for Future Research. J. Sci. Educ. Technol. 2013, 22, 449–462. [Google Scholar] [CrossRef]
- Devlin, T.J.; Feldhaus, C.R.; Bentrem, K.M. The Evolving Classroom: A Study of Traditional and Technology-Based Instruction in a STEM Classroom. J. Technol. Educ. 2013, 25. [Google Scholar] [CrossRef]
- Zhu, Y.; Lou, Z.; Ge, T.; Wu, T.; Wang, Y.; Tan, T.; Wang, J. An Interactive Mixed Reality Platform for Inquiry-Based Education. In Proceedings of the 2021 IEEE 7th International Conference on Virtual Reality (ICVR), Foshan, China, 20–22 May 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 324–331. [Google Scholar] [CrossRef]
- Halawa, S.; Lin, T.C.; Hsu, Y.S. Exploring instructional design in K-12 STEM education: A systematic literature review. Int. J. Stem Educ. 2024, 11, 43. [Google Scholar] [CrossRef]
- Fernández-Vázquez, D.; Navarro-López, V.; Cano-de-la Cuerda, R.; Palacios-Ceña, D.; Espada, M.; Bores-García, D.; Delfa-de-la Morena, J.M.; Romero-Parra, N. Influence of Virtual Reality and Gamification Combined with Practice Teaching Style in Physical Education on Motor Skills and Students’ Perceived Effort: A Mixed-Method Intervention Study. Sustainability 2024, 16, 1584. [Google Scholar] [CrossRef]
- Wu, C.H.; Liu, C.H.; Huang, Y.M. The exploration of continuous learning intention in STEAM education through attitude, motivation, and cognitive load. Int. J. STEM Educ. 2022, 9, 35. [Google Scholar] [CrossRef]
- Messadi, T.; Newman, W.E.; Braham, A.; Nutter, D. Cyber-Innovation in the STEM Classroom, a Mixed Reality Approach. Creat. Educ. 2018, 9, 2385–2393. [Google Scholar] [CrossRef]
- Doswell, J.; Mosley, P. Robotics In Mixed-Reality Training Simulations: Augmenting STEM Learning. In Proceedings of the Sixth IEEE International Conference on Advanced Learning Technologies (ICALT’06), Washington, DC, USA, 5–7 July 2006; IEEE: Piscataway, NJ, USA, 2006; pp. 864–868. [Google Scholar] [CrossRef]
- Pan, Z.; Cheok, A.D.; Yang, H.; Zhu, J.; Shi, J. Virtual reality and mixed reality for virtual learning environments. Comput. Graph. 2006, 30, 20–28. [Google Scholar] [CrossRef]
- Maas, M.J.; Hughes, J.M. Virtual, augmented and mixed reality in K–12 education: A review of the literature. Technol. Pedagog. Educ. 2020, 29, 231–249. [Google Scholar] [CrossRef]
- Chen, S.S.C.; Duh, H. Interface of mixed reality: From the past to the future. CCF Trans. Pervasive Comput. Interact. 2019, 1, 69–87. [Google Scholar] [CrossRef]
- Ferguson, C.; van Oostendorp, H. Lost in Learning: Hypertext Navigational Efficiency Measures Are Valid for Predicting Learning in Virtual Reality Educational Games. Front. Psychol. 2020, 11, 578154. [Google Scholar] [CrossRef]
- Kirschner, P.A.; Sweller, J.; Clark, R.E. Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching. Educ. Psychol. 2006, 41, 75–86. [Google Scholar] [CrossRef]
- Wang, M.; Peng, J.; Cheng, B.; Zhou, H.; Liu, J. Knowledge visualization for self-regulated learning. Educ. Technol. Soc. 2011, 14, 28–42. [Google Scholar]
- Hardman, D.; Edwards, L. Lost in hyperspace: Cognitive mapping and navigation in a hypertext environment. In Hypertext: Theory into Practice; GBR: Andhra Pradesh, India, 1989; pp. 105–145. [Google Scholar]
- Weng, N.G.; Sing, A.L.L. Perception and Skill Learning for Augmented and Virtual Reality Learning Environments. In Proceedings of the Computational Science and Technology, Kota Kinabalu, Malaysia, 29–30 August 2018; Alfred, R., Lim, Y., Ibrahim, A.A.A., Anthony, P., Eds.; Springer: Singapore, 2019; pp. 391–400. [Google Scholar] [CrossRef]
- Zhao, J.; Bhatt, C.; Cooper, M.; Shamma, D.A. Flexible Learning with Semantic Visual Exploration and Sequence-Based Recommendation of MOOC Videos. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI’18, Montreal, QC, Canada, 21–26 April 2018; ACM: New York, NY, USA, 2018; pp. 1–13. [Google Scholar] [CrossRef]
- Eppler, M.J. A Comparison between Concept Maps, Mind Maps, Conceptual Diagrams, and Visual Metaphors as Complementary Tools for Knowledge Construction and Sharing. Inf. Vis. 2006, 5, 202–210. [Google Scholar] [CrossRef]
- Bertschi, S.; Bresciani, S.; Crawford, T.; Goebel, R.; Kienreich, W.; Lindner, M.; Sabol, V.; Moere, A.V. What is Knowledge Visualization? Perspectives on an Emerging Discipline. In Proceedings of the 2011 15th International Conference on Information Visualisation, London, UK, 13–15 July 2011; IEEE: Piscataway, NJ, USA, 2011; pp. 329–336. [Google Scholar] [CrossRef]
- Sutcliffe, A. User-Centred Requirements Engineering; Springer: London, UK, 2002. [Google Scholar] [CrossRef]
- Minge, M.; Thüring, M. Hedonic and pragmatic halo effects at early stages of User Experience. Int. J.-Hum.-Comput. Stud. 2018, 109, 13–25. [Google Scholar] [CrossRef]
- de Bruin, A.B.; van Merriënboer, J.J. Bridging Cognitive Load and Self-Regulated Learning Research: A complementary approach to contemporary issues in educational research. Learn. Instr. 2017, 51, 1–9. [Google Scholar] [CrossRef]
- Al Khatib, S.A. Meta-cognitive self-regulated learning and motivational beliefs as predictors of college students’ performance. Int. J. Res. Educ. 2010, 27, 57–71. [Google Scholar]
- Raptis, G.E.; Fidas, C.; Avouris, N. Effects of mixed-reality on players’ behaviour and immersion in a cultural tourism game: A cognitive processing perspective. Int. J.-Hum.-Comput. Stud. 2018, 114, 69–79. [Google Scholar] [CrossRef]
- Makransky, G.; Petersen, G.B. The Cognitive Affective Model of Immersive Learning (CAMIL): A Theoretical Research-Based Model of Learning in Immersive Virtual Reality. Educ. Psychol. Rev. 2021, 33, 937–958. [Google Scholar] [CrossRef]
- Makransky, G.; Lilleholt, L. A structural equation modeling investigation of the emotional value of immersive virtual reality in education. Educ. Technol. Res. Dev. 2018, 66, 1141–1164. [Google Scholar] [CrossRef]
- Mekler, E.D.; Hornbæk, K. Momentary Pleasure or Lasting Meaning?: Distinguishing Eudaimonic and Hedonic User Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI’16, San Jose, CA, USA, 7–12 May 2016; ACM: New York, NY, USA, 2016; pp. 4509–4520. [Google Scholar] [CrossRef]
- Wei, L.; Xiang, L. The Practical Research of Mixed Reality for Photographic Darkroom Education. In Proceedings of the HCI International 2022—Late Breaking Papers: Interacting with Extended Reality and Artificial Intelligence, Virtual, 26 June–1 July 2022; Springer Nature: Cham, Switzerland, 2022; pp. 98–113. [Google Scholar] [CrossRef]
- Song, Y.; Yang, C.; Gai, W.; Bian, Y.; Liu, J. A new storytelling genre: Combining handicraft elements and storytelling via mixed reality technology. Vis. Comput. 2020, 36, 2079–2090. [Google Scholar] [CrossRef]
- Bosché, F.; Abdel-Wahab, M.; Carozza, L. Towards a Mixed Reality System for Construction Trade Training. J. Comput. Civ. Eng. 2016, 30, 04015016. [Google Scholar] [CrossRef]
- Volkow, S.W.; Howland, A.C. The Case for Mixed Reality to Improve Performance. Perform. Improv. 2018, 57, 29–37. [Google Scholar] [CrossRef]
- Verpoorten, D.; Castaigne, J.L.; Westera, W.; Specht, M. A quest for meta-learning gains in a physics serious game. Educ. Inf. Technol. 2012, 19, 361–374. [Google Scholar] [CrossRef]
- Mehrabian, A. An Approach to Environmental Psychology; Massachusetts Institute of Technology: Cambridge, MA, USA, 1974. [Google Scholar]
- Whiting, A.; Ritz, W.; Hain, J.S. Exploring the Effects on Students from Converting On-Campus Classes to Online due to the COVID-19 Pandemic. J. Adv. Mark. Educ. 2021, 29, 2546. [Google Scholar]
- Zhai, X.; Wang, M.; Ghani, U. The SOR (stimulus-organism-response) paradigm in online learning: An empirical study of students’ knowledge hiding perceptions. Interact. Learn. Environ. 2019, 28, 586–601. [Google Scholar] [CrossRef]
- Shao, Z.; Chen, K. Understanding individuals’ engagement and continuance intention of MOOCs: The effect of interactivity and the role of gender. Internet Res. 2020, 31, 1262–1289. [Google Scholar] [CrossRef]
- Zhao, Y.; Wang, A.; Sun, Y. Technological environment, virtual experience, and MOOC continuance: A stimulus–organism–response perspective. Comput. Educ. 2020, 144, 103721. [Google Scholar] [CrossRef]
- Goi, M.T.; Kalidas, V.; Yunus, N. Mediating roles of emotion and experience in the stimulus-organism-response framework in higher education institutions. J. Mark. High. Educ. 2018, 28, 90–112. [Google Scholar] [CrossRef]
- Nagoya, R.; Bernarto, I.; Antonio, F.; Pramono, R.; Wanasida, A.S.; Purwanto, A. Exploring intention to enroll university using an extended stimulus-organism-response model. Acad. Strateg. Manag. J. 2021, 20, 1–12. [Google Scholar]
- Hsiao, C.H.; Tang, K.Y. Who captures whom—Pokémon or tourists? A perspective of the Stimulus-Organism-Response model. Int. J. Inf. Manag. 2021, 61, 102312. [Google Scholar] [CrossRef]
- Triantoro, T.; Gopal, R.; Benbunan-Fich, R.; Lang, G. Would you like to play? A comparison of a gamified survey with a traditional online survey method. Int. J. Inf. Manag. 2019, 49, 242–252. [Google Scholar] [CrossRef]
- Mollen, A.; Wilson, H. Engagement, telepresence and interactivity in online consumer experience: Reconciling scholastic and managerial perspectives. J. Bus. Res. 2010, 63, 919–925. [Google Scholar] [CrossRef]
- Zheng, X.; Men, J.; Yang, F.; Gong, X. Understanding impulse buying in mobile commerce: An investigation into hedonic and utilitarian browsing. Int. J. Inf. Manag. 2019, 48, 151–160. [Google Scholar] [CrossRef]
- Fang, Y.H. Beyond the Credibility of Electronic Word of Mouth: Exploring eWOM Adoption on Social Networking Sites from Affective and Curiosity Perspectives. Int. J. Electron. Commer. 2014, 18, 67–102. [Google Scholar] [CrossRef]
- Luo, J.; Yu, S. Implementing a key-competence-based subject knowledge learning tool in Chinese middle schools: The direct and sustained effects. Interact. Learn. Environ. 2024, 32, 1348–1367. [Google Scholar] [CrossRef]
- Vieira, C.; Parsons, P.; Byrd, V. Visual learning analytics of educational data: A systematic literature review and research agenda. Comput. Educ. 2018, 122, 119–135. [Google Scholar] [CrossRef]
- Rozić, R.; Slišković, R.; Rosić, M. Artificial Intelligence for Knowledge Visualization: An Overview. In Proceedings of the Digital Transformation in Education and Artificial Intelligence Application, Mostar, Bosnia and Herzegovina, 18–20 April 2023; Springer Nature: Cham, Switzerland, 2023; pp. 118–131. [Google Scholar] [CrossRef]
- Novak, J.D.; Cañas, A.J. The Theory Underlying Concept Maps and How to Construct and Use Them; Technical Report; Florida Institute for Human and Machine Cognition: Pensacola, FL, USA, 2008. [Google Scholar]
- Wang, M.; Jacobson, M.J. Guest editorial-knowledge visualization for learning and knowledge management. J. Educ. Technol. Soc. 2011, 14, 1–3. [Google Scholar]
- Mystakidis, S.; Christopoulos, A.; Pellas, N. A systematic mapping review of augmented reality applications to support STEM learning in higher education. Educ. Inf. Technol. 2021, 27, 1883–1927. [Google Scholar] [CrossRef]
- Azuma, R.T. A Survey of Augmented Reality. In Presence Teleoperators Virtual Environ; ACM: New York, NY, USA, 1997; pp. 355–385. [Google Scholar]
- Mayer, R.E. Multimedia learning. In Psychology of Learning and Motivation; Elsevier: Amsterdam, The Netherlands, 2002; pp. 85–139. [Google Scholar] [CrossRef]
- Santos, M.E.C.; Chen, A.; Taketomi, T.; Yamamoto, G.; Miyazaki, J.; Kato, H. Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation. IEEE Trans. Learn. Technol. 2014, 7, 38–56. [Google Scholar] [CrossRef]
- Chen, W.; Shan, Y.; Wu, Y.; Yan, Z.; Li, X. Design and Evaluation of a Distance-Driven User Interface for Asynchronous Collaborative Exhibit Browsing in an Augmented Reality Museum. IEEE Access 2021, 9, 73948–73962. [Google Scholar] [CrossRef]
- Rokhsaritalemi, S.; Sadeghi-Niaraki, A.; Choi, S.M. A Review on Mixed Reality: Current Trends, Challenges and Prospects. Appl. Sci. 2020, 10, 636. [Google Scholar] [CrossRef]
- Chen, C.H.; Huang, C.Y.; Chou, Y.Y. Effects of augmented reality-based multidimensional concept maps on students’ learning achievement, motivation and acceptance. Univers. Access Inf. Soc. 2019, 18, 257–268. [Google Scholar] [CrossRef]
- Liu, Y.; Liu, Y.; Yue, K. Investigating the Factors that Influence Technology Acceptance of an Educational Game Integrating Mixed Reality and Concept Maps. In Proceedings of the 2021 International Conference on Advanced Learning Technologies (ICALT), Tartu, Estonia, 12–15 July 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 409–413. [Google Scholar] [CrossRef]
- Hao, K.C.; Lee, L.C. The development and evaluation of an educational game integrating augmented reality, ARCS model, and types of games for English experiment learning: An analysis of learning. Interact. Learn. Environ. 2019, 29, 1101–1114. [Google Scholar] [CrossRef]
- Rauschnabel, P.A.; Felix, R.; Hinsch, C.; Shahab, H.; Alt, F. What is XR? Towards a Framework for Augmented and Virtual Reality. Comput. Hum. Behav. 2022, 133, 107289. [Google Scholar] [CrossRef]
- Barnum, C.M. Usability Testing Essentials: Ready, Set ⋯ Test! 2nd ed.; Morgan Kaufmann: Burlington, MA, USA, 2020. [Google Scholar]
- Dino, M.J.S.; Dion, K.W.; Abadir, P.M.; Budhathoki, C.; Huang, C.M.; Ong, I.; Balbin, P.T.; Himmelfarb, C.R.; Davidson, P.M. Usability and acceptance as facilitators of behavioral intention to use a mixed reality exercise program in older adults: A structural equation model. Comput. Hum. Behav. Artif. Humans 2024, 2, 100071. [Google Scholar] [CrossRef]
- Davis, F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989, 13, 319. [Google Scholar] [CrossRef]
- Nilashi, M.; Abumalloh, R.A. i-TAM: A model for immersive technology acceptance. Educ. Inf. Technol. 2024, 30, 7689–7717. [Google Scholar] [CrossRef]
- Kara, M.; Çakıcı Alp, N. Assessing the adoption of the Yavuz Battleship application in the mixed reality environment using the technology acceptance model. Multimed. Syst. 2024, 30, 76. [Google Scholar] [CrossRef]
- Sepasgozar, S.M. Immersive on-the-job training module development and modeling users’ behavior using parametric multi-group analysis: A modified educational technology acceptance model. Technol. Soc. 2022, 68, 101921. [Google Scholar] [CrossRef]
- Whitelock-Wainwright, A.; Laan, N.; Wen, D.; Gašević, D. Exploring student information problem solving behaviour using fine-grained concept map and search tool data. Comput. Educ. 2020, 145, 103731. [Google Scholar] [CrossRef]
- Prasetya, D.D.; Pinandito, A.; Hayashi, Y.; Hirashima, T. Analysis of quality of knowledge structure and students’ perceptions in extension concept mapping. Res. Pract. Technol. Enhanc. Learn. 2022, 17, 14. [Google Scholar] [CrossRef]
- Prasetya, D.D.; Widiyaningtyas, T.; Hirashima, T. Interrelatedness patterns of knowledge representation in extension concept mapping. Res. Pract. Technol. Enhanc. Learn. 2025, 20, 9. [Google Scholar] [CrossRef]
- Lewis, J.R.; Sauro, J. Usability and User Experience: Design and Evaluation. In Handbook of Human Factors and Ergonomics; Wiley: Hoboken, NJ, USA, 2021; pp. 972–1015. [Google Scholar] [CrossRef]
- Getto, G.; Beecher, F. Toward a Model of UX Education: Training UX Designers Within the Academy. IEEE Trans. Prof. Commun. 2016, 59, 153–164. [Google Scholar] [CrossRef]
- Law, E.L.C.; van Schaik, P.; Roto, V. Attitudes towards user experience (UX) measurement. Int. J.-Hum.-Comput. Stud. 2014, 72, 526–541. [Google Scholar] [CrossRef]
- Kim, Y.M.; Rhiu, I.; Yun, M.H. A Systematic Review of a Virtual Reality System from the Perspective of User Experience. Int. J. Human–Comput. Interact. 2019, 36, 893–910. [Google Scholar] [CrossRef]
- Loureiro, S.M.C.; Gorgus, T.; Kaufmann, H.R. Antecedents and outcomes of online brand engagement: The role of brand love on enhancing electronic-word-of-mouth. Online Inf. Rev. 2017, 41, 985–1005. [Google Scholar] [CrossRef]
- Lee, C.H.; Chiang, H.S.; Hsiao, K.L. What drives stickiness in location-based AR games? An examination of flow and satisfaction. Telemat. Inform. 2018, 35, 1958–1970. [Google Scholar] [CrossRef]
- Lim, W.M.; Mohamed Jasim, K.; Das, M. Augmented and virtual reality in hotels: Impact on tourist satisfaction and intention to stay and return. Int. J. Hosp. Manag. 2024, 116, 103631. [Google Scholar] [CrossRef]
- Hornbæk, K.; Hertzum, M. Technology Acceptance and User Experience: A Review of the Experiential Component in HCI. ACM Trans.-Comput.-Hum. Interact. 2017, 24, 1–30. [Google Scholar] [CrossRef]
- Jo, H.; Park, D.H. Affordance, usefulness, enjoyment, and aesthetics in sustaining virtual reality engagement. Sci. Rep. 2023, 13, 15097. [Google Scholar] [CrossRef]
- Holdack, E.; Lurie-Stoyanov, K.; Fromme, H.F. The role of perceived enjoyment and perceived informativeness in assessing the acceptance of AR wearables. J. Retail. Consum. Serv. 2022, 65, 102259. [Google Scholar] [CrossRef]
- Hsu, C.L.; Lin, J.C.C. Effect of perceived value and social influences on mobile app stickiness and in-app purchase intention. Technol. Forecast. Soc. Chang. 2016, 108, 42–53. [Google Scholar] [CrossRef]
- Cheng, K.H. An epistemic curiosity-evoking model for immersive virtual reality narrative reading: User experience and the interaction among epistemic curiosity, transportation, and attitudinal learning. Comput. Educ. 2023, 201, 104814. [Google Scholar] [CrossRef]
- Álvarez, I.M.; Manero, B.; Romero-Hernández, A.; Cárdenas, M.; Masó, I. Virtual reality platform for teacher training on classroom climate management: Evaluating user acceptance. Virtual Real. 2024, 28, 78. [Google Scholar] [CrossRef]
- Liu, X.; Yang, D.; Hong, J.C.; Gu, J.; You, H. Relationships among students’ hands-on making self-efficacy, incremental belief of intelligence, help-seeking attitudes, and continuance intention to participate in a STEAM contest. Int. J. Technol. Des. Educ. 2024, 34, 1785–1803. [Google Scholar] [CrossRef]
- Choi, M.; Choi, Y.; Nosrati, S.; Hailu, T.B.; Kim, S.S. Psychological dynamics in the metaverse: Evaluating perceived values, attitude, and behavioral intention in metaverse events. J. Travel Tour. Mark. 2023, 40, 602–618. [Google Scholar] [CrossRef]
- Faqih, K.M. Factors influencing the behavioral intention to adopt a technological innovation from a developing country context: The case of mobile augmented reality games. Technol. Soc. 2022, 69, 101958. [Google Scholar] [CrossRef]
- Ajith, N.T.; Sridevi, P.; Mathew, L.S. Experience Matters: Exploring the Impact of User Experience on Stickiness and Loyalty in OTT Platforms. Int. J. Human–Comput. Interact. 2025, 1–15. [Google Scholar] [CrossRef]
- Gao, J.; Jia, W.; Yin, J. Exploring Smartphone User Interface Experience-Sharing Behavior: Design Perception and Motivation-Driven Mechanisms through the SOR Model. Sustainability 2024, 16, 6670. [Google Scholar] [CrossRef]
- Matovu, H.; Ungu, D.A.K.; Won, M.; Tsai, C.C.; Treagust, D.F.; Mocerino, M.; Tasker, R. Immersive virtual reality for science learning: Design, implementation, and evaluation. Stud. Sci. Educ. 2022, 59, 205–244. [Google Scholar] [CrossRef]
- Casuso-Holgado, M.J.; García-Muñoz, C.; Martín-Valero, R.; Lucena-Anton, D.; Moral-Munoz, J.A.; Cortés-Vega, M.D. Dropout rate in randomised controlled trials of balance and gait rehabilitation in multiple sclerosis: Is it expected to be different for virtual reality-based interventions? A systematic review with meta-analysis and meta-regression. Virt. Real. 2022, 27, 3451–3467. [Google Scholar] [CrossRef]
- Schwab, M.; Strobelt, H.; Tompkin, J.; Fredericks, C.; Huff, C.; Higgins, D.; Strezhnev, A.; Komisarchik, M.; King, G.; Pfister, H. booc.io: An Education System with Hierarchical Concept Maps and Dynamic Non-linear Learning Plans. IEEE Trans. Vis. Comput. Graph. 2017, 23, 571–580. [Google Scholar] [CrossRef]
- Chen, K.F.; Hwang, G.J.; Chen, M.R.A. Knowledge check-based concept mapping in digital games: Impacts on students’ learning performance and behaviors. Educ. Technol. Res. Dev. 2024, 72, 2297–2324. [Google Scholar] [CrossRef]
- Etikan, I.; Musa, S.A.; Alkassim, R.S. Comparison of Convenience Sampling and Purposive Sampling. Am. J. Theor. Appl. Stat. 2016, 5, 1–4. [Google Scholar] [CrossRef]
- Ng, P.M.; Chan, J.K.; Lit, K.K.; Cheung, C.T.; Lau, M.M.; Wan, C.; Choy, E.T. The impact of social media exposure and online peer networks on green purchase behavior. Comput. Hum. Behav. 2025, 165, 108517. [Google Scholar] [CrossRef]
- Venkatesh, V.; Bala, H. Technology Acceptance Model 3 and a Research Agenda on Interventions. Decis. Sci. 2008, 39, 273–315. [Google Scholar] [CrossRef]
- Ibili, E.; Resnyansky, D.; Billinghurst, M. Applying the technology acceptance model to understand maths teachers’ perceptions towards an augmented reality tutoring system. Educ. Inf. Technol. 2019, 24, 2653–2675. [Google Scholar] [CrossRef]
- McLean, G.; Wilson, A. Shopping in the digital world: Examining customer engagement through augmented reality mobile applications. Comput. Hum. Behav. 2019, 101, 210–224. [Google Scholar] [CrossRef]
- Huang, F.; Teo, T.; Sánchez-Prieto, J.C.; García-Peñalvo, F.J.; Olmos-Migueláñez, S. Cultural values and technology adoption: A model comparison with university teachers from China and Spain. Comput. Educ. 2019, 133, 69–81. [Google Scholar] [CrossRef]
- Hair Jr, J.F.; Hult, G.T.M.; Ringle, C.M.; Sarstedt, M.; Danks, N.P.; Ray, S. Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook; Springer Nature: Berlin/Heidelberg, Germany, 2021. [Google Scholar]
- Kock, N. Common Method Bias in PLS-SEM: A Full Collinearity Assessment Approach. Int. J. e-Collab. 2015, 11, 1–10. [Google Scholar] [CrossRef]
- Liang, H.; Saraf, N.; Hu, Q.; Xue, Y. Assimilation of Enterprise Systems: The Effect of Institutional Pressures and the Mediating Role of Top Management. MIS Q. 2007, 31, 59. [Google Scholar] [CrossRef]
- Hair, J.F.; Risher, J.J.; Sarstedt, M.; Ringle, C.M. When to use and how to report the results of PLS-SEM. Eur. Bus. Rev. 2019, 31, 2–24. [Google Scholar] [CrossRef]
- Benitez, J.; Henseler, J.; Castillo, A.; Schuberth, F. How to perform and report an impactful analysis using partial least squares: Guidelines for confirmatory and explanatory IS research. Inf. Manag. 2020, 57, 103168. [Google Scholar] [CrossRef]
- Yudhistyra, W.I.; Srinuan, C. Exploring the acceptance of mixed reality technology innovation among mining industry workers. Acta Psychol. 2024, 251, 104580. [Google Scholar] [CrossRef]
- Chopdar, P.K.; Balakrishnan, J. Consumers response towards mobile commerce applications: S-O-R approach. Int. J. Inf. Manag. 2020, 53, 102106. [Google Scholar] [CrossRef]
- Zhu, C.; Wu, D.C.W.; Hall, C.M.; Fong, L.H.N.; Koupaei, S.N.; Lin, F. Exploring non-immersive virtual reality experiences in tourism: Empirical evidence from a world heritage site. Int. J. Tour. Res. 2023, 25, 372–383. [Google Scholar] [CrossRef]
- Yang, T.; Lai, I.K.W.; Fan, Z.B.; Mo, Q.M. The impact of a 360° virtual tour on the reduction of psychological stress caused by COVID-19. Technol. Soc. 2021, 64, 101514. [Google Scholar] [CrossRef] [PubMed]
- Lee, J.; Kim, J.; Choi, J.Y. The adoption of virtual reality devices: The technology acceptance model integrating enjoyment, social interaction, and strength of the social ties. Telemat. Inform. 2019, 39, 37–48. [Google Scholar] [CrossRef]
- Kim, M.J.; Hall, C.M. A hedonic motivation model in virtual reality tourism: Comparing visitors and non-visitors. Int. J. Inf. Manag. 2019, 46, 236–249. [Google Scholar] [CrossRef]
- Salimon, M.G.; Yusoff, R.Z.B.; Mohd Mokhtar, S.S. The mediating role of hedonic motivation on the relationship between adoption of e-banking and its determinants. Int. J. Bank Mark. 2017, 35, 558–582. [Google Scholar] [CrossRef]
- Rūtelionė, A.; Bhutto, M.Y. Exploring the psychological benefits of green apparel and its influence on attitude, intention and behavior among Generation Z: A serial multiple mediation study applying the stimulus–organism–response model. J. Fash. Mark. Manag. Int. J. 2024, 28, 1074–1092. [Google Scholar] [CrossRef]
- Kim, M.J.; Lee, C.K.; Jung, T. Exploring Consumer Behavior in Virtual Reality Tourism Using an Extended Stimulus-Organism-Response Model. J. Travel Res. 2018, 59, 69–89. [Google Scholar] [CrossRef]
- Yang, H.P.; Fan, W.S.; Tsai, M.C. Applying Stimulus–Organism–Response Theory to Explore the Effects of Augmented Reality on Consumer Purchase Intention for Teenage Fashion Hair Dyes. Sustainability 2024, 16, 2537. [Google Scholar] [CrossRef]
- Gavrilova, T.; Alsufyev, A.; Grinberg, E. Knowledge visualization: Critique of the St. Gallen School and an analysis of contemporary trends. Bus. Inform. 2017, 2017, 7–19. [Google Scholar] [CrossRef]
- Troise, C. Exploring knowledge visualization in the digital age: An analysis of benefits and risks. Manag. Decis. 2021, 60, 1116–1131. [Google Scholar] [CrossRef]
- Davis, F.D.; Bagozzi, R.P.; Warshaw, P.R. User Acceptance of Computer Technology: A Comparison of Two Theoretical Models. Manag. Sci. 1989, 35, 982–1003. [Google Scholar] [CrossRef]
Scale and Items | Factor Loadings | Cronbach’s Alpha | CR | AVE | Outer VIF |
---|---|---|---|---|---|
MR features | 0.887 | 0.931 | 0.817 | ||
3D graphics | 0.856 | 0.814 | 0.890 | 0.729 | 1.953 |
TDG1 | 0.867 | 1.902 | |||
TDG2 | 0.859 | 1.814 | |||
TDG3 | 0.835 | 1.696 | |||
Interface design | 0.936 | 0.834 | 0.900 | 0.751 | 2.959 |
ID1 | 0.877 | 2.000 | |||
ID2 | 0.838 | 1.778 | |||
ID3 | 0.884 | 2.112 | |||
Operational functions | 0.916 | 0.778 | 0.872 | 0.695 | 2.520 |
OF1 | 0.842 | 1.898 | |||
OF2 | 0.757 | 1.384 | |||
OF3 | 0.897 | 2.163 | |||
MR usablity | 0.860 | 0.914 | 0.781 | ||
PUCM | 0.879 | 0.864 | 0.917 | 0.786 | 2.012 |
PUCM1 | 0.861 | 1.980 | |||
PUCM2 | 0.893 | 2.370 | |||
PUCM3 | 0.906 | 2.479 | |||
PEU | 0.875 | 0.843 | 0.895 | 0.680 | 2.171 |
PEU1 | 0.790 | 1.775 | |||
PEU2 | 0.849 | 2.115 | |||
PEU3 | 0.845 | 2.013 | |||
PEU4 | 0.815 | 1.877 | |||
PU | 0.905 | 0.882 | 0.919 | 0.740 | 2.490 |
PU1 | 0.846 | 2.257 | |||
PU2 | 0.907 | 3.088 | |||
PU3 | 0.882 | 2.618 | |||
PU4 | 0.802 | 1.847 | |||
SF | 0.736 | 0.848 | 0.652 | ||
SF1 | 0.840 | 1.487 | |||
SF2 | 0.699 | 1.381 | |||
SF3 | 0.872 | 1.781 | |||
PE | 0.859 | 0.914 | 0.780 | ||
PE1 | 0.870 | 2.123 | |||
PE2 | 0.880 | 2.039 | |||
PE3 | 0.899 | 2.462 | |||
AT | 0.878 | 0.925 | 0.804 | ||
AT1 | 0.900 | 2.374 | |||
AT2 | 0.890 | 2.316 | |||
AT3 | 0.901 | 2.595 | |||
CI | 0.819 | 0.892 | 0.734 | ||
CI1 | 0.804 | 1.586 | |||
CI2 | 0.881 | 2.083 | |||
CI3 | 0.884 | 2.049 |
Construct | TDG | ID | OF | PUCM | PEU | PU | SF | PE | AT | CI |
---|---|---|---|---|---|---|---|---|---|---|
MR features | ||||||||||
TDG | ||||||||||
ID | 0.831 | |||||||||
OF | 0.807 | 0.844 | ||||||||
MR Usability | ||||||||||
PUCM | 0.741 | 0.763 | 0.792 | |||||||
PEU | 0.728 | 0.862 | 0.850 | 0.734 | ||||||
PU | 0.757 | 0.718 | 0.768 | 0.800 | 0.825 | |||||
SF | 0.758 | 0.779 | 0.828 | 0.779 | 0.713 | 0.767 | ||||
PE | 0.746 | 0.707 | 0.710 | 0.745 | 0.652 | 0.712 | 0.799 | |||
AT | 0.748 | 0.669 | 0.682 | 0.764 | 0.695 | 0.768 | 0.823 | 0.769 | ||
CI | 0.665 | 0.651 | 0.670 | 0.693 | 0.594 | 0.700 | 0.867 | 0.827 | 0.833 |
Total Effects | Direct Effects | Hypothesis | Indirect Effect | Support | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
β | t-Value | p | β | t-Value | p | β | SE | t-Value | p | LLCI | ULCI | ||
0.614 *** | 8.997 | 0.000 | 0.007 | 0.062 | 0.951 | H4a: MRfeatures→SF→CI | 0.115 * | 0.054 | 2.117 | 0.034 | 0.023 | 0.230 | Yes |
0.614 *** | 8.997 | 0.000 | 0.007 | 0.062 | 0.951 | H4b: MRfeatures→PE→CI | 0.097 | 0.058 | 1.670 | 0.095 | 0.013 | 0.232 | No |
0.614 *** | 8.997 | 0.000 | 0.007 | 0.062 | 0.951 | H4c: MRfeatures→AT→CI | 0.053 | 0.043 | 1.219 | 0.223 | −0.011 | 0.158 | No |
0.425 ** | 3.131 | 0.002 | 0.019 | 0.159 | 0.874 | H5a: MRusability→SF→CI | 0.109 * | 0.054 | 2.033 | 0.042 | 0.027 | 0.236 | Yes |
0.425 ** | 3.131 | 0.002 | 0.019 | 0.159 | 0.874 | H5b: MRusability→PE→CI | 0.126 * | 0.064 | 1.967 | 0.049 | 0.030 | 0.276 | Yes |
0.425 ** | 3.131 | 0.002 | 0.019 | 0.159 | 0.874 | H5c: MRusability→AT→CI | 0.170 * | 0.071 | 2.395 | 0.017 | 0.061 | 0.337 | Yes |
Path | Path Coefficients | t-Value | p-Values | Decision | Inner VIF | |
---|---|---|---|---|---|---|
H1a: MR features→SF | 0.393 ** | 3.176 | 0.002 | Supported | 2.873 | 0.534 |
H1b: MR features→PE | 0.375 ** | 3.293 | 0.001 | Supported | 2.873 | 0.515 |
H1c: MR features→AT | 0.182 | 1.524 | 0.128 | Not supported | 2.873 | 0.549 |
H1d: MR features→MR usability | 0.807 *** | 24.149 | 0.000 | Supported | 1.000 | 0.652 |
H1e: MR features→CI | 0.007 | 0.062 | 0.951 | Not supported | 3.315 | 0.632 |
H2a: MR usability→SF | 0.328 ** | 2.842 | 0.005 | Supported | 2.873 | |
H2b: MR usability→PE | 0.426 *** | 3.796 | 0.000 | Supported | 2.873 | |
H2c: MR usability→AT | 0.586 *** | 5.712 | 0.000 | Supported | 2.873 | |
H2d: MR usability→CI | 0.019 | 0.159 | 0.874 | Not supported | 3.211 | |
H3a: SF→CI | 0.292 ** | 2.945 | 0.003 | Supported | 2.497 | |
H3b: PE→CI | 0.295 * | 2.472 | 0.013 | Supported | 2.347 | |
H3c: AT→CI | 0.290 ** | 2.885 | 0.004 | Supported | 2.647 | |
H4a: MR features→SF→CI | 0.115 * | 2.117 | 0.034 | Supported | ||
H4b: MR features→PE→CI | 0.097 | 1.670 | 0.095 | Not supported | ||
H4c: MR features→AT→CI | 0.053 | 1.219 | 0.223 | Not supported | ||
H5a: MR usability→SF→CI | 0.109 * | 2.033 | 0.042 | Supported | ||
H5b: MR usability→PE→CI | 0.126 * | 1.967 | 0.049 | Supported | ||
H5c: MR usability→AT→CI | 0.170 * | 2.395 | 0.017 | Supported |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Liu, Y.; Liu, Y. Advancing STEM Education for Sustainability: The Impact of Graphical Knowledge Visualization and User Experience on Continuance Intention in Mixed-Reality Environments. Sustainability 2025, 17, 3869. https://doi.org/10.3390/su17093869
Liu Y, Liu Y. Advancing STEM Education for Sustainability: The Impact of Graphical Knowledge Visualization and User Experience on Continuance Intention in Mixed-Reality Environments. Sustainability. 2025; 17(9):3869. https://doi.org/10.3390/su17093869
Chicago/Turabian StyleLiu, Yu, and Yue Liu. 2025. "Advancing STEM Education for Sustainability: The Impact of Graphical Knowledge Visualization and User Experience on Continuance Intention in Mixed-Reality Environments" Sustainability 17, no. 9: 3869. https://doi.org/10.3390/su17093869
APA StyleLiu, Y., & Liu, Y. (2025). Advancing STEM Education for Sustainability: The Impact of Graphical Knowledge Visualization and User Experience on Continuance Intention in Mixed-Reality Environments. Sustainability, 17(9), 3869. https://doi.org/10.3390/su17093869