Higher Immersive Profiles Improve Learning Outcomes in Augmented Reality Learning Environments
Abstract
:1. Introduction
1.1. Immersion in Digital Environments
1.2. Augmented Reality in Education
1.3. Aim of the Study and Research Questions
2. Methodology
2.1. Participants
2.2. Learning Application
2.3. Instruments
2.3.1. Conceptual Assessment Test
- Sodium Chloride
- Sodium Oxide
- Potassium Chloride
- Hydrochloric Acid.”
2.3.2. The Augmented Reality Immersion Questionnaire (ARI)
2.4. Procedure
2.5. Data Analysis
3. Results
3.1. Research Question 1: Do Students Improve Their Conceptual Understanding of Basic Concepts of Chemistry after Using the AR-Based Learning Tool?
3.2. Research Question 2: What Is the Degree of Immersion That Students Achieve by Using AR Teaching Material?
3.3. Research Question 3: How Do Students’ Degrees of Immersion Relate to Learning Outcomes in Chemistry-Based Instruction Using an AR-Based Learning Tool?
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Schott, C.; Marshall, S. Virtual reality and situated experiential education: A conceptualization and exploratory trial. J. Comput. Assist. Learn. 2018, 34, 843–852. [Google Scholar] [CrossRef]
- Dede, C.J.; Jacobson, J.; Richards, J. Introduction: Virtual, Augmented, and Mixed Realities in Education. In Virtual, Augmented, and Mixed Realities in Education; Springer: Singapore, 2017; pp. 1–16. [Google Scholar] [CrossRef]
- Mills, N. Self-Efficacy in Second Language Acquisition. In Multiple Perspectives on the Self in Sla; Channel View Publications, Ltd.: Bristol, UK, 2014; Volume 73, pp. 6–22. [Google Scholar]
- Barab, S.; Dede, C. Games and immersive participatory simulations for science education: An emerging type of curricula. J. Sci. Educ. Technol. 2007, 16, 1–3. [Google Scholar] [CrossRef]
- Georgiou, Y.; Kyza, E.A. The development and validation of the ARI questionnaire: An instrument for measuring immersion in location-based augmented reality settings. Int. J. Hum.-Comput. Stud. 2017, 98, 24–37. [Google Scholar] [CrossRef]
- Rowe, J.P.; Shores, L.R.; Mott, B.W.; Lester, J.C. Integrating learning, problem solving, and engagement in narrative-centered learning environments. Int. J. Artif. Intell. Educ. 2011, 21, 115–133. [Google Scholar]
- Cheng, M.; She, H.; Annetta, L.A. Game immersion experience: Its hierarchical structure and impact on game-based science learning. J. Comput. Assist. Learn. 2015, 31, 232–253. [Google Scholar] [CrossRef]
- Hsu, M.; Cheng, M.T. Bio Detective: Student science learning, immersion experience, and problem-solving patterns. In Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014, Nara, Japan, 30 November–4 December 2014; pp. 171–178. [Google Scholar]
- Cabiria, J. Augmenting Engagement: Augmented Reality in Education; Emerald Group Publishing Limited: Bingley, UK, 2012. [Google Scholar]
- Cummings, J.J.; Bailenson, J.N. How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence. Media Psychol. 2016, 19, 272–309. [Google Scholar] [CrossRef]
- Dede, C. Immersive Interfaces for Engagement and Learning. Science 2009, 323, 66–69. [Google Scholar] [CrossRef] [Green Version]
- Slater, M.; Wilbur, S. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence-Teleoper. Virtual Environ. 1997, 6, 603–616. [Google Scholar] [CrossRef]
- Witmer, B.G.; Singer, M.J. Measuring presence in virtual environments: A presence questionnaire. Presence-Teleoper. Virtual Environ. 1998, 7, 225–240. [Google Scholar] [CrossRef]
- Jennett, C.; Cox, A.L.; Cairns, P.; Dhoparee, S.; Epps, A.; Tijs, T.; Walton, A. Measuring and defining the experience of immersion in games. Int. J. Hum.-Comput. Stud. 2008, 66, 641–661. [Google Scholar] [CrossRef]
- Brown, E.; Cairns, P. A grounded investigation of game immersion. In Proceedings of the Conference on Human Factors in Computing Systems, Vienna, Austria, 24–29 April 2004; pp. 1297–1300. [Google Scholar]
- Agarwal, R.; Karahanna, E. Time flies when you’re having fun: Cognitive absorption and beliefs about information technology usage. Mis Q. 2000, 24, 665–694. [Google Scholar] [CrossRef]
- Csikszentmihalyi, M. In Flow: The Psychology of Optimal Experience; Harper and Row: New York, NY, USA, 1990. [Google Scholar]
- Azuma, R.T. A survey of augmented reality. Presence Teleoper. Virtual Environ. 1997, 6, 355–385. [Google Scholar] [CrossRef]
- Mystakidis, S.; Christopoulos, A.; Pellas, N. A systematic mapping review of augmented reality applications to support STEM learning in higher education. Educ. Inf. Technol. 2022, 27, 1883–1927. [Google Scholar] [CrossRef]
- Me, F.; Hsu, Y. Mobile augmented-reality artifact creation as a component of mobile computer-supported collaborative learning. Internet High. Educ. 2015, 26, 33–41. [Google Scholar]
- Erbas, C.; Demirer, V. The effects of augmented reality on students’ academic achievement and motivation in a biology course. J. Comput. Assist. Learn. 2019, 35, 450–458. [Google Scholar] [CrossRef]
- Ibili, E.; Cat, M.; Resnyansky, D.; Sahin, S.; Billinghurst, M. An assessment of geometry teaching supported with augmented reality teaching materials to enhance students’ 3D geometry thinking skills. Int. J. Math. Educ. Sci. Technol. 2020, 51, 224–246. [Google Scholar] [CrossRef]
- Ibáñez, M.B.; Di-Serio, A.; Villarán-Molina, D.; Delgado-Kloos, C. Augmented Reality-Based Simulators as Discovery Learning Tools: An Empirical Study; IEEE Transactions on Education: Gainesville, FL, USA, 2015; Volume 58, pp. 208–213. [Google Scholar]
- Wojciechowski, R.; Cellary, W. Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Comput. Educ. 2016, 95, 353. [Google Scholar] [CrossRef]
- Manisha; Mantri, A. An Augmented Reality Application for Basic Mathematics: Teaching and Assessing Kids’ Learning Efficiency. In Proceedings of the 2019 5th International Conference on Computing, Communication, Control and Automation (Iccubea), Pune, India, 19–21 September 2019. [Google Scholar]
- Chang, Y.; Chen, C.; Liao, C. Enhancing English-Learning Performance through a Simulation Classroom for EFL Students Using Augmented Reality-A Junior High School Case Study. Appl. Sci. 2020, 10, 7854. [Google Scholar] [CrossRef]
- Paliokas, I.; Patenidis, A.T.; Mitsopoulou, E.E.; Tsita, C.; Pehlivanides, G.; Karyati, E.; Tsafaras, S.; Stathopoulos, E.A.; Kokkalas, A.; Diplaris, S.; et al. A Gamified Augmented Reality Application for Digital Heritage and Tourism. Appl. Sci. 2020, 10, 7868. [Google Scholar] [CrossRef]
- Leue, M.C.; Jung, T.; Dieck, D. Google Glass Augmented Reality: Generic Learning Outcomes for Art Galleries. In Information and Communication Technologies in Tourism 20; Tussyadiah, I., Inversini, A., Eds.; Springer: Cham, Switzerland, 2015; pp. 463–476. [Google Scholar]
- Lee, M. Rediscovering Neighborhood History Through Augmented Reality. In Proceedings of the 2021 4th IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2021, Online, 15–17 November 2021; pp. 60–64. [Google Scholar]
- Chen, C.; Chou, Y.; Huang, C. An Augmented-Reality-Based Concept Map to Support Mobile Learning for Science. Asia-Pac. Educ. Res. 2016, 25, 567–578. [Google Scholar] [CrossRef]
- Kapp, S.; Thees, M.; Strzys, M.P.; Beil, F.; Kuhn, J.; Amiraslanov, O.; Javaheri, H.; Lukowicz, P.; Lauer, F.; Rheinlander, C.; et al. Augmenting Kirchhoff’s laws: Using augmented reality and smartglasses to enhance conceptual electrical experiments for high school students. Phys. Teach. 2019, 57, 52–53. [Google Scholar] [CrossRef]
- Thees, M.; Kapp, S.; Strzys, M.P.; Beil, F.; Lukowicz, P.; Kuhn, J. Effects of augmented reality on learning and cognitive load in university physics laboratory courses. Comput. Hum. Behav. 2020, 108, 106316. [Google Scholar] [CrossRef]
- Uppot, R.N.; Laguna, B.; McCarthy, C.J.; De Novi, G.; Phelps, A.; Siegel, E.; Courtier, J. Implementing Virtual and Augmented Reality Tools for Radiology Education and Training, Communication, and Clinical Care. Radiology 2019, 291, 570–580. [Google Scholar] [CrossRef] [PubMed]
- Ibáñez, M.B.; Uriarte Portillo, A.; Zatarain Cabada, R.; Barrón, M.L. Impact of augmented reality technology on academic achievement and motivation of students from public and private Mexican schools. A case study in a middle-school geometry course. Comput. Educ. 2020, 145, 103734. [Google Scholar] [CrossRef]
- Li, K.; Keller, J.M. Use of the ARCS model in education: A literature review. Comput. Educ. 2018, 122, 54–62. [Google Scholar] [CrossRef]
- Wen, Y. Augmented reality enhanced cognitive engagement: Designing classroom-based collaborative learning activities for young language learners. EtrD-Educ. Technol. Res. Dev. 2021, 69, 843–860. [Google Scholar] [CrossRef]
- Drljevic, N.; Boticki, I.; Wong, L. Investigating the different facets of student engagement during augmented reality use in primary school. Br. J. Educ. Technol. 2022, 1–28. Available online: https://bera-journals.onlinelibrary.wiley.com/doi/abs/10.1111/bjet.13197 (accessed on 28 March 2022). [CrossRef]
- Ibáñez, M.B.; Di Serio, A.; Villarán, D.; Delgado, C. Experimenting with electromagnetism using augmented reality: Impact on flow student experience and educational effectiveness. Comput. Educ. 2014, 71, 1–13. [Google Scholar] [CrossRef] [Green Version]
- Hou, H.; Lin, Y. The Development and Evaluation of an Educational Game Integrated with Augmented Reality and Virtual Laboratory for Chemistry Experiment Learning. In Proceedings of the 2017 6th Iiai International Congress on Advanced Applied Informatics (Iiai-Aai), Hamamatsu, Japan, 9–13 July 2017; pp. 1005–1006. [Google Scholar]
- Qin, Y. Attractiveness of game elements, presence, and enjoyment of mobile augmented reality games: The case of Pokemon Go. Telemat. Inf. 2021, 62, 101620. [Google Scholar] [CrossRef]
- Vrellis, I.; Delimitros, M.; Chalki, P.; Gaintatzis, P.; Bellou, I.; Mikropoulos, T.A. Seeing the unseen: User experience and technology acceptance in Augmented Reality science literacy. In Proceedings of the 2020 IEEE 20th International Conference on Advanced Learning Technologies (Icalt 2020), Tartu, Estonia, 6–9 July 2020; pp. 333–337. [Google Scholar]
- Salar, R.; Arici, F.; Caliklar, S.; Yilmaz, R.M. A Model for Augmented Reality Immersion Experiences of University Students Studying in Science Education. J. Sci. Educ. Technol. 2020, 29, 257–271. [Google Scholar] [CrossRef]
- Song, H.K.; Baek, E.; Choo, H.J. Try-on experience with augmented reality comforts your decision Focusing on the roles of immersion and psychological ownership. Inf. Technol. People 2020, 33, 1214–1234. [Google Scholar] [CrossRef]
- Georgiou, Y.; Kyza, E.A. Bridging narrative and locality in mobile-based augmented reality educational activities: Effects of semantic coupling on students’ immersion and learning gains. Int. J. Hum.-Comput. Stud. 2021, 145, 102546. [Google Scholar] [CrossRef]
- Han, J.; Kamber, M.; Pei, J. Data Mining: Concepts and Techniques, 3rd ed.; Morgan Kaufmann Publishers: Burlington, MA, USA, 2012; pp. 1–703. [Google Scholar]
- Banerjee, A.; Dave, R.N. Validating clusters using the Hopkins statistic. In Proceedings of the 2004 IEEE International Conference on Fuzzy Systems, Vols 1–3, Proceedings, Budapest, Hungary, 15–29 July 2004; pp. 149–153. [Google Scholar]
- Charrad, M.; Ghazzali, N.; Boiteau, V.; Niknafs, A. Nbclust: An R Package for Determining the Relevant Number of Clusters in a Data Set. J. Stat. Softw. 2014, 61, 1–36. [Google Scholar] [CrossRef] [Green Version]
- Byers, T.; Imms, W.; Hartnell-Young, E. Comparative analysis of the impact of traditional versus innovative learning environment on student attitudes and learning outcomes. Stud. Educ. Eval. 2018, 58, 167–177. [Google Scholar] [CrossRef]
- Jufrida, J.; Kurniawan, W.; Astalini, A.; Darmaji, D.; Kurniawan, D.A.; Maya, W.A. Students’ attitude and motivation in mathematical physics. Int. J. Eval. Res. Educ. 2019, 8, 401–408. [Google Scholar] [CrossRef]
- Huang, W. Investigating the Novelty Effect in Virtual Reality on Stem Learning. Ph.D. Thesis, Arizona State University, Tempe, AZ, USA, 2020. [Google Scholar]
- Ibáñez, M.B.; Delgado, C. Augmented reality for STEM learning: A systematic review. Comput. Educ. 2018, 123, 109–123. [Google Scholar] [CrossRef]
- Georgiou, Y.; Kyza, E.A. Relations between student motivation, immersion and learning outcomes in location-based augmented reality settings. Comput. Hum. Behav. 2018, 89, 173–181. [Google Scholar] [CrossRef]
- Ibáñez, M.B.; Di-Serio, A.; Villarán-Molina, D.; Delgado, C. Support for Augmented Reality Simulation Systems: The Effects of Scaffolding on Learning Outcomes and Behavior Patterns; IEEE Transactions on Learning Technologies: Gainesville, FL, USA, 2016; Volume 9, pp. 46–56. [Google Scholar]
- Wahyu, Y.; Suastra, I.W.; Sadia, I.W.; Suarni, N.K. The Effectiveness of Mobile Augmented Reality Assisted STEM-Based Learning on Scientific Literacy and Students’ Achievement. Int. J. Instr. 2020, 13, 343–356. [Google Scholar] [CrossRef]
- Krueger, J.M.; Bodemer, D. Application and Investigation of Multimedia Design Principles in Augmented Reality Learning Environments. Information 2022, 13, 74. [Google Scholar] [CrossRef]
Mean | SD | |
---|---|---|
Pretest | 6.50 | 1.80 |
Posttest | 7.67 | 1.58 |
Factor | Mean | SD |
---|---|---|
Interest | 3.96 | 0.72 |
Usability | 2.95 | 0.56 |
Emotional attachment | 3.77 | 0.76 |
Focus of attention | 3.59 | 0.91 |
Presence | 3.57 | 0.83 |
Flow | 3.57 | 0.88 |
Item | Mean | SD | |
---|---|---|---|
I1 | I liked the activity because it was novel | 4.18 | 0.93 |
I2 | I wanted to spend time to participate in the activity | 3.90 | 0.91 |
I3 | The topic of the activity made me want to find out more about it | 3.62 | 1.05 |
I4 | I wanted to spend the time to complete the activity successfully | 3.79 | 0.98 |
I5 | I liked the type of the activity | 4.17 | 0.85 |
I6 | The AR application we employed captured my attention | 4.10 | 0.89 |
Item | Mean | SD | |
---|---|---|---|
E1 | I often felt suspense by the activity | 4.05 | 0.85 |
E2 | I was curious about how the activity would progress | 3.99 | 1.03 |
E3 | I was impatient about completing the activity successfully | 4.08 | 0.91 |
E4 | I was often excited since I felt as being part of the activity | 3.55 | 1.07 |
E5 | I often felt that I was really in charge of the activity | 3.18 | 1.17 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Uriarte-Portillo, A.; Ibáñez, M.-B.; Zataraín-Cabada, R.; Barrón-Estrada, M.-L. Higher Immersive Profiles Improve Learning Outcomes in Augmented Reality Learning Environments. Information 2022, 13, 218. https://doi.org/10.3390/info13050218
Uriarte-Portillo A, Ibáñez M-B, Zataraín-Cabada R, Barrón-Estrada M-L. Higher Immersive Profiles Improve Learning Outcomes in Augmented Reality Learning Environments. Information. 2022; 13(5):218. https://doi.org/10.3390/info13050218
Chicago/Turabian StyleUriarte-Portillo, Aldo, María-Blanca Ibáñez, Ramón Zataraín-Cabada, and María-Lucía Barrón-Estrada. 2022. "Higher Immersive Profiles Improve Learning Outcomes in Augmented Reality Learning Environments" Information 13, no. 5: 218. https://doi.org/10.3390/info13050218