Comparison of Tutorial Methods in Virtual Reality Games for a Better User Experience
Abstract
:1. Introduction
2. Literature Review
2.1. Virtual Reality (VR) Interaction
2.2. VR Tutorial
2.3. VR Educational Game Content
2.4. Simulator Sickness Questionnaire
3. Tutorial Development
3.1. Content Selection for Tutorials
3.2. Tutorial Design Progress
3.3. Tutorial Method Proposal
4. Usability Evaluation
4.1. Participants
4.2. Experimental Environment and Equipment
4.3. Experimental Procedure
4.4. Evaluation Factors
Factor | Item | Reference | |
---|---|---|---|
Presence | Spatial Presence | I felt present in the virtual space. | [41] |
Experienced Realism | How much of your experience in the virtual environment seemed consistent with your real-world experience? | [41] | |
Involvement | I was completely captivated by the virtual world. | [41] | |
Mapping | The method of interacting (playing) in a game environment was the same as the method used in real life. | [41] | |
Controls’ Learnability | Mental Load | The game’s controls were difficult to learn for me. | [46,47] |
Mental Effort | I needed to put lots of mental effort into learning the game’s controls. | [46,47] | |
Learnability | When I wanted to do something in the game, it was easy to remember the corresponding control. | [48] | |
Intrinsic Motivation | Enjoyment | I was very interested in VR games. | [42] |
Continual Intention to Use | I wanted to play VR games longer without stopping. | [43] | |
Player Experience | The realism of VR helps enhance my understanding. | [7] | |
Perceived Learning Effectiveness | I learned a lot of factual information from the VR game. | [45] |
4.5. Analysis Techniques
5. Results
5.1. VREQ
5.2. SSQ
6. Discussion
6.1. User Experience and Motion Sickness
6.2. Analysis of Qualitative Interview Results According to the Tutorial Method
6.3. Limitations
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Ahir, K.; Govani, K.; Gajera, R.; Shah, M. Application on Virtual Reality for Enhanced Education Learning, Military Training and Sports. Augment. Hum. Res. 2020, 5, 7. [Google Scholar] [CrossRef]
- Andersen, E.; O’Rourke, E.; Liu, Y.E.; Snider, R.; Lowdermilk, J.; Truong, D.; Cooper, S.; Popovic, Z. The impact of tutorials on games of varying complexity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). Association for Computing Machinery, New York, NY, USA, 5 May 2012; pp. 59–68. [Google Scholar]
- McGovern, E.; Moreira, G.; Luna-Nevarez, C. An application of virtual reality in education: Can this technology enhance the quality of students’ learning experience? J. Educ. Bus. 2020, 95, 490–496. [Google Scholar] [CrossRef]
- Al-Ansi, A.M.; Jaboob, M.; Garad, A.; Al-Ansi, A. Analyzing augmented reality (AR) and virtual reality (VR) recent development in education. Soc. Sci. Humanit. Open 2023, 8, 100532. [Google Scholar] [CrossRef]
- Frommel, J.; Fahlbusch, K.; Brich, J.; Weber, M. The effects of context-sensitive tutorials in virtual reality games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY’17), Association for Computing Machinery, New York, NY, USA, 15 October 2017; pp. 367–375. [Google Scholar]
- Ho, J.C. Practice in reality for virtual reality games: Making players familiar and confident with a game. In Proceedings of the IFIP Conference on Human-Computer Interaction (INTERACT 2017); Springer: Cham, Switzerland, 2017; pp. 147–162. [Google Scholar] [CrossRef]
- Lee, P.W.; Wang, H.Y.; Tung, Y.C.; Lin, J.W.; Valstar, A. TranSection: Hand-based interaction for playing a game within a virtual reality game. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 18 April 2015; pp. 73–76. [Google Scholar]
- Wang, A.; Thompson, M.; Roy, D.; Pan, K.; Perry, J.; Tan, P.; Eberhart, R.; Klopfer, E. Iterative user and expert feedback in the design of an educational virtual reality biology game. Interact. Learn. Environ. 2022, 30, 677–694. [Google Scholar] [CrossRef]
- Abuhammad, A.; Falah, J.; Alfalah, S.F.; Abu-Tarboush, M.; Tarawneh, R.T.; Drikakis, D.; Charissis, V. “MedChemVR”: A Virtual Reality Game to Enhance Medicinal Chemistry Education. Multimodal Technol. Interact. 2021, 5, 10. [Google Scholar] [CrossRef]
- Checa, D.; Bustillo, A. A review of immersive virtual reality serious games to enhance learning and training. Multimed. Tools Appl. 2020, 79, 5501–5527. [Google Scholar] [CrossRef]
- Borstad, A.L.; Crawfis, R.; Phillips, K.; Lowes, L.P.; Maung, D.; McPherson, R.; Siles, A.; Worthen-Chaudhari, L.; Gauthier, L.V. In-Home Delivery of Constraint-Induced Movement Therapy via Virtual Reality Gaming. J. Patient-Centered Res. Rev. 2018, 5, 6–17. [Google Scholar] [CrossRef] [PubMed]
- Velev, D.; Zlateva, P. Virtual Reality Challenges in Education and Training. Int. J. Learn. Teach. 2017, 3, 33–37. [Google Scholar] [CrossRef]
- Ferguson, C.; Broek, E.L.v.D.; van Oostendorp, H. On the role of interaction mode and story structure in virtual reality serious games. Comput. Educ. 2020, 143, 103671. [Google Scholar] [CrossRef]
- Shi, A.; Wang, Y.; Ding, N. The effect of game–based immersive virtual reality learning environment on learning outcomes: Designing an intrinsic integrated educational game for pre–class learning. Interact. Learn. Environ. 2022, 30, 721–734. [Google Scholar] [CrossRef]
- Drey, T.; Jansen, P.; Fischbach, F.; Frommel, J.; Rukzio, E. Towards progress assessment for adaptive hints in educational virtual reality games. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, New York, NY, USA, 25 April 2020; pp. 1–9. [Google Scholar] [CrossRef]
- McLaughlin, A.C.; Rogers, W.A.; Fisk, A.D. Using direct and indirect input devices: Attention demands and age-related differences. ACM Trans. Comput. Interact. 2009, 16, 1–15. [Google Scholar] [CrossRef] [PubMed]
- Yang, S.; Lim, C. How to use VR technology in educational games, prototyping. AJMAHS 2018, 8, 161–168. [Google Scholar]
- Tan, C.T.; Leong, T.W.; Shen, S.; Dubravs, C.; Si, C. Exploring gameplay experiences on the Oculus Rift. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, Association for Computing Machinery, New York, NY, USA, 5 October 2015; pp. 253–263. [Google Scholar] [CrossRef]
- Marougkas, A.; Troussas, C.; Krouska, A.; Sgouropoulou, C. How personalized and effective is immersive virtual reality in education? A systematic literature review for the last decade. Multimedia Tools Appl. 2024, 83, 18185–18233. [Google Scholar] [CrossRef]
- Kao, D.; Magana, A.J.; Mousas, C. Evaluating tutorial-based instructions for controllers in virtual reality games. In Proceedings of the ACM on Human-Computer Interaction, Association for Computing Machinery, New York, NY, USA, 6 October 2021; pp. 1–28. [Google Scholar] [CrossRef]
- Cao, S.; Liu, F. Learning to play: Understanding in-game tutorials with a pilot study on implicit tutorials. Heliyon 2022, 8, e11482. [Google Scholar] [CrossRef] [PubMed]
- Miguel-Alonso, I.; Checa, D.; Guillen-Sanz, H.; Bustillo, A. Evaluation of the novelty effect in immersive Virtual Reality learning experiences. Virtual Real. 2024, 28, 27. [Google Scholar] [CrossRef]
- Park, K.-B.; Lee, J.Y. Comparative Study on the Interface and Interaction for Manipulating 3D Virtual Objects in a Virtual Reality Environment. Korean J. Comput. Des. Eng. 2016, 21, 20–30. [Google Scholar] [CrossRef]
- Matthews, T.; Tian, F.; Dolby, T. Interaction design for paediatric emergency VR training. Virtual Real. Intell. Hardw. 2020, 2, 330–344. [Google Scholar] [CrossRef]
- Bozgeyikli, E.; Bozgeyikli, L.; Raij, A.; Katkoori, S.; Alqasemi, R.; Dubey, R. Virtual reality interaction techniques for individuals with autism spectrum disorder, Design considerations and preliminary results. In Proceedings of the International Conference on Human-Computer Interaction (HCI International 2016); Springer: Cham, Switzerland, 2016; pp. 127–137. [Google Scholar] [CrossRef]
- Krompiec, P.; Park, K. Enhanced Player Interaction Using Motion Controllers for First-Person Shooting Games in Virtual Reality. IEEE Access 2019, 7, 124548–124557. [Google Scholar] [CrossRef]
- Ros, M.; Debien, B.; Cyteval, C.; Molinari, N.; Gatto, F.; Lonjon, N. Applying an immersive tutorial in virtual reality to learning a new technique. Neurochirurgie 2020, 66, 212–218. [Google Scholar] [CrossRef] [PubMed]
- Fussell, S.G.; Derby, J.L.; Smith, J.K.; Shelstad, W.J.; Benedict, J.D.; Chaparro, B.S.; Thomas, R.; Dattel, A.R. Usability testing of a virtual reality tutorial. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting; SAGE Publications: Los Angeles, CA, USA, 2019; Volume 63, pp. 2303–2307. [Google Scholar] [CrossRef]
- Akman, E.; Çakır, R. The effect of educational virtual reality game on primary school students’ achievement and engagement in mathematics. Interact. Learn. Environ. 2020, 31, 1467–1484. [Google Scholar] [CrossRef]
- Makransky, G.; Borre-Gude, S.; Mayer, R.E. Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments. J. Comput. Assist. Learn. 2019, 35, 691–707. [Google Scholar] [CrossRef]
- Castronovo, F.; Nikolic, D.; Ventura, S.M.; Shroff, V.; Nguyen, A.; Dinh, N.H.; Gaedicke, C. Design and development of a virtual reality educational game for architectural and construction reviews. In Proceedings of the 2019 ASEE Annual Conference & Exposition, Tampa, FL, USA, 15 June 2019. [Google Scholar] [CrossRef]
- Jansen, P.; Fischbach, F. The Social Engineer: An immersive virtual reality educational game to raise social engineering awareness. In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play; Association for Computing Machinery: New York, NY, USA, 2020; pp. 59–63. [Google Scholar] [CrossRef]
- Kim, H.K.; Park, J.; Choi, Y.; Choe, M. Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. Appl. Ergon. 2018, 69, 66–73. [Google Scholar] [CrossRef] [PubMed]
- Kennedy, R.S.; Lane, N.E.; Berbaum, K.S.; Lilienthal, M.G. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. Int. J. Aviat. Psychol. 1993, 3, 203–220. [Google Scholar] [CrossRef]
- Chu, P. VR Design: Transitioning from a 2D to 3D Design Paradigm; Samsung Developer Connection: San Francisco, CA, USA, 2014. [Google Scholar]
- Fröjdman, S. User Experience Guidelines for Design of Virtual Reality Graphical User Interfaces Controlled by Head Orientation Input. Available online: https://www.diva-portal.org/smash/record.jsf?pid=diva2%3A939381&dswid=9471 (accessed on 15 March 2023).
- Alger, M. Visual Design Methods for Virtual Reality. Available online: https://www.semanticscholar.org/paper/Visual-Design-Methods-for-Virtual-Reality-Alger/94d9115ffc204c4a904312d6cecaf3032101009c (accessed on 15 March 2023).
- Purwar, S. Designing User Experience for Virtual Reality (VR) Applications. Available online: https://uxplanet.org/designing-user-experience-for-virtual-reality-vr-applications-fc8e4faadd96 (accessed on 24 February 2020).
- Maguire, M. An exploration of low-fidelity prototyping methods for augmented and virtual reality. In Proceedings of the International Conference on Human-Computer Interaction (HCII 2020), Copenhagen, Denmark, 19–24 July 2020; Springer: Cham, Switzerland, 2020; pp. 470–481. [Google Scholar] [CrossRef]
- Kamaruddin, N.; Sulaiman, S. Understanding interface design principles and elements guidelines: A content analysis of es-tablished scholars. In Proceedings of the Art and Design International Conference (AnDIC 2016); Springer: Singapore, 2018; pp. 89–100. [Google Scholar] [CrossRef]
- Schubert, T.; Friedmann, F.; Regenbrecht, H. The Experience of Presence: Factor Analytic Insights. Res. Q. Exerc. Sport 2001, 10, 266–281. [Google Scholar] [CrossRef]
- McAuley, E.; Duncan, T.; Tammen, V.V. Psychometric Properties of the Intrinsic Motivation Inventory in a Competitive Sport Setting: A Confirmatory Factor Analysis. Res. Q. Exerc. Sport 1989, 60, 48–58. [Google Scholar] [CrossRef] [PubMed]
- Zhao, L.; Lu, Y. Enhancing perceived interactivity through network externalities: An empirical study on micro-blogging service satisfaction and continuance intention. Decis. Support Syst. 2012, 53, 825–834. [Google Scholar] [CrossRef]
- Lee, E.A.-L.; Wong, K.W.; Fung, C.C. How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Comput. Educ. 2010, 55, 1424–1442. [Google Scholar] [CrossRef]
- Sholihin, M.; Sari, R.C.; Yuniarti, N.; Ilyana, S. A new way of teaching business ethics: The evaluation of virtual reality-based learning media. Int. J. Manag. Educ. 2020, 18, 100428. [Google Scholar] [CrossRef]
- Paas, F.G. Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. J. Educ. Psychol. 1992, 84, 429–434. [Google Scholar] [CrossRef]
- Sweller, J.; van Merrienboer, J.J.; Paas, F.G. Cognitive Architecture and Instructional Design. Educ. Psychol. Rev. 1998, 10, 251–296. [Google Scholar] [CrossRef]
- Ryan, R.M.; Rigby, C.S.; Przybylski, A. The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motiv. Emot. 2006, 30, 344–360. [Google Scholar] [CrossRef]
- National IT Industry Promotion Agency. VR/AR Device Production and Use Guidelines; National IT Industry Promotion Agency: Seoul, Republic of Korea, 2020. [Google Scholar]
Factor | Mean | SD | |
---|---|---|---|
Presence | Spatial Presence | 7.12 | 1.43 |
Experienced Realism | 5.46 | 1.85 | |
Involvement | 5.98 | 1.81 | |
Mapping | 5.94 | 2.43 | |
Controls’ Learnability | Mental Load | 6.37 | 2.30 |
Mental Effort | 6.23 | 2.54 | |
Learnability | 6.25 | 2.20 | |
Intrinsic Motivation | Enjoyment | 7.24 | 1.85 |
Continual Intention to Use | 7.41 | 2.04 | |
Player Experience | 6.75 | 2.10 | |
Perceived Learning Effectiveness | 7.08 | 1.83 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Lee, Y.; Kim, G.; Lee, K.H.; Park, J.; Kim, H.K. Comparison of Tutorial Methods in Virtual Reality Games for a Better User Experience. Appl. Sci. 2024, 14, 7141. https://doi.org/10.3390/app14167141
Lee Y, Kim G, Lee KH, Park J, Kim HK. Comparison of Tutorial Methods in Virtual Reality Games for a Better User Experience. Applied Sciences. 2024; 14(16):7141. https://doi.org/10.3390/app14167141
Chicago/Turabian StyleLee, Yuryeon, Guyeop Kim, Kang Hoon Lee, Jaehyun Park, and Hyun K. Kim. 2024. "Comparison of Tutorial Methods in Virtual Reality Games for a Better User Experience" Applied Sciences 14, no. 16: 7141. https://doi.org/10.3390/app14167141