An Expert Usability Evaluation of a Specialized Platform for Designing and Producing Online Educational Talking Books
Abstract
:1. Introduction
2. Development of the ETBP
2.1. The ETBP Overview
- (a)
- Microlearning: the principle that content learning time should not exceed 10 min [18].
- (b)
- E-learning theory: consideration of multimedia, segmentation, consistency, and learner control [19].
- (c)
- Cognitive apprenticeship: applying main methods such as modeling, coaching, and scaffolding [20].
- (d)
- Self-regulated learning: self-paced learning approach, time management, and self-evaluation [21].
- (e)
- Dual coding theory: user interface design using multiple channels [22].
- (f)
- Functional requirements: ETBP should be based on instructor/student authentication and consist of a set of learning tools required for online ETB learning.
- (g)
- Software requirement: ETBP should be able to support daily used applications and store learning log data and extend its functionality easily.
- (h)
- Performance requirements: ETBP should have a stress-free response for instructors/students.
2.2. ETBP Functions
- Platform Users function provides password-based login/logout and role-based authentication for instructors and students. It also provides user account management (create, edit, delete, display, and search) for instructors.
- ETB Designer function allows for students to design, edit, manage, and search online ETB scenarios, providing no-code templates based on the microlearning principle of 5 min or less of content and the segmentation principle of structuring scenarios with overviews, chapters, and pages.
- Audio Recorder function records audio materials based on the online ETB scenarios in conjunction with the h5p Audio Recorder website.
- ETB Creator function enables students to publish, edit, manage, and search for online ETBs. Based on multimedia principles, it provides no-code templates that combine images, graphics, and videos with text scenarios and audio materials. Based on the learner control principles, it can add video/audio controls, such as “play”, “stop”, and “repeat”, and navigation options, such as “next” and “back”.
- ETB Visual Learning function manages and delivers content for E-learning of online ETB development methods. It teaches students a model case of content creation based on the principles of cognitive apprenticeship. It comprises three pieces of content that reflect the principles of E-learning theory, textual and visual explanation, coherence, and learner control, as well as the principles described in the functions above.
- Quizzes function is a no-code template tool for creating, editing, and managing quizzes (true or false/choice) for student formative assessment. Based on the principle of self-regulated learning, students can check their understanding at any time.
- Reports function generates student performance reports, such as student activity logs and quiz scores from the ETBP database.
2.3. Importance of the ETBP for Instructors and Students in Higher Education
3. Methodology
3.1. Participants
3.2. Procedure
3.3. Instrument
4. Results and Discussion
4.1. Instructional Technology Experts’ Perceptions of the Proposed Platform
4.2. Summary of the Evaluation Experiment’s Result
4.3. Pedagogical Implications for ETBP Development
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Technology in Education—2023 GEM Report. 2023 GEM Report. 8 November 2023. Available online: https://gem-report-2023.unesco.org/technology-in-education/ (accessed on 22 May 2024).
- Ice, P.; Curtis, R.; Phillips, P.; Wells, J. Using asynchronous audio feedback to enhance teaching presence and students’ sense of community. J. Asynchronous Learn. Netw. 2007, 11, 3–25. [Google Scholar] [CrossRef]
- Saputra, D.B.; Arianto, M.A.; Saputra, E. “Will they listen to me?” Investigating the utilization of audio feedback in higher education. Stud. Engl. Lang. Educ. 2023, 10, 741–755. [Google Scholar] [CrossRef]
- Mudawi, G.H.H.; Mohmed, G.R. The Effectiveness of Course—Book Audio Files as Strategy to Improve Listening Skills of ‘EFL’ Learners. Int. J. ELT Linguist. Comp. Lit. 2016, 4, 7–27. [Google Scholar]
- Saka, Z. The Effectiveness of Audiobooks on Pronunciation Skills of EFL Learners at Different Proficiency Levels. 2015. Available online: https://repository.bilkent.edu.tr/items/42db8d47-2c44-449c-93bf-c96d4d890358 (accessed on 9 August 2024).
- Muzata, K.K. Distance Education Students’ Experiences of Learning from Audio Recorded Lectures, a Case of Mufulira and Nkrumah Colleges of Education. Int. J. Educ. Chron. 2013, 4, 97–109. [Google Scholar]
- Shahriza, A.Z.; Rahmatullah, B.; Majid, M.H.A.; Samuri, S.M.; Hidayanto, A.N.; Yas, Q.M.; Purnama, S. A systematic literature review on the use of podcasts in education among university students. ASEAN J. Teach. Learn. High. Educ. 2022, 14, 222–236. [Google Scholar] [CrossRef]
- García-Bullé, S. Five Educational Benefits of Audiobooks. Observatory—Institute for the Future of Education. 16 June 2022. Available online: https://observatory.tec.mx/edu-news/five-educational-benefits-of-audiobooks/ (accessed on 11 August 2024).
- Amirah, B.; Saidalvi, A. Talking story: eBooks to improve reading comprehension skills. In Embracing Change: Emancipating the Landscape of Research in Linguistics, Language and Literature, Proceedings of the International Conference of Research on Languasge Education 2023, Melaka, Malaysia, 13–14 March 2023; Academy of Language Studies: Melaka, Malaysia, 2023; pp. 259–271. Available online: https://ir.uitm.edu.my/id/eprint/82077/ (accessed on 6 February 2024).
- Alsamadani, H.A. The Effect of Talking Story Books on Saudi Young EFL Learners’ Reading Comprehension. Engl. Lang. Teach. 2017, 10, 204. [Google Scholar] [CrossRef]
- Fansury, A.H.; Lutfin, N.; Arsyad, S.N. Audio Books as Teaching Media to Blind Students in Learning EFL. Klasikal J. Educ. Lang. Teach. Sci. 2019, 1, 1–9. [Google Scholar] [CrossRef]
- Rahman, A.; Hajar, I. The effect of audiobook on reading comprehension of the eleventh grade students of SMA Negeri 2 Buru. ELT Worldw. J. Engl. Lang. Teach. 2020, 7, 104. [Google Scholar] [CrossRef]
- Çarkıt, C. Evaluation of audiobook listening experiences of 8th grade students. Educ. Policy Anal. Strateg. Res. 2020, 15, 146–163. [Google Scholar] [CrossRef]
- Singh, A.; Alexander, P.A. Audiobooks, Print, and Comprehension: What We Know and What We Need to Know. Educ. Psychol. Rev. 2022, 34, 677–715. [Google Scholar] [CrossRef]
- Hufron, A.; Trisanti, N. English digital talking books as media to teach narrative writing. ELT Forum J. Engl. Lang. Teach. 2016, 5, 1–8. [Google Scholar]
- Rusdianti, M. The Influence of Using Audiobooks on Student’s Listening Skill. Ph.D. Thsis, State Islamic University, South Tangerang, Indonesia, 2024. Available online: https://repository.uinjkt.ac.id/dspace/handle/123456789/76977 (accessed on 11 August 2024).
- Rahmat, M.S.; Fikri, I.F.; Habibi, A. Using Talking Books to Improve The Seventh Grade Students’speaking Achievement of Smp Muhammadiyah 11 Rogojampi. Taklimuna J. Educ. Teach. 2023, 2, 13–22. [Google Scholar]
- Nikkhoo, I.; Ahmadi, Z.; Akbari, M.; Imannezhad Sh Anvari Ardekani, S.; Lashgari, H. Microlearning for Today’s Students: A Rapid Review of Essentials and Considerations. Med. Educ. Bull. 2023, 4, 673–685. [Google Scholar] [CrossRef]
- E-Learning Theory (Mayer, Sweller, Moreno)—Learning Theories. 15 December 2015. Available online: https://learning-theories.com/e-learning-theory-mayer-sweller-moreno.html (accessed on 18 February 2024).
- Collins, A. Cognitive Apprenticeship. In The Cambridge Handbook of the Learning Sciences; Sawyer, R.K., Ed.; Cambridge University Press: Cambridge, UK, 2006; pp. 47–60. [Google Scholar]
- Zimmerman, B.J. Becoming a Self-Regulated Learner: An Overview. Theory Pract. 2002, 41, 64–70. [Google Scholar] [CrossRef]
- Loveless, B. Dual Coding Theory: The Complete Guide for Teachers. Education Corner. 14 April 2023. Available online: https://www.educationcorner.com/dual-coding-theory/ (accessed on 2 June 2024).
- Nielsen, J. How Many Test Users in A Usability Study? Nielsen Norman Group. 3 June 2012. Available online: https://www.nngroup.com/articles/how-many-test-users/ (accessed on 31 March 2024).
- Faulkner, L. Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. Behav. Res. Methods Instrum. Comput. 2003, 35, 379–383. [Google Scholar] [CrossRef]
- Nielsen, J. 10 Usability Heuristics for User Interface Design. Nielsen Norman Group. 30 January 2024. Available online: https://www.nngroup.com/articles/ten-usability-heuristics/ (accessed on 30 November 2023).
- Laubheimer, P. Preventing User Errors: Avoiding Unconscious Slips. Nielsen Norman Group. 1 July 2023. Available online: https://www.nngroup.com/articles/slips/ (accessed on 30 November 2023).
- Kaley, A. Match between the System and the Real World (Usability Heuristic #2). Nielsen Norman Group. 30 January 2024. Available online: https://www.nngroup.com/articles/match-system-real-world/ (accessed on 30 November 2023).
- Hsu, C.; Yeh, Y.; Yen, J. Development of design criteria and evaluation scale for web-based learning platforms. Int. J. Ind. Ergon. 2009, 39, 90–95. [Google Scholar] [CrossRef]
- Shollar, D.Z.; Hana, M.; Elgaber, S. 10-Criteria for E-Learning Interface Design: Theoretical study. Int. Conf. Electr. Eng. 2010, 7, 1–16. [Google Scholar] [CrossRef]
- Rao, D.; Saha, S.K. An immersive learning platform for efficient biology learning of secondary School-Level students. J. Educ. Comput. Res. 2019, 57, 1671–1694. [Google Scholar] [CrossRef]
- Taveira-Gomes, T.; Saffarzadeh, A.; Severo, M.; Guimarães, M.J.; Ferreira, M.A. A novel collaborative e-learning platform for medical students—ALERT STUDENT. BMC Med. Educ. 2014, 14, 143. [Google Scholar] [CrossRef] [PubMed]
- Kim, S.-W.; Seo, B.-H. The Development of e-Learning Platform for Gifted Children Education. Int. J. Educ. Media Technol. 2009, 3. Available online: https://ijemt.org/index.php/journal/article/view/156 (accessed on 8 February 2024).
- Ahmed, M.E.; Hasegawa, S. Development of New Distance Learning Platform to Create and Deliver Learning Content for Deaf Students. Educ. Sci. 2022, 12, 826. [Google Scholar] [CrossRef]
- Kavčič, A.; Pesek, M.; Marolt, M. A platform for supporting learning process of visually impaired children. In Proceedings of the 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia, 22–26 May 2017; pp. 848–852. [Google Scholar] [CrossRef]
Questions Items | SA | A | N | D | SD | Mean | Standard Deviation |
---|---|---|---|---|---|---|---|
| 12 | 2 | 0 | 0 | 0 | 4.86 | 0.36 |
| 13 | 1 | 0 | 0 | 0 | 4.93 | 0.27 |
| 10 | 4 | 0 | 0 | 0 | 4.71 | 0.47 |
| 9 | 4 | 1 | 0 | 0 | 4.57 | 0.65 |
| 12 | 2 | 0 | 0 | 0 | 4.86 | 0.36 |
| 7 | 6 | 0 | 0 | 1 | 4.29 | 1.07 |
| 11 | 3 | 0 | 0 | 0 | 4.79 | 0.43 |
Overall Mean | 4.71 |
Questions Items | SA | A | N | D | SD | Mean | Standard Deviation |
---|---|---|---|---|---|---|---|
| 10 | 4 | 0 | 0 | 0 | 4.71 | 0.47 |
| 11 | 3 | 0 | 0 | 0 | 4.79 | 0.43 |
| 13 | 1 | 0 | 0 | 0 | 4.93 | 0.27 |
| 10 | 4 | 0 | 0 | 0 | 4.71 | 0.47 |
| 12 | 2 | 0 | 0 | 0 | 4.86 | 0.36 |
| 12 | 2 | 0 | 0 | 0 | 4.86 | 0.36 |
Overall Mean | 4.81 |
Questions Items | SA | A | N | D | SD | Mean | Standard Deviation |
---|---|---|---|---|---|---|---|
| 6 | 3 | 5 | 0 | 0 | 4.07 | 0.92 |
| 6 | 6 | 2 | 0 | 0 | 4.29 | 0.73 |
| 13 | 1 | 0 | 0 | 0 | 4.93 | 0.27 |
| 14 | 0 | 0 | 0 | 0 | 5.00 | 0.00 |
| 10 | 4 | 0 | 0 | 0 | 4.71 | 0.47 |
| 9 | 5 | 0 | 0 | 0 | 4.64 | 0.50 |
| 9 | 4 | 1 | 0 | 0 | 4.57 | 0.65 |
| 10 | 4 | 0 | 0 | 0 | 4.71 | 0.47 |
| 14 | 0 | 0 | 0 | 0 | 5.00 | 0.00 |
| 10 | 3 | 1 | 0 | 0 | 4.64 | 0.63 |
| 7 | 5 | 2 | 0 | 0 | 4.36 | 0.74 |
Overall Mean | 4.63 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ahmed, M.E.; Hasegawa, S. An Expert Usability Evaluation of a Specialized Platform for Designing and Producing Online Educational Talking Books. Appl. Syst. Innov. 2024, 7, 74. https://doi.org/10.3390/asi7050074
Ahmed ME, Hasegawa S. An Expert Usability Evaluation of a Specialized Platform for Designing and Producing Online Educational Talking Books. Applied System Innovation. 2024; 7(5):74. https://doi.org/10.3390/asi7050074
Chicago/Turabian StyleAhmed, Mohamed Elsayed, and Shinobu Hasegawa. 2024. "An Expert Usability Evaluation of a Specialized Platform for Designing and Producing Online Educational Talking Books" Applied System Innovation 7, no. 5: 74. https://doi.org/10.3390/asi7050074