The Role of the E-Learning Departments in Controlling the Quality of Electronic Assessments in Palestinian Universities during the COVID-19 Pandemic
Abstract
:1. Introduction
2. Theoretical E-Assessment Frameworks
3. Literature Review
4. Research Rationale, Goals and Questions
4.1. The Research Rationale and Goals
4.2. The Research Question
5. Methods
5.1. Research Context and Participants
5.2. Data Collecting and Analysis Tools
5.3. Research Validity and Reliability
6. Results
6.1. Assessment Using Face-To-Face Means
In some assessments, there was a file that contains questions that are answered in print or handwriting, and within the allocated time that was specified by the instructor, the student was supposed to submit the answers. It was obligatory to assess the students who were enrolled in some engineering practical workshops due to lack of any other plausible alternative.
6.2. Suggesting Alternative Methods of E-Assessment
A direction was made towards alternative evaluation techniques that depend on analysis, and then in the treatment phase after the first shock of the COVID19 pandemic, the instructors were trained on all evaluation methods. Instructors were asked to offer a course syllabus that includes the course objectives, the course various assessment mechanisms, practical activities and/or projects that show the student’s personality such as analyzing research papers and other exercises or activities that were held at the level of each college and the nature and specificity of the course.
One of the most difficult things in light of the COVID19 pandemic was the assessment process, usually the monitoring was prevalent. Alternative methods were the face-to-face written exam where instructors were supposed to direct students to do group work projects, except in certain courses in education and sociology departments because, where they depended on discussions and case research, but in mathematics, chemistry and science written assessments were unavoidable.
6.3. Putting Restrictions on Multiple-Answer Questions
The method of placing random questions within the categories (easy, medium, difficult) has been adopted; moreover, shuffling the questions and changing the order of answers to the same question reduced the cheating process. Students could not log into the electronic assessment in Moodle through more than once; each student was supposed to log into his/her account via their usernames only once irrespective of where he or she is.
6.4. Giving Freedom for the Instructors to Initiate E-Assessment Methods
6.5. Distributing the E-Assessment Methods by a Single Instructor among the Others
We showed some successful models for instructors who succeeded in building computerized exams using Moodle, and their experiences were displayed in a set of settings that ensured preventing movement between questions, and incorporating a variety of questions in each exam.
6.6. Encouraging Activities as Means of E-Assessment
6.7. Requesting the Use of Cameras during the Synchronous Exam
Opening the cameras is legal, but in terms of custom, they cannot force students because of the privacy issue in the Palestinian society, in addition to the fact that the speed of the Internet in the country does not bear the great burden of devices when playing the camera and the Internet.
We requested students to open their cameras, where some professors applied them firmly. The problem was with first-year students because they were beginners to the system and to the language, so it was difficult for them to abide by such obligations. The student who refused to open the camera was allowed to compensate for this by sitting to face-t-face exams in the university campus.
6.8. Being Flexible in in Replacing Face-To-Face Exams with E-Assessment
7. Discussion
8. Conclusions and Recommendations
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Conflicts of Interest
References
- Poon, J. Blended learning: An institutional approach for enhancing students’ learning experiences. J. Online Learn. Teach. 2013, 9, 271–288. Available online: https://jolt.merlot.org/vol9no2/poon_0613.pdf (accessed on 25 September 2021).
- Vollmer, J.; Debunking the LCMS Myth. Chief Learning Officers. 1 July 2003. Available online: https://www.chieflearningofficer.com/2003/07/01/debunking-the-lcms-myth (accessed on 25 September 2021).
- Galanis, V.I.; Laskari, E.C.; Meletiou, G.C.; Vrahatis, M.N. E-Evaluation in Open and Distance Learning Environments. In Proceedings of the Presented at The International Conference on Information Technologies (InfoTech 2009), Varna, Bulgaria, 17–20 September 2009. [Google Scholar]
- Baneres, D.; Baró, X.; Guerrero-Roldán, A.-E.; Rodriguez, M.E. Adaptive e-Assessment System: A General Approach. Int. J. Emerg. Technol. Learn. (iJET) 2016, 11, 16–23. [Google Scholar] [CrossRef]
- Hu, C. Application of E-Learning Assessment Based on AHP-BP Algorithm in the Cloud Computing Teaching Platform. Int. J. Emerg. Technol. Learn. (iJET) 2016, 11, 27. [Google Scholar] [CrossRef]
- Astalini, A.; Darmaji, D.; Kurniawan, W.; Anwar, K.; Kurniawan, D.A. Effectivenes of Using E-Module and E-Assessment. Int. J. Interact. Mob. Technol. (iJIM) 2019, 13, 21–39. [Google Scholar] [CrossRef]
- Howarth, P. The opportunities and challenges faced in utilizing e-Based assessment. In Proceedings of the Presented at Annual Conference of Educational Research Center on Educational Measurement, Beirut, Lebanon, 24–25 March 2010. [Google Scholar]
- Kim, N.; Smith, M.J.; Maeng, K. Assessment in online distance education: A comparison of three online programs at a university. Online J. Distance Learn. Adm. 2008, 11. Available online: https://www.westga.edu/~distance/ojdla/spring111/kim111.html. (accessed on 25 September 2021).
- Fontanillas, T.R.; Carbonell, M.R.; Catasús, M.G. E-assessment process: Giving a voice to online learners. Int. J. Educ. Technol. High. Educ. 2016, 13, 1–14. [Google Scholar] [CrossRef]
- Shalatska, H.; Zotova-Sadylo, O.; Makarenko, O.; Dzevytska, L. Implementation of E-assessment in Higher Education. In Proceedings of the ICTERI Workshops, Kharkiv, Ukraine, 6–10 October 2020; pp. 1172–1186. [Google Scholar]
- Simonson, M.; Zvacek, S.M.; Smaldino, S. Teaching and Learning at a Distance: Foundations of Distance Education, 7th ed.; Information Age Publishing: Charlotte, NC, USA, 2019. [Google Scholar]
- Schneider, S.L.; Council, M.L. Distance learning in the era of COVID-19. Arch. Dermatol. Res. 2021, 313, 389–390. [Google Scholar] [CrossRef]
- Garrison, D.R.; Vaughan, N.D. Blended Learning in Higher Education: Framework, Principles, and Guidelines; John Wiley & Sons: Hoboken, NJ, USA, 2008. [Google Scholar]
- Daher, W. Virtual Interactions in Distance Learning. In Handbook of Research on Practices and Outcomes in Virtual Worlds and Environments; IGI Global: Hershey, PA, USA, 2012; pp. 514–535. [Google Scholar]
- Bąkała, A.; Bąkała, M. Enhancing ethical behavior in online exams. Ann. Etyka Życiu Gospod. 2020, 23, 37–51. [Google Scholar] [CrossRef]
- Daher, W.; Awawdeh Shahbari, J. Secondary students’ identities in the virtual classroom. Sustainability 2020, 12, 4407. [Google Scholar] [CrossRef]
- Kundu, A.; Bej, T. Experiencing e-assessment during COVID-19: An analysis of Indian students’ perception. High. Educ. Evaluation Dev. 2021, 15, 114–134. [Google Scholar] [CrossRef]
- Gasparyan, A.Y.; Nurmashev, B.; Seksenbayev, B.; Trukhachev, V.; Kostyukova, E.I.; Kitas, G.D. Plagiarism in the Context of Education and Evolving Detection Strategies. J. Korean Med. Sci. 2017, 32, 1220–1227. [Google Scholar] [CrossRef]
- Sa’Di, R.A.; Abdelraziq, A.; Sharadgah, T.A. E-Assessment at Jordan’s Universities in the Time of the COVID-19 Lockdown: Challenges and Solutions. Arab. World Engl. J. 2021, 1, 37–54. [Google Scholar] [CrossRef]
- Peytcheva-Forsyth, R.; Aleksieva, L.; Yovkova, B. The impact of technology on cheating and plagiarism in the assessment–The teachers’ and students’ perspectives. In AIP Conference Proceedings; AIP Publishing LLC: Melville, NY, USA, 2018; Volume 2048, p. 020037. [Google Scholar]
- Bhebhe, S.; Maphosa, C. An exploration of online assessment in institutions of higher learning. In The Impact of COVID-19 On the International Education System; Naumovska, L., Ed.; Proud Pen: London, UK, 2020; pp. 172–183. [Google Scholar] [CrossRef]
- Das, D.K. Civil Engineering Students’ Perceptions of Conventional and Alternative Assessment Methods. Afr. J. Res. Math. Sci. Technol. Educ. 2020, 24, 116–128. [Google Scholar] [CrossRef]
- Yulia, H. Online Learning to Prevent the Spread of Pandemic Corona Virus in Indonesia. Eternal Engl. Teach. J. 2020, 11. [Google Scholar] [CrossRef]
- Roberts, R. Qualitative Interview Questions: Guidance for Novice Researchers. Qual. Rep. 2020, 25, 3185–3203. [Google Scholar] [CrossRef]
- Elo, S.; Kääriäinen, M.; Kanste, O.; Pölkki, T.; Utriainen, K.; Kyngäs, H. Qualitative content analysis: A focus on trustworthiness. SAGE Open 2014, 4, 2158244014522633. [Google Scholar] [CrossRef]
- Saunders, B.; Sim, J.; Kingstone, T.; Baker, S.; Waterfield, J.; Bartlam, B.; Burroughs, H.; Jinks, C. Saturation in qualitative research: Exploring its conceptualization and operationalization. Qual. Quant. 2018, 52, 1893–1907. [Google Scholar] [CrossRef]
- Baya’a, N.; Daher, W. Middle school students’ learning of mathematics using mobile phones: Conditions and consequences. J. Interact. Learn. Res. 2010, 21, 165–185. [Google Scholar]
- Daher, W. Discursive positionings and emotions in modelling activities. Int. J. Math. Educ. Sci. Technol. 2015, 46, 1149–1164. [Google Scholar] [CrossRef]
- Daher, W.; Baya’A, N. Characteristics of middle school students learning actions in outdoor mathematical activities with the cellular phone. Teach. Math. Its Appl. Int. J. IMA 2011, 31, 133–152. [Google Scholar] [CrossRef]
- Daher, W. Mathematics Learning Community Flourishes in the Cellular Phone Environment. Int. J. Mob. Blended Learn. 2010, 2, 1–17. [Google Scholar] [CrossRef]
- Jusas, V.; Butkiene, R.; Venčkauskas, A.; Burbaite, R.; Gudoniene, D.; Grigaliūnas, Š.; Andone, D. Models for Administration to Ensure the Successful Transition to Distance Learning during the Pandemic. Sustainability 2021, 13, 4751. [Google Scholar] [CrossRef]
- Butnaru, G.I.; Niță, V.; Anichiti, A.; Brînză, G. The Effectiveness of Online Education during Covid 19 Pandemic—A Comparative Analysis between the Perceptions of Academic Students and High School Students from Romania. Sustainability 2021, 13, 5311. [Google Scholar] [CrossRef]
- Drašler, V.; Bertoncelj, J.; Korošec, M.; Pajk Žontar, T.; Poklar Ulrih, N.; Cigić, B. Difference in the Attitude of Students and Employees of the University of Ljubljana towards Work from Home and Online Education: Lessons from COVID-19 Pandemic. Sustainability 2021, 13, 5118. [Google Scholar] [CrossRef]
- United Nations Office for the Coordination of Humanitarian Affairs COVID-19 Emergency Situation Report 6, 28 April 2020. Available online: https://www.ochaopt.org/content/covid-19-emergency-situation-report-6. (accessed on 25 September 2021).
- Adli, H. Gaza Children Struggle with Studies during COVID-19 Lockdown. Al Jazeera, 16 October 2020. Available online: https://www.aljazeera.com/news/2020/10/16/gaza-children-struggle-with-studies-during-covid-19-lockdown. (accessed on 25 September 2021).
- UNESCO. COVID-19 in Palestine: How Distance Learning Will Help Student Continue Education. 12 April 2020. Available online: https://en.unesco.org/news/covid-19-palestine-how-distance-learning-will-help-student-continue-education. (accessed on 25 September 2021).
- Ali, L.; Dmour, N. The shift to online assessment due to COVID-19: An empirical study of university students, behaviour and performance, in the region of UAE. Int. J. Inf. Educ. Technol. 2021, 11, 220–228. [Google Scholar]
- Allen, I.E.; Seaman, J. Digital Learning Compass: Distance Education Enrollment Report 2017; Babson Survey Research Group, e-Literate, and WCET: Babson Park, MA, USA, 2017; Available online: https://onlinelearningsurvey.com/reports/digtiallearningcompassenrollment2017.pdf (accessed on 25 September 2021).
- Jaschik, S.; Lederman, D. Survey of Faculty Attitudes on Technology: A Study by inside Higher Ed and Gallup; Gallup, Inc.: Washington, DC, USA, 2018; Available online: https://www.insidehighered.com/system/files/media/IHE_2018_Survey_Faculty_Technology.pdf. (accessed on 25 September 2021).
- Daher, W.; Sabbah, K.; Abuzant, M. Affective Engagement of Higher Education Students in an Online Course. Emerg. Sci. J. 2021, 5, 545–558. [Google Scholar] [CrossRef]
- Abuzant, M.; Ghanem, M.; Abd-Rabo, A.; Daher, W. Quality of Using Google Classroom to Support the Learning Processes in the Automation and Programming Course. Int. J. Emerg. Technol. Learn. (iJET) 2021, 16, 72–87. [Google Scholar] [CrossRef]
- Amer, A.; Daher, W. Moodle quizzes as a teaching tool in English for academic purposes course. Int. J. Innov. Learn. 2019, 25, 35. [Google Scholar] [CrossRef]
- Daher, W. Students’ Adoption of Social Networks as Environments for Learning and Teaching: The Case of the Facebook. Int. J. Emerg. Technol. Learn. (iJET) 2014, 9, 16. [Google Scholar] [CrossRef]
- Oliveira, P.C.D.; Cunha, C.J.C.D.A.; Nakayama, M.K. Learning management systems (LMS) and e-learning management: An integrative review and research agenda. JISTEM-J. Inf. Syst. Technol. Manag. 2016, 13, 157–180. [Google Scholar] [CrossRef]
- Meccawy, Z.; Meccawy, M.; Alsobhi, A. Assessment in ‘survival mode’: Student and faculty perceptions of online assessment practices in HE during COVID-19 pandemic. Int. J. Educ. Integr. 2021, 17, 1–24. [Google Scholar] [CrossRef]
- Hamdan, R. The Extent to Which Technical Education Quality Standards Are Applied at Palestine Technical University and Colleges. In Proceedings of the Eighth Arab International Conference for Quality Assurance of Higher Education, Lebanese International University, Beirut, Lebanon, 9–11 April 2018. [Google Scholar]
- Azevedo, J.; Beites, P.D.; Oliveira, E.P. Evaluating E-Assessment: A Practical Application Using Statistical Methods. In Handbook of Research on E-Assessment in Higher Education; Azevedo, A., Azevedo, J., Eds.; IGI Global: Hershey, PA, USA, 2019; pp. 68–100. [Google Scholar]
Category | Codes | Examples |
---|---|---|
Assessment using face-to-face means | Assessment, evaluation, face-to-face, regular | In some assessments, there was a file that contains questions that are answered in print or handwritten in the appropriate manner, and within the allocated time that was specified by the instructor |
Suggesting alternative methods of e-assessment | Suggest, propose, alternative, different, method, way e-assessment | A direction was made towards alternative evaluation techniques that depend on analysis |
Putting restrictions on multiple-answer questions | Restricting, conditioning, multiple-answer, question, problem | The method of placing random questions within the categories (easy, medium, difficult) has been adopted. |
Giving freedom for the instructors initiate e-assessment methods: | Freedom, instructor, initiate, suggest, propose, is responsible, e-assessment, method, way | The administration’s decision was that the instructor is supposed to responsible for the various assessment settings |
Distributing the e-assessment methods by a single instructor among the others: | Distribute, show, e-assessment, method, way, instructor, lecturer, others, rest | We showed some successful models for instructors who succeeded in building computerized exams using Moodle |
Encouraging activities as means of e-assessment: | Encourage, change, allow, activity, problem solving, e-assessment | The evaluation rates were changed, and a large percentage was given to the activities provided by the student |
Requesting the use of cameras during the synchronous exam: | Request, require, ask, camera, video, synchronous exam | The cameras in synchronous exams are legal, but in terms of custom, they cannot force students because of their privacy in the Palestinian society |
Being flexible in in replacing face-to-face exams with e-assessment | Flexible, replace, make, face-to-face, e-assessment, exam, problem solving | The student who faced technical problems with the Internet during the exam |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Hamdan, R.; Ashour, W.; Daher, W. The Role of the E-Learning Departments in Controlling the Quality of Electronic Assessments in Palestinian Universities during the COVID-19 Pandemic. Sustainability 2021, 13, 12021. https://doi.org/10.3390/su132112021
Hamdan R, Ashour W, Daher W. The Role of the E-Learning Departments in Controlling the Quality of Electronic Assessments in Palestinian Universities during the COVID-19 Pandemic. Sustainability. 2021; 13(21):12021. https://doi.org/10.3390/su132112021
Chicago/Turabian StyleHamdan, Rabab, Wafaa Ashour, and Wajeeh Daher. 2021. "The Role of the E-Learning Departments in Controlling the Quality of Electronic Assessments in Palestinian Universities during the COVID-19 Pandemic" Sustainability 13, no. 21: 12021. https://doi.org/10.3390/su132112021
APA StyleHamdan, R., Ashour, W., & Daher, W. (2021). The Role of the E-Learning Departments in Controlling the Quality of Electronic Assessments in Palestinian Universities during the COVID-19 Pandemic. Sustainability, 13(21), 12021. https://doi.org/10.3390/su132112021