Next Article in Journal
Validation of a Deep Learning Model for Detecting Chest Pathologies from Digital Chest Radiographs
Previous Article in Journal
The Role of Nasal Cytology and Serum Atopic Biomarkers in Paediatric Rhinitis
Previous Article in Special Issue
Cultivating Clinical Clarity through Computer Vision: A Current Perspective on Whole Slide Imaging and Artificial Intelligence
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Virtual Versus Light Microscopy Usage among Students: A Systematic Review and Meta-Analytic Evidence in Medical Education

1
Department of Physiology, Neuroscience, and Behavioral Sciences, St. George’s University School of Medicine, St. George’s, Grenada
2
Department of Pathology, St. Matthews University School of Medicine, Georgetown P.O. Box 30992, Cayman Islands
3
Department of Microbiology, St. Matthews University School of Medicine, Georgetown P.O. Box 30992, Cayman Islands
4
Department of Psychology, University of Leicester, Leicester LE1 7RH, UK
5
Medical Student Research Institute, St. George’s University School of Medicine, St. George’s, Grenada
6
Department of Public Health, Torrens University, Ultimo, Sydney, NSW 2007, Australia
7
Department of Clinical Medicine, American University of Antigua, St. John’s, Antigua and Barbuda
8
Department of Biochemistry, St. George’s University School of Medicine, St. George’s, Grenada
9
Department of Pathology, Government Medical College, Jammu 180001, India
10
Department of Education Service, St. George’s University, St. George’s, Grenada
11
Medical Illustrator, The Centre for Biomedical Visualization, St. George’s University, St. George’s, Grenada
12
Department of Pathology, Wexner Medical Center, The Ohio State University, Cooperative Human Tissue Network (CHTN) Midwestern Division, Columbus, OH 43210, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2023, 13(3), 558; https://doi.org/10.3390/diagnostics13030558
Submission received: 19 July 2022 / Revised: 26 January 2023 / Accepted: 30 January 2023 / Published: 2 February 2023
(This article belongs to the Special Issue Digital Pathology: Records of Successful Implementations)

Abstract

:
Background: The usage of whole-slide images has recently been gaining a foothold in medical education, training, and diagnosis. Objectives: The first objective of the current study was to compare academic performance on virtual microscopy (VM) and light microscopy (LM) for learning pathology, anatomy, and histology in medical and dental students during the COVID-19 period. The second objective was to gather insight into various applications and usage of such technology for medical education. Materials and methods: Using the keywords “virtual microscopy” or “light microscopy” or “digital microscopy” and “medical” and “dental” students, databases (PubMed, Embase, Scopus, Cochrane, CINAHL, and Google Scholar) were searched. Hand searching and snowballing were also employed for article searching. After extracting the relevant data based on inclusion and execution criteria, the qualitative data were used for the systematic review and quantitative data were used for meta-analysis. The Newcastle Ottawa Scale (NOS) scale was used to assess the quality of the included studies. Additionally, we registered our systematic review protocol in the prospective register of systematic reviews (PROSPERO) with registration number CRD42020205583. Results: A total of 39 studies met the criteria to be included in the systematic review. Overall, results indicated a preference for this technology and better academic scores. Qualitative analyses reported improved academic scores, ease of use, and enhanced collaboration amongst students as the top advantages, whereas technical issues were a disadvantage. The performance comparison of virtual versus light microscopy meta-analysis included 19 studies. Most (10/39) studies were from medical universities in the USA. VM was mainly used for teaching pathology courses (25/39) at medical schools (30/39). Dental schools (10/39) have also reported using VM for teaching microscopy. The COVID-19 pandemic was responsible for the transition to VM use in 17/39 studies. The pooled effect size of 19 studies significantly demonstrated higher exam performance (SMD: 1.36 [95% CI: 0.75, 1.96], p < 0.001) among the students who used VM for their learning. Students in the VM group demonstrated significantly higher exam performance than LM in pathology (SMD: 0.85 [95% CI: 0.26, 1.44], p < 0.01) and histopathology (SMD: 1.25 [95% CI: 0.71, 1.78], p < 0.001). For histology (SMD: 1.67 [95% CI: −0.05, 3.40], p = 0.06), the result was insignificant. The overall analysis of 15 studies assessing exam performance showed significantly higher performance for both medical (SMD: 1.42 [95% CI: 0.59, 2.25], p < 0.001) and dental students (SMD: 0.58 [95% CI: 0.58, 0.79], p < 0.001). Conclusions: The results of qualitative and quantitative analyses show that VM technology and digitization of glass slides enhance the teaching and learning of microscopic aspects of disease. Additionally, the COVID-19 global health crisis has produced many challenges to overcome from a macroscopic to microscopic scale, for which modern virtual technology is the solution. Therefore, medical educators worldwide should incorporate newer teaching technologies in the curriculum for the success of the coming generation of health-care professionals.

Graphical Abstract

1. Introduction

The advent of the COVID-19 pandemic and physical distancing posed an unprecedented challenge to the world of medical education. How do you teach medicine, a human-centered subject that requires active interaction and engagement with people, without face-to-face contact? In response to this challenge, medical schools worldwide have implemented various changes such as online lectures and virtual classrooms in their education during the last two years to adapt to the new norm [1,2,3].

1.1. Whole-Slide Imaging (WSI)

Even before the pandemic, however, digital pathology using digital whole-slide imaging (WSI) was steadily gaining a foothold in medical education, training, and diagnosis [4,5]. Cumulative validations of the outstanding diagnostic concordance between WSI and glass-slide diagnoses prompted constant development and establishment of guidelines regarding WSI, thus progressively broadening the scope of its use [6,7]. Following the release of the guideline on the validation of WSI for diagnostic purposes by the Pathology and Laboratory Quality Center for Evidence-Based Guidelines of the College of American Pathologists (CAP) in 2013, WSI later gained approval from the Food and Drug Administration (FDA) for its use in primary diagnosis in 2017 and continues to be updated, the latest being the Guideline Update from the College of American Pathologists in Collaboration with the American Society for Clinical Pathology and the Association for Pathology Informatics in 2022 [6,8].
WSI technology is readily utilized by virtual microscopy (VM), a computerized conversion of light microscopy images in full resolution and their presentation over a computer network [9]. VM software can reproduce a digitized, high-resolution image of a traditional glass slide and allows the users to highlight, annotate, pan, and zoom. With the ease of use, added features, and reliability, interest in the exciting potential of VM continues to be on the rise [7,10,11].

1.2. Virtual Microscopy and COVID-19

Numerous literature reviews and meta-analyses reported the advantages of virtual microscopy before the global wave of digitization from the COVID-19 pandemic in 2019 [12,13,14,15]. Researchers have endlessly highlighted advantages of digital pathology using VM in medical practice [16,17,18,19]. These advantages include:

1.2.1. General

  • No risk of deterioration of staining quality or breakage of slides, no fading or stored slides, shorter sign-out time, access from any device, better flexibility, easy image sharing in clinical communication

1.2.2. Telepathology

  • Quick access, elimination of physical slide transfer, better availability of service for remote and understaffed areas

1.2.3. Cost and Efficiency

  • Better archiving, sharing, and easy retrieval; faster turnaround times, reduced cost of equipment, lab maintenance, and auxiliary techniques (less immunohistochemistry).
Advantages of VM use for medical educational are observed as well. Learners benefit from VM through remote teaching, multiple user access, the comfort of use amongst the modern “digital native” generation with prior computer knowledge, and better interaction between teachers and students by viewing the same image at the same time [17,20]. A meta-analysis by Wilson et al. also found that learners prefer VM to conventional light microscopy as well [13].
One notable advantage of using VM worth acknowledging is the benefit of access to slide images without restricting time and space. This unique characteristic of VM came into the spotlight upon facing the lockdowns during the coronavirus global health crisis. To ensure undisrupted quality education for students, lecturers adjusted their teaching methods to social distancing and disease-prevention regulations accordingly. In addition, the massive shift in medical education towards remote learning and digitization of the learning materials granted researchers an abundant opportunity and data to investigate VM more deeply. With the already known benefits of using digital slides, additional positive effects such as self-paced learning, improved tissue recognition due to better access to slides, improved understanding, and better academic performance have been reported during COVID-19 lockdown-adapted online classes [2,21,22].
In this review, we aim to compare the academic performance of medical students by using VM technology to learn the microscopic aspect of the disease. In addition, this study intends to include recent data on VM and WSI to present the most updated synthesis on VM and to explore any differences in usage, benefits, and drawbacks of VM that may have been newly discovered during the COVID-19 era.

2. Materials and Methods

This review reports the systematic findings according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines [23]. The systematic review protocol was registered in the prospective register of systematic reviews (PROSPERO; https://www.crd.york.ac.uk/prospero (accessed on 21 September 2020)) with registration number CRD42020205583.
The review questions were “Does virtual or digital microscopy enhance student exam performance?” along with secondary qualitative assessment: “Is virtual microscopy a reliable and a better method for teaching and learning in medical education?” and “What are the student preferences for this newer technology?”

2.1. Literature Review

One author (NN) performed a literature search to identify if any systematic reviews were available or protocols registered as to our study objective. We identified three similar reviews [13,14,24]. However, these reviews had major limitations, such as not including studies that measured the efficacy of VM during or after the COVID-19 pandemic period. One of these previous studies included both medical students and pathology residents [24]. Its literature search was performed in a limited number of databases and failed to report comprehensive search criteria. Furthermore, these studies had narrow selection criteria, including only the pathology course at medical school, despite existing papers demonstrating VM or LM use in cytopathology, anatomy, histology, or hematopathology courses in medical, dental, and veterinary schools.

2.2. Eligibility Criteria

Only original research articles assessing the performance of LM and VM through the process of any data type—academic scores, student feedback, questionnaires, and surveys—were included for this review. Additionally, we included articles assessing the performance or perception of medical or dental students using VM or traditional LM. Articles were included irrespective of use for pathology, histology, anatomy or histopathology. The meta-analysis included comparative studies of LM versus VM or crossover studies. Studies with data on the students’ performance measured as a percentage or score on a definitive scale and clear mention of method of evaluating students’ perceptions were included. Studies published in English were included (or others if the translation in English was available).
Studies mentioning a VM resource or description of the technology used in medical or dental schools were also included. Along with this information, studies describing VM use due to the transition toward online teaching during COVID-19 were included.

2.3. Exclusion Criteria

Studies that described VM used for pathological diagnosis or involving perceptions of pathology residents were excluded from this review. Literature reviews (systematic, meta-analyses, narrative), editorial letters, book chapters, and case reports were excluded. Publications in which the modality of WSI was unclear/unspecified or no data (qualitative or quantitative) in the form of survey or comparison were available were also excluded.

2.4. Search Criteria and Database

A comprehensive database search was performed on 15 December 2021 and again on 15 March 2022 (to include updates) from the date of inception in Scopus, PubMed, CINAHL, Web of Science, Embase, Cochrane Library and Google Scholar. Various search terms such as “virtual microscopy/microscop*,” “digital microscopy/microscop*,” “virtual slides,” “whole slide imaging,” “students,” and “medical education” in combinations of Boolean operators and truncation were used to ensure comprehensive inclusion of relevant articles. Search criteria were adjusted to the selected database. In addition, we manually searched recent reviews or eligible studies to identify any potential studies.

2.5. Article Screening and Eligibility Evaluation

For a fair screening process, two teams (SM, SN, and ShN; JW, TC, and SH) of researchers independently performed title and abstract screening based on study inclusion criteria. In addition, we performed a full-text analysis if the potentially relevant article’s abstract did not contain sufficient information. The inclusion and exclusion criteria were used to select the eligible studies and access the full-text articles. Zotero software was used as the reference manager to import the search results from the database and exclude duplicates [25]. Google Sheets was used to screen the articles and register a primary reason for exclusion. Disagreements were resolved by collective discussion involving both teams, which ensured that appropriate publications were selected according to the eligibility criteria.

2.6. Extraction of Qualitative and Quantitative Data

One author (SM) independently extracted the available data from the eligible studies, followed by the second author (SN) reviewing the extracted data. Finally, we designed a standardized data collection Google sheet to organize the qualitative and quantitative data.
For each selected study, the following information was extracted (when available): year and country of publication, which variable was analyzed (performance, perception or both), number of participants, students’ educational level, type of equipment and software used to assess WSI, types of workstation, digital slide accessibility, equipment training, LM availability and its specification, number and Scope of used samples, and how the students’ performance and/or perception were assessed and their results. The outcome of interest for this meta-analysis was focused on estimating overall exam performance based on discipline and subject.

2.7. Quality Assessment

Two authors independently (SM and RN) used the original version of the Newcastle Ottawa Scale (NOS) for the quality appraisal of the included studies [26]. The NOS scale is a star-based system that evaluates the study based on three major perspectives: the selection of the study groups, comparability of the groups, and the ascertainment of either the exposure or outcome of interest for non-RCTs. For case–control studies, a study was awarded a maximum of one star for each numbered item within the selection and exposure categories. A maximum of two stars were given for comparability. For cohort studies, a study was awarded a maximum of one star for each numbered item within the selection and outcome categories. For comparability, a maximum of two stars were given (see Supplementary File S1). Finally, each study was categorized as good, fair or poor quality. A subgroup quantitative analysis of the studies was done after classifying them as good, fair or poor quality according to Agency for Health Research and Quality (AHRQ) standards (see Supplementary File S2). Any discrepancies were resolved by discussion with the third reviewer (SN).

2.8. Statistical Analyses

The Google sheet was cleaned and organized to conduct qualitative and quantitative analysis. Qualitative results were organized and included in the systematic review, whereas the quantitative data were analyzed further to estimate the overall better educational technique (VM versus LM). Review Manager version 5.4 calculated mean differences, pooled effect size, and heterogeneity. Only the studies with data on comparative exam scores went to the quantitative analytical stage (meta-analyses). Since the overall analysis demonstrated considerable heterogeneity, the random effect model to generate forest plots and publication bias was used. The choice of a random effect model was made due to the heterogeneity that was observed for different countries, different year of study, different faculty, different discipline, different teaching technique, different technical setup, and pre/COVID-19. Included studies used different scales to measure the same outcome, i.e., the units for the outcome of interest were different across studies. For such cases, the mean differences (MD) cannot be directly pooled and analyzed. Thus, MD was divided by the respective standard deviations (SDs) to yield a statistic known as the standardized mean difference (SMD) [27]. Therefore, the extracted data were computed and organized as continuous data followed by an inverse variance analysis method to estimate the SMD and 95% confidence interval. The heterogeneity was assessed using Higgins square I2 or Q-statistic. I2 can be interpreted as minimal (0–40%), moderate (30–60%), substantial (50–90%) and considerable (75–100%) [28]. Begg and Mazumdar’s rank correlation and Egger’s test were used to confirm the publication bias [29]. Subgroup analyses according to the subject (pathology, histology or histopathology) and faculty (medical or dental) were also performed.
In the qualitative data review of included articles, themes that referred to the applications, advantages, and disadvantages of VM were identified. In addition, perceptions, surveys, or questionnaire data related to student experiences with VM were extracted from the Google sheet.

3. Results

3.1. Search Results and Study Characteristics

A total of 1627 studies were identified from the selected database search. After removal of 676 duplicates, there were 951 eligible studies, of which those conducted before year 2019 were further excluded. Thus, a final number of 263 articles were screened for title and abstract and 39 full-text articles were reviewed to be included in the systematic review. The meta-analysis of the performance comparison of VM versus LM included 19 studies (see flowchart in Figure 1).
The included articles were published from 2019 to 2022, and originated from North America, South America, Europe, Australia, the United Kingdom and Asia. Most (10/39) were from medical universities in the USA. VM was mostly used for teaching pathology (25/39) at medical schools (30/39). Dental schools (10/39) also reported using VM for teaching microscopy. The most commonly used VM software reported by the studies (6/39) was Aperio ImageScope [30]. Only three studies in this review collected data using a randomized controlled trial protocol, whereas most collected data were based on group performance comparison without randomization. COVID-19 was responsible for transition to VM use in 17/39 studies. A detailed synthesis of included studies in this review is provided in Table 1.
Using Table 1, we performed thematic analyses for the advantages/disadvantages reported by various studies on using VM or LM. Thematic analyses revealed various codes describing the advantages and disadvantages from the included articles (Supplementary Table S1). The top themes highlighting advantages that emerged were improvements in academic performance of the students, ease of use of VM, a positive student perception and acceptability of VM, and enhanced cooperation and student collaboration. In addition, one of the generated themes highlighted a positive impact on the teaching faculty.
Results from various studies revealed significantly improved academic test scores [20,31,32,36,37,38,46,48,50,52,53,58,62,63] along with improvements in the medical knowledge of students [22,34,38,44,45,46,48,55,58,61,63,64,67].
Development of diagnostic and practical skills during laboratory sessions was an important finding [33,39,48,53,56,58,59,64]. Studies also reported that VM promotes self-directed learning [31,35,38,41,48,58,59,64] and thus an overall better method of learning for exam preparation for the students [32,38,52,53,56].
Accessibility to the slide images outside classroom [35,44,47,48,49,52,53,54,59,64,67], ability to annotate slides [20,35] and availability of ample free resources led to a more efficient and feasible method of learning [20,34,40,41,44,48,54,67].
An overall positive acceptance for VM with a higher student satisfaction for VM-based teaching in addition to increased levels of subject interest was another reported advantage [20,22,35,36,37,39,41,47,49,50,53,54,55,59,60,64,66,67].
Improved student and faculty rapport [33,34,42,45,51,52,56,60] as well as better cooperation and participation amongst students was another interesting finding [20,31,32,33,34,36,43,52,57,60,61,66,67].
The teaching faculty also reported higher levels of satisfaction with VM use [20,35,42,57,59] and also reported VM as a time-saving and cost-effective teaching method [20,31,32,33,35,36,42,57,67].
Technical and internet issues while accessing the slides were the main disadvantages [22,33,38,41,44,57,67]. Few studies reported less interaction and impaired social connections along with a lack of faculty feedback as main disadvantages [22,41,44].

3.2. Quality Assessment of Included Studies Using NOS

The final included articles were predominantly of cross-sectional design, and thus an adapted version of the NOS scale was applied for quality assessment of cross-sectional studies. Others were evaluated using the original NOS scale. To evaluate each study, a n asterisk was assigned to any of the fulfilled criteria in the selected scale parameter. Table 2 represents the summary of quality assessment using the NOS scale for cohort studies.
Table 3 represents the summary of quality assessment using the NOS scale for cross-sectional studies (total nine articles).
Table 4 represents the summary of quality assessment using the NOS scale for randomized controlled studies (total three articles).
Table 5 represents the summary of quality assessment using the NOS scale for case–control studies (total seven articles).
The pooled effect size of 19 studies significantly demonstrated higher exam performance (SMD: 1.36 [95% CI: 0.75, 1.96], p < 0.001) among the students who studied by VM method than the LM method with considerable heterogeneity (I2: 100%, p-value <0.001) as shown in Figure 2.
Students in the VM group demonstrated significantly higher exam performance than LM in pathology (SMD: 0.85 [95% CI: 0.26, 1.44], p < 0.01) and histopathology (SMD: 1.25 [95% CI: 0.71, 1.78], p < 0.001). For histology (SMD: 1.67 [95% CI: −0.05, 3.40], p = 0.06), the result was insignificant (Figure 3).
The overall analysis of 15 studies assessing exam performance showed significantly higher performance for both medical (SMD: 1.42 [95% CI: 0.59, 2.25], p < 0.001) and dental students (SMD: 0.58 [95% CI: 0.58, 0.79], p < 0.001) under VM learning than the conventional method (Figure 4).
A subgroup analysis on studies of low risk or bias compared to higher risk of bias was also performed based on the results of the NOS scale (Figure 5).
In sum, 11/19 studies were categorized as good quality, whereas 3/19 were fair and 5/19 were of poor quality. The result showed a clear significance for the “good” subgroup (SMD: 1.01 [95% CI: 0.52, 1.50], p < 0.001) as well as the “fair” subgroup (SMD: 1.39 [95% CI: 0.79, 1.99], p < 0.001). The result was not significant for the “poor” rated studies (SMD: 1.86 [95% CI: −0.80, 4.52], p = 0.17).
The studies in the funnel plot are distributed asymmetrically, which suggests publication bias. Begg’s and Mazumdar’s for rank correlation have a p-value of 0.19, suggesting publication bias. Eggers test for a regression intercept of 10.36 resulted in p-value (one-tailed) of 0.06, which confirms the presence of publication bias (Figure 6).

4. Discussion

In this review article, the authors compared the utility of VM for teaching medical subjects in medical and dental schools. The results of our qualitative and quantitative analyses show a comparison of student performance after using VM technology. The digitization of glass slides undoubtedly enhances the ease of teaching and learning of microscopic aspects of disease. Additionally, the COVID-19 global health crisis has produced many challenges to overcome from a macroscopic to microscopic scale, for which modern virtual technology has been the solution [1].
The authors performed a systematic review considering how to remove existing literature limitations. A well-designed study criterion to include more studies, including the articles published during COVID-19 pandemic to analyze available evidence on the usage of VM for the learning process for medical and dental school learners compared to the traditional LM, was developed.
The results from the systematic review clearly show a preference for using VM. In contrast, the meta-analysis results statistically prove that overall student performance on the examination is better when using such technology for learning.
As the use of virtual learning platforms and virtual meeting spaces proliferated, educators of undergraduate and preclinical sciences adapted to using VM with remote students [2]. The use of VM in education is not unprecedented, of course, but its application and scope has significantly expanded over the last two years [21,32,36,68,69]. Much like modern students are more likely to have experience editing a digital photograph than developing an analogue photograph, the technology offers a more intuitive experience to the novice user. Clinical medicine, too, has shown VM to be a ready solution for histopathology diagnosis, supported by double-blind evidence of no inferiority to traditional modalities of diagnosis [70,71,72].
Various researchers around the globe have highlighted the advantages of such digital technologies when used for histopathology diagnosis, including diagnosis for such specialties as dermatology, neurology, gastrointestinal, cancer pathology and hematological diagnosis [73,74,75,76,77,78]. The advent of newer artificial intelligence (AI) and machine learning technologies that are being embedded into digital pathology and VM software have extended a pathologist’s diagnostic capabilities beyond the scope of the tissue section on a glass slide [79].
The newer applications and ever-increasing usage of VM software and WSI systems propel the need to integrate such technologies for medical education, especially at the undergraduate level, as students may encounter such technology during their residency years and during medical practice.
VM has gained increasing interest in the last four decades. The benefits over traditional LM include the practical, such as storage and maintenance of slides on a hard drive with backup, and the user experience, where an entire classroom can work with a single slide. For many years, however, this resource had severe limitations due to limited data storage and image magnification technology. Using WSI technology, starting in the early 2000s, VM has allowed the user to choose the magnification of the image with the stroke of a mouse and with less technical skill than traditional LM [9,17].
Results of this systematic review highlighted findings with a focus on advantages of VM use for both students and medical teachers. Most of the included articles mentioned various advantages, such as ease of use of digital slides. Easy access and constant availability with online access were the top advantages, whereas cost of implementation was the most discussed disadvantage of VM. The current COVID-19 pandemic has clearly given a boost to the field, so more robust real-world data from larger-scale VM implementations can be expected soon.
While students have largely returned to in-person learning in the pandemic’s third year, many of the innovations and remote learning adaptations of the pandemic are being integrated rather than discarded [80]. Prevailing tides of change in the digital era were already moving academic histopathology away from traditional LM in favor of a modern approach [19]. Digitizing the workspace has been a welcome improvement for learners. In one survey of pathology students utilizing VM in a remote clerkship, respondents reported greater interest and understanding of the material [22]. While some larger organizations have been able to produce and maintain their own VM database, smaller organizations have been able to benefit from the free access many institutions have offered.
An interesting aspect of the review findings in this study were the areas of VM use in medical education. Various VM-based learning activities have been employed by medical educators. Such activities include active learning activities such as group discussions, collaborative discussions, podcasts and clinical case discussions. In this review, the results show an overall positive impact of VM in a digitized learning environment and evidence indicates high acceptability and adaptability by medical learners.
Educators at the University of Eastern Finland initiated a curricular reform for histology education focused on development of a student-centered WSI platform [66]. A “gamification” histology learning model was developed that is based on incorporation of game mechanics and game theory into education [81,82].
Introduction of such a learning system into dental and medical histology courses stimulated learning and improved student satisfaction [66].
Another interesting application of VM by Sakthi-Velavan et al. involved the blending of histology content using podcasts into an integrated curriculum [32]. VM-based podcasts are narrative recordings of digital histology images. Results of the study showed a positive association between podcast viewing and improved overall class performance. The students reported a better learning experience after using the podcast-based VM. The findings align with the current review and previous studies on exploring the effectiveness of VM podcast-based teaching in medical schools [83].
During the COVID-19 pandemic, educators were forced to transition to an online distance learning pedagogy. Westfälische-Wilhelms-University, Germany and the University of California San Francisco are a couple of many such universities that successfully transitioned the entire VM-based courses to a completely online distance learning histology and pathology curriculum. Researchers at these universities used customized VM university databases and reported that the implementation of a curricular histology course in an online format was technically realizable, effective and well accepted among students. While distance learning models are insufficient for career progression in pathology, VM can still be adapted to enhance collaboration and microscopic learning of disease [40,41].
High costs of WSI scanners and VM software pose a significant challenge for adoption of digital microscopy in medical schools. Ample alternative options are available for implementation of VM for teaching and learning microscopy. Such resources include free online websites or cloud-based servers that can be accessed via the internet freely for educational purpose. Results from the analysis of the studies included in this review highlight the use of such free websites and cloud-based servers for VM resources [20,31,36,38,43].
One of the most used VM apps in this review was Aperio ImageScope, which allows viewing online or local network WSI [30]. The Biolucida viewer [84] is another such VM viewer that connects to the digital slide cloud library at the University of Iowa and can be viewed freely worldwide without any cost involved. The University of Michigan Virtual Slide Box [85] and Virtual Pathology at the University of Leeds [86] offer many WS images that can be viewed over the internet by any available web browser.
Another interesting aspect of VM implementation in medical education is the development of competence in students. American accreditation agencies such as the Accreditation Council for Graduate Medical Education (ACGME) [87] and Liaison Committee on Medical Education (LCME) [88] have outlined core skills that need to be addressed by medical schools to meet the required educational standards, including medical knowledge, patient care, communication skills, professionalism, lifelong learning and social context of health care [89]. Due to the accreditation body requirements along with the ongoing transition towards remote or distance learning, implementation of VM can help in addressing such competence and ensuring development of competent physicians for the society [9,20].

Limitations of this Review

A significant limitation of our study is the presence of a considerable level of heterogeneity. This could be due to the methodological (differences in study design, risk of bias, etc.) and statistical (variation in intervention effects or results) differences from the diverse geographical population with different cultures. For example, Lee et al. (2020) reported academic scores as percentages to compare LM and VM groups. However, Chen et al. (2019) reported academic scores on a five point scale to compare the academic improvement by using the VM. The quality of published articles can be further improved by standardizing of the research design and methodology for such an educational intervention. The NOS scale resulted in only four studies with a high score (six or seven stars) and 15 studies had a score above three stars. A total of 24 out of 39 studies had poor research design according to the NOS scale. As most educators and medical schools around the world use a wide spectrum of teaching methods along with diverse curricular designs, results for educational intervention impact will continue to be heterogeneous.
Nonetheless, this meta-analysis provides strong evidence that students prefer VM over LM (although it cannot be replaced completely) and exam performance also increased by using VM. The heterogeneity of results and different outcomes posed could be resolved in the future by introducing more subgroup analysis that would still need some homogeneous data set to work on.

5. Conclusions

This review highlights various advantages of VM compared to traditional LM for medical education. Most studies in this meta-analysis were pilot projects and first-time implementation of digital technology at various medical universities. Globally, VM and WSI technology have undoubtedly reshaped pathology teaching and learning in medical and dental schools. Use of VM in medical education has provided a venue for stimulated learning, improved student satisfaction and an overall better learning experience. Easy access to educational content and constant availability with online access are amongst the top advantages, whereas cost of implementation and access to the internet are still the most discussed disadvantages of such technology.
Availability of numerous free online VM resources has fueled global access to educational materials geared towards learning microscopy of normal tissue and pathological features of various human diseases. The ongoing COVID-19 pandemic has further fueled the need for digitization of teaching methods, particularly increased use of VM in medical education worldwide. As much of the current work on VM usage outcomes is from early technology implementation, a certain degree of enthusiastic bias in favor of VM is inevitable.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/diagnostics13030558/s1. Table S1: Themes depicting advantages/disadvantages of VM in comparison to LM; File S1: Newcastle—Ottawa Quality assessment scale case control studies; File S2: Thresholds for converting the Newcastle-Ottawa scales to AHRQ standards.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Camargo, C.P.; Tempski, P.Z.; Busnardo, F.F.; de Arruda Martins, M.; Gemperli, R. Online learning and COVID-19: A meta-synthesis analysis. Clinics 2020, 75, e2286. [Google Scholar] [CrossRef] [PubMed]
  2. Caruso, M.C. Virtual Microscopy and Other Technologies for Teaching Histology During COVID-19. Anat. Sci. Educ. 2020, 14, 19–21. [Google Scholar] [CrossRef] [PubMed]
  3. Cheng, X.; Chan, L.K.; Cai, H.; Zhou, D.; Yang, X. Adaptions and perceptions on histology and embryology teaching practice in China during the COVID-19 pandemic. Transl. Res. Anat. 2021, 24, 100115. [Google Scholar] [CrossRef]
  4. Retamero, J.A.; Aneiros-Fernandez, J.; del Moral, R.G. Complete Digital Pathology for Routine Histopathology Diagnosis in a Multicenter Hospital Network. Arch. Pathol. Lab. Med. 2019, 144, 221–228. [Google Scholar] [CrossRef]
  5. Volynskaya, Z.; Chow, H.; Evans, A.; Wolff, A.; Lagmay, T.C.; Asa, S.L. Integrated Pathology Informatics Enables High-Quality Personalized and Precision Medicine: Digital Pathology and Beyond. Arch. Pathol. Lab. Med. 2017, 142, 369–382. [Google Scholar] [CrossRef]
  6. Evans, A.J.; Brown, R.W.; Bui, M.M.; Chlipala, E.A.; Lacchetti, C.; Milner, D.A.; Pantanowitz, L.; Parwani, A.V.; Reid, K.; Riben, M.W.; et al. Validating Whole Slide Imaging Systems for Diagnostic Purposes in Pathology. Arch. Pathol. Lab. Med. 2022, 146, 440–450. [Google Scholar] [CrossRef]
  7. Jahn, S.W.; Plass, M.; Moinfar, F. Digital Pathology: Advantages, Limitations and Emerging Perspectives. J. Clin. Med. 2020, 9, 3697. [Google Scholar] [CrossRef]
  8. FDA Allows Marketing of First Whole Slide Imaging System for Digital Pathology. Available online: https://www.fda.gov/news-events/press-announcements/fda-allows-marketing-first-whole-slide-imaging-system-digital-pathology (accessed on 22 January 2022).
  9. Nauhria, S.; Hangfu, L. Virtual microscopy enhances the reliability and validity in histopathology curriculum: Practical guidelines. MedEdPublish 2019, 8, 28. [Google Scholar] [CrossRef]
  10. Boyce, B.F. An update on the validation of whole slide imaging systems following FDA approval of a system for a routine pathology diagnostic service in the United States. Biotech. Histochem. 2017, 92, 381–389. [Google Scholar] [CrossRef] [PubMed]
  11. Kumar, N.; Gupta, R.; Gupta, S. Whole Slide Imaging (WSI) in Pathology: Current Perspectives and Future Directions. J. Digit. Imaging 2020, 33, 1034–1040. [Google Scholar] [CrossRef]
  12. Araújo, A.L.D.; Arboleda, L.P.A.; Palmier, N.R.; Fonsêca, J.M.; de Pauli Paglioni, M.; Gomes-Silva, W.; Ribeiro, A.C.P.; Brandão, T.B.; Simonato, L.E.; Speight, P.M.; et al. The performance of digital microscopy for primary diagnosis in human pathology: A systematic review. Virchows Arch. 2019, 474, 269–287. [Google Scholar] [CrossRef] [PubMed]
  13. Wilson, A.B.; Taylor, M.A.; Klein, B.A.; Sugrue, M.K.; Whipple, E.C.; Brokaw, J.J. Meta-analysis and review of learner performance and preference: Virtual versus optical microscopy. Med. Educ. 2016, 50, 428–440. [Google Scholar] [CrossRef] [PubMed]
  14. Kuo, K.H.; Leo, J.M. Optical Versus Virtual Microscope for Medical Education: A Systematic Review. Anat. Sci. Educ. 2018, 12, 678–685. [Google Scholar] [CrossRef]
  15. Joaquim, D.C.; Hortsch, M.; Silva, A.S.R.d.; David, P.B.; Leite, A.C.R.d.M.; Girão-Carmona, V.C.C. Digital information and communication technologies on histology learning: What to expect?—An integrative review. Anat. Histol. Embryol. 2021, 51, 180–188. [Google Scholar] [CrossRef] [PubMed]
  16. Indu, M.; Rathy, R.; Binu, M.P. “Slide less pathology”: Fairy tale or reality? J. Oral Maxillofac. Pathol. 2016, 20, 284–288. [Google Scholar] [CrossRef]
  17. Saco, A.; Bombi, J.A.; Garcia, A.; Ramírez, J.; Ordi, J. Current Status of Whole-Slide Imaging in Education. Pathobiology 2016, 83, 79–88. [Google Scholar] [CrossRef] [PubMed]
  18. Sasongko, W.D.; Widiastuti, I. Virtual lab for vocational education in Indonesia: A review of the literature. In Proceedings of the The 2nd International Conference on Science, Mathematics, Environment, and Education; AIP Publishing: Long Island, NY, USA, 2019. [Google Scholar]
  19. Lujan, G.M.; Savage, J.; Shana’ah, A.; Yearsley, M.; Thomas, D.; Allenby, P.; Otero, J.; Limbach, A.L.; Cui, X.; Scarl, R.T.; et al. Digital Pathology Initiatives and Experience of a Large Academic Institution During the Coronavirus Disease 2019 (COVID-19) Pandemic. Arch. Pathol. Lab. Med. 2021, 145, 1051–1061. [Google Scholar] [CrossRef] [PubMed]
  20. Nauhria, S.; Ramdass, P. Randomized cross-over study and a qualitative analysis comparing virtual microscopy and light microscopy for learning undergraduate histopathology. Indian J. Pathol. Microbiol. 2019, 62, 84–90. [Google Scholar] [CrossRef]
  21. Balseiro, A.; Pérez-Martínez, C.; de Paz, P.; García Iglesias, M.J. Evaluation of the COVID-19 Lockdown-Adapted Online Methodology for the Cytology and Histology Course as Part of the Degree in Veterinary Medicine. Vet. Sci. 2022, 9, 51. [Google Scholar] [CrossRef]
  22. Samueli, B.; Sror, N.; Jotkowitz, A.; Taragin, B. Remote pathology education during the COVID-19 era: Crisis converted to opportunity. Ann. Diagn. Pathol. 2020, 49, 151612. [Google Scholar] [CrossRef]
  23. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]
  24. Rodrigues-Fernandes, C.I.; Speight, P.M.; Khurram, S.A.; Araújo, A.L.D.; Perez, D.E.d.C.; Fonseca, F.P.; Lopes, M.A.; de Almeida, O.P.; Vargas, P.A.; Santos-Silva, A.R. The use of digital microscopy as a teaching method for human pathology: A systematic review. Virchows Arch. 2020, 477, 475–486. [Google Scholar] [CrossRef] [PubMed]
  25. Mueen Ahmed, K.K.; Dhubaib, B.E.A. Zotero: A bibliographic assistant to researcher. J. Pharm. Pharm. 2022, 2, 304–305. [Google Scholar] [CrossRef]
  26. Luchini, C.; Stubbs, B.; Solmi, M.; Veronese, N. Assessing the quality of studies in meta-analyses: Advantages and limitations of the Newcastle Ottawa Scale. World J. Meta-Anal. 2017, 5, 80–84. [Google Scholar] [CrossRef]
  27. Andrade, C. Mean Difference, Standardized Mean Difference (SMD), and Their Use in Meta-Analysis. J. Clin. Psychiatry 2020, 81, 20f13681. [Google Scholar] [CrossRef]
  28. Higgins, J.P.T.; Thomas, J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. Cochrane Handbook for Systematic Reviews of Interventions; Wiley: Hoboken, NJ, USA, 2019. [Google Scholar]
  29. Van Enst, W.A.; Ochodo, E.; Scholten, R.J.P.M.; Hooft, L.; Leeflang, M.M. Investigation of publication bias in meta-analyses of diagnostic test accuracy: A meta-epidemiological study. BMC Med. Res. Methodol. 2014, 14, 70. [Google Scholar] [CrossRef]
  30. Aperio ImageScope—Pathology Slide Viewing Software. Available online: https://www.leicabiosystems.com/digital-pathology/manage/aperio-imagescope/ (accessed on 14 December 2022).
  31. Waugh, S.; Devin, J.; Lam, A.K.-Y.; Gopalan, V. E-learning and the virtual transformation of histopathology teaching during COVID-19: Its impact on student learning experience and outcome. BMC Med. Educ. 2022, 22, 22. [Google Scholar] [CrossRef]
  32. Sakthi-Velavan, S.; Zahl, S. Integration of virtual microscopy podcasts in the histology discipline in osteopathic medical school: Learning outcomes. Anat. Sci. Educ. 2022, 16, 157–170. [Google Scholar] [CrossRef]
  33. Ahmed, S.; Habib, M.; Naveed, H.; Mudassir, G.; Bhatti, M.M.; Ahmad, R.N. Improving Medical Students’ Learning Experience of Pathology by Online Practical Sessions through Virtual Microscopy. J. Rawalpindi Med. Coll. 2022, 26, 122–127. [Google Scholar] [CrossRef]
  34. Qing, J.; Cheng, G.; Ni, X.-Q.; Yang, Y.; Zhang, W.; Li, Z. Implementation of an interactive virtual microscope laboratory system in teaching oral histopathology. Sci. Rep. 2022, 12, 5492. [Google Scholar] [CrossRef]
  35. Francis, D.V.; Charles, A.S.; Jacob, T.M.; Ruban, A.; Premkumar, P.S.; Rabi, S. Virtual microscopy as a teaching–learning tool for histology in a competency-based medical curriculum. Med. J. Armed India 2022. [Google Scholar] [CrossRef]
  36. Nikas, I.P.; Lamnisos, D.; Meletiou-Mavrotheris, M.; Themistocleous, S.C.; Pieridi, C.; Mytilinaios, D.G.; Michaelides, C.; Johnson, E.O. Shift to emergency remote preclinical medical education amidst the COVID-19 pandemic: A single-institution study. Anat. Sci. Educ. 2022, 15, 27–41. [Google Scholar] [CrossRef] [PubMed]
  37. Zhong, Y.; Sun, W.; Zhou, L.; Tang, M.; Zhang, W.; Xu, J.; Jiang, Y.; Liu, L.; Xu, Y. Application of remote online learning in oral histopathology teaching in China. Med. Oral Patol. Oral Cir. Bucal 2021, 26, e533–e540. [Google Scholar] [CrossRef]
  38. Yakin, M.; Linden, K. Adaptive e-learning platforms can improve student performance and engagement in dental education. J. Dent. Educ. 2021, 85, 1309–1315. [Google Scholar] [CrossRef]
  39. Chang, J.Y.-F.; Lin, T.-C.; Wang, L.-H.; Cheng, F.-C.; Chiang, C.-P. Comparison of virtual microscopy and real microscopy for learning oral pathology laboratory course among dental students. J. Dent. Sci. 2021, 16, 840–845. [Google Scholar] [CrossRef] [PubMed]
  40. Darici, D.; Reissner, C.; Brockhaus, J.; Missler, M. Implementation of a fully digital histology course in the anatomical teaching curriculum during COVID-19 pandemic. Ann. Anat.-Anat. Anz. 2021, 236, 151718. [Google Scholar] [CrossRef]
  41. Tanaka, K.S.; Ramachandran, R. Perceptions of a Remote Learning Pathology Elective for Advanced Clinical Medical Students. Acad. Pathol. 2021, 8, 23742895211006846. [Google Scholar] [CrossRef]
  42. Tauber, Z.; Lacey, H.; Lichnovska, R.; Erdosova, B.; Zizka, R.; Sedy, J.; Cizkova, K. Students’ preparedness, learning habits and the greatest difficulties in studying Histology in the digital era: A comparison between students of general and dental schools. Eur. J. Dent. Educ. 2020, 25, 371–376. [Google Scholar] [CrossRef]
  43. Guiter, G.E.; Sapia, S.; Wright, A.I.; Hutchins, G.G.A.; Arayssi, T. Development of a Remote Online Collaborative Medical School Pathology Curriculum with Clinical Correlations, across Several International Sites, through the COVID-19 Pandemic. Med. Sci. Educ. 2021, 31, 549–556. [Google Scholar] [CrossRef]
  44. Somera dos Santos, F.; Osako, M.K.; Perdoná, G.d.S.C.; Alves, M.G.; Sales, K.U. Virtual Microscopy as a Learning Tool in Brazilian Medical Education. Anat. Sci. Educ. 2021, 14, 408–416. [Google Scholar] [CrossRef]
  45. Cruz, M.; Murphy, M.; Gentile, M.M.; Stewart, K.; Barroeta, J.E.; Carrasco, G.A.; Kocher, W.D.; Behling, K.C. Assessment of Pathology Learning Modules With Virtual Microscopy in a Preclinical Medical School Curriculum. Am. J. Clin. Pathol. 2021, 156, 794–801. [Google Scholar] [CrossRef] [PubMed]
  46. Sharma, R.; King, T.S.; Hanson, E.R.; Fiebelkorn, K. Medical Histopathology Laboratories: Remote Teaching in Response to COVID-19 Pandemic. Acad. Pathol. 2021, 8, 2374289521998049. [Google Scholar] [CrossRef] [PubMed]
  47. White, M.J.; Birkness, J.E.; Salimian, K.J.; Meiss, A.E.; Butcher, M.; Davis, K.; Ware, A.D.; Zarella, M.D.; Lecksell, K.; Rooper, L.M.; et al. Continuing Undergraduate Pathology Medical Education in the Coronavirus Disease 2019 (COVID-19) Global Pandemic: The Johns Hopkins Virtual Surgical Pathology Clinical Elective. Arch. Pathol. Lab. Med. 2021, 145, 814–820. [Google Scholar] [CrossRef] [PubMed]
  48. Lakhtakia, R. Virtual Microscopy in Undergraduate Pathology Education. Sultan Qaboos Univ. Med. J. SQUMJ 2021, 21, 428–435. [Google Scholar] [CrossRef] [PubMed]
  49. Liu, Q.; Sun, W.; Du, C.; Yang, L.; Yuan, N.; Cui, H.; Song, W.; Ge, L. Medical Morphology Training Using the Xuexi Tong Platform During the COVID-19 Pandemic: Development and Validation of a Web-Based Teaching Approach. JMIR Med. Inform. 2021, 9, e24497. [Google Scholar] [CrossRef]
  50. Simok, A.A.; Kasim, F.; Hadie, S.N.H.; Abdul Manan@Sulong, H.; Yusoff, M.S.B.; Mohd Noor, N.F.; Asari, M.A. Knowledge Acquisition and Satisfaction of Virtual Microscopy Usage Among Medical Students of Universiti Sains Malaysia. Educ. Med. J. 2021, 13, 43–55. [Google Scholar] [CrossRef]
  51. Manou, E.; Lazari, E.-C.; Thomopoulou, G.-E.; Agrogiannis, G.; Kavantzas, N.; Lazaris, A.C. Participation and Interactivity in Synchronous E-Learning Pathology Course During the COVID-19 Pandemic. Adv. Med. Educ. Pract. 2021, 12, 1081–1091. [Google Scholar] [CrossRef]
  52. Laohawetwanit, T. The use of virtual pathology in teaching medical students: First experience of a medical school in Thailand. MedEdPublish 2020, 9, 116. [Google Scholar] [CrossRef]
  53. Uraiby, H.; Grafton-Clarke, C.; Gordon, M.; Sereno, M.; Powell, B.; McCarthy, M. Fostering intrinsic motivation in remote undergraduate histopathology education. J. Clin. Pathol. 2021, 75, 837–843. [Google Scholar] [CrossRef]
  54. Ali, S.A.A.; Syed, S. Teaching and Learning Strategies of Oral Histology Among Dental Students. Int. J. Morphol. 2020, 38, 634–639. [Google Scholar] [CrossRef]
  55. Parker, E.U.; Chang, O.; Koch, L. Remote Anatomic Pathology Medical Student Education in Washington State. Am. J. Clin. Pathol. 2020, 154, 585–591. [Google Scholar] [CrossRef] [PubMed]
  56. Dennis, J.F. The HistoHustle: Supplemental Histology Sessions to Enrich Student Learning and Self-Efficacy. Med. Sci. Educ. 2020, 30, 1725–1726. [Google Scholar] [CrossRef] [PubMed]
  57. Bacha, D.; Ferjaoui, W.; Charfi, L.; Rejaibi, S.; Gharbi, L.; ben Slama, S.; Njim, L.; Lahmar, A. The interest of virtual microscopy as a means of simulation learning in pathological anatomy and cytology. Oncol. Radiother. 2020, 14, 23–29. [Google Scholar]
  58. Lee, B.C.; Hsieh, S.T.; Chang, Y.L.; Tseng, F.Y.; Lin, Y.J.; Chen, Y.L.; Wang, S.H.; Chang, Y.F.; Ho, Y.L.; Ni, Y.H.; et al. A Web-Based Virtual Microscopy Platform for Improving Academic Performance in Histology and Pathology Laboratory Courses: A Pilot Study. Anat. Sci. Educ. 2020, 13, 743–758. [Google Scholar] [CrossRef] [PubMed]
  59. Amer, M.; Nemenqani, D. Successful use of virtual microscopy in the assessment of practical histology during pandemic COVID-19: A descriptive study. J. Microsc. Ultrastruct. 2020, 8, 156–161. [Google Scholar] [CrossRef] [PubMed]
  60. Romeike, B.F.M.; Fischer, M. Buzz groups facilitate collaborative learning and improve histopathological competencies of students. Clin. Neuropathol. 2019, 38, 285–293. [Google Scholar] [CrossRef]
  61. King, T.S.; Sharma, R.; Jackson, J.; Fiebelkorn, K.R. Clinical Case-Based Image Portfolios in Medical Histopathology. Anat. Sci. Educ. 2019, 12, 200–209. [Google Scholar] [CrossRef]
  62. Husmann, P.R.; O’Loughlin, V.D. Another Nail in the Coffin for Learning Styles? Disparities among Undergraduate Anatomy Students’ Study Strategies, Class Performance, and Reported VARK Learning Styles. Anat. Sci. Educ. 2019, 12, 6–19. [Google Scholar] [CrossRef]
  63. Yohannan, D.G.; Oommen, A.M.; Umesan, K.G.; Raveendran, V.L.; Sreedhar, L.S.L.; Anish, T.S.N.; Hortsch, M.; Krishnapillai, R. Overcoming Barriers in a Traditional Medical Education System by the Stepwise, Evidence-Based Introduction of a Modern Learning Technology. Med. Sci. Educ. 2019, 29, 803–817. [Google Scholar] [CrossRef]
  64. Chen, C.P.; Clifford, B.M.; O’Leary, M.J.; Hartman, D.J.; Picarsic, J.L. Improving Medical Students’ Understanding of Pediatric Diseases through an Innovative and Tailored Web-based Digital Pathology Program with Philips Pathology Tutor (Formerly PathXL). J. Pathol. Inform. 2019, 10, 18. [Google Scholar] [CrossRef]
  65. Tauber, Z.; Cizkova, K.; Lichnovska, R.; Lacey, H.; Erdosova, B.; Zizka, R.; Kamarad, V. Evaluation of the effectiveness of the presentation of virtual histology slides by students during classes. Are there any differences in approach between dentistry and general medicine students? Eur. J. Dent. Educ. 2019, 23, 119–126. [Google Scholar] [CrossRef] [PubMed]
  66. Felszeghy, S.; Pasonen-Seppänen, S.; Koskela, A.; Nieminen, P.; Härkönen, K.; Paldanius, K.M.A.; Gabbouj, S.; Ketola, K.; Hiltunen, M.; Lundin, M.; et al. Using online game-based platforms to improve student performance and engagement in histology teaching. BMC Med. Educ. 2019, 19, 273. [Google Scholar] [CrossRef] [PubMed]
  67. Yazid, F.; Ghazali, N.; Rosli, M.S.A.; Apandi, N.I.M.; Ibrahim, N. The Use of Digital Microscope in Oral Pathology Teaching. J. Int. Dent. Med. Res. 2019, 12, 1095–1099. [Google Scholar]
  68. Lionetti, K.A.; Townsend, H. Teaching Microscopy Remotely: Two Engaging Options. J. Microbiol. Biol. Educ. 2022, 23, 1–3. [Google Scholar] [CrossRef]
  69. Clarke, E.; Doherty, D.; Randell, R.; Grek, J.; Thomas, R.; Ruddle, R.A.; Treanor, D. Faster than light (microscopy): Superiority of digital pathology over microscopy for assessment of immunohistochemistry. J. Clin. Pathol. 2022. [Google Scholar] [CrossRef] [PubMed]
  70. Samuelson, M.I.; Chen, S.J.; Boukhar, S.A.; Schnieders, E.M.; Walhof, M.L.; Bellizzi, A.M.; Robinson, R.A.; Rajan, K.D.A. Rapid Validation of Whole-Slide Imaging for Primary Histopathology Diagnosis. Am. J. Clin. Pathol. 2021, 155, 638–648. [Google Scholar] [CrossRef]
  71. Liscia, D.S.; Bellis, D.; Biletta, E.; D’Andrea, M.; Croci, G.A.; Dianzani, U. Whole-Slide Imaging Allows Pathologists to Work Remotely in Regions with Severe Logistical Constraints Due to COVID-19 Pandemic. J. Pathol. Inform. 2020, 11, 20. [Google Scholar] [CrossRef]
  72. Blum, A.E.; Murphy, G.F.; Lee, J.J. Digital dermatopathology: The time is now. J. Cutan. Pathol. 2021, 48, 469–471. [Google Scholar] [CrossRef] [PubMed]
  73. Alassiri, A.; Almutrafi, A.; Alsufiani, F.; Al Nehkilan, A.; Al Salim, A.; Musleh, H.; Aziz, M.; Khalbuss, W. Whole slide imaging compared with light microscopy for primary diagnosis in surgical neuropathology: A validation study. Ann. Saudi Med. 2020, 40, 36–41. [Google Scholar] [CrossRef]
  74. Ammendola, S.; Bariani, E.; Eccher, A.; Capitanio, A.; Ghimenton, C.; Pantanowitz, L.; Parwani, A.; Girolami, I.; Scarpa, A.; Barresi, V. The histopathological diagnosis of atypical meningioma: Glass slide versus whole slide imaging for grading assessment. Virchows Arch. 2020, 478, 747–756. [Google Scholar] [CrossRef]
  75. Babawale, M.; Gunavardhan, A.; Walker, J.; Corfield, T.; Huey, P.; Savage, A.; Bansal, A.; Atkinson, M.; Abdelsalam, H.; Raweily, E.; et al. Verification and Validation of Digital Pathology (Whole Slide Imaging) for Primary Histopathological Diagnosis: All Wales Experience. J. Pathol. Inform. 2021, 12. [Google Scholar] [CrossRef] [PubMed]
  76. Borowsky, A.D.; Glassy, E.F.; Wallace, W.D.; Kallichanda, N.S.; Behling, C.A.; Miller, D.V.; Oswal, H.N.; Feddersen, R.M.; Bakhtar, O.R.; Mendoza, A.E.; et al. Digital Whole Slide Imaging Compared With Light Microscopy for Primary Diagnosis in Surgical Pathology. Arch. Pathol. Lab. Med. 2020, 144, 1245–1253. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  77. Lam, A.K.; Leung, M. Whole-Slide Imaging for Esophageal Adenocarcinoma. In Esophageal Adenocarcinoma; Methods in Molecular Biology; Springer: Berlin/Heidelberg, Germany, 2018; pp. 135–142. [Google Scholar]
  78. Wang, C.; Wei, X.-L.; Li, C.-X.; Wang, Y.-Z.; Wu, Y.; Niu, Y.-X.; Zhang, C.; Yu, Y. Efficient and Highly Accurate Diagnosis of Malignant Hematological Diseases Based on Whole-Slide Images Using Deep Learning. Front. Oncol. 2022, 12, 879308. [Google Scholar] [CrossRef] [PubMed]
  79. Niazi, M.K.K.; Parwani, A.V.; Gurcan, M.N. Digital pathology and artificial intelligence. Lancet Oncol. 2019, 20, e253–e261. [Google Scholar] [CrossRef] [PubMed]
  80. Frazier, P.I.; Cashore, J.M.; Duan, N.; Henderson, S.G.; Janmohamed, A.; Liu, B.; Shmoys, D.B.; Wan, J.; Zhang, Y. Modeling for COVID-19 college reopening decisions: Cornell, a case study. Proc. Natl. Acad. Sci. USA 2022, 119, e2112532119. [Google Scholar] [CrossRef] [PubMed]
  81. Van Gaalen, A.E.J.; Brouwer, J.; Schönrock-Adema, J.; Bouwkamp-Timmer, T.; Jaarsma, A.D.C.; Georgiadis, J.R. Gamification of health professions education: A systematic review. Adv. Health Sci. Educ. 2020, 26, 683–711. [Google Scholar] [CrossRef]
  82. Bai, S.; Hew, K.F.; Gonda, D.E.; Huang, B.; Liang, X. Incorporating fantasy into gamification promotes student learning and quality of online interaction. Int. J. Educ. Technol. High. Educ. 2022, 19, 29. [Google Scholar] [CrossRef]
  83. Roth, J.; Chang, A.; Ricci, B.; Hall, M.; Mehta, N. Why Not a Podcast? Assessing Narrative Audio and Written Curricula in Obstetrical Neurology. J. Grad. Med. Educ. 2020, 12, 86–91. [Google Scholar] [CrossRef]
  84. Biolucida. Available online: https://www.mbfbioscience.com/biolucida (accessed on 14 December 2022).
  85. University of Michigan Virtual Slide Box. Available online: https://www.pathology.med.umich.edu/apps/slides/ (accessed on 14 December 2022).
  86. Virtual Pathology at the University of Leeds. Available online: https://www.virtualpathology.leeds.ac.uk/ (accessed on 10 October 2022).
  87. The Milestones Guidebook. Available online: https://www.acgme.org/globalassets/MilestonesGuidebook.pdf (accessed on 25 December 2021).
  88. Standards, Publications, & Notification Forms. Available online: https://lcme.org/publications/ (accessed on 10 January 2021).
  89. Hassell, L.A.; Fung, K.-M.; Chaser, B. Digital slides and ACGME resident competencies in anatomic pathology: An altered paradigm for acquisition and assessment. J. Pathol. Inform. 2011, 2, 27. [Google Scholar] [CrossRef]
Figure 1. Included 19 studies (PRISMA flow diagram).
Figure 1. Included 19 studies (PRISMA flow diagram).
Diagnostics 13 00558 g001
Figure 2. Pooled effect size of 19 studies [20,31,32,33,34,35,37,38,39,44,45,50,52,57,58,59,60,63,64].
Figure 2. Pooled effect size of 19 studies [20,31,32,33,34,35,37,38,39,44,45,50,52,57,58,59,60,63,64].
Diagnostics 13 00558 g002
Figure 3. Analysis of studies assessing subject-wise exam performance of students [20,31,32,33,34,35,37,38,39,44,45,50,52,57,58,59,60,63,64].
Figure 3. Analysis of studies assessing subject-wise exam performance of students [20,31,32,33,34,35,37,38,39,44,45,50,52,57,58,59,60,63,64].
Diagnostics 13 00558 g003
Figure 4. Overall analysis of 15 studies assessing exam performance among medical students [20,31,32,33,35,44,45,50,52,57,59,60,63,64].
Figure 4. Overall analysis of 15 studies assessing exam performance among medical students [20,31,32,33,35,44,45,50,52,57,59,60,63,64].
Diagnostics 13 00558 g004
Figure 5. Analysis of studies based on NOS scale quality [20,31,32,33,34,35,37,38,39,44,45,50,52,57,58,59,60,63,64].
Figure 5. Analysis of studies based on NOS scale quality [20,31,32,33,34,35,37,38,39,44,45,50,52,57,58,59,60,63,64].
Diagnostics 13 00558 g005
Figure 6. Publication bias (funnel plot).
Figure 6. Publication bias (funnel plot).
Diagnostics 13 00558 g006
Table 1. Characteristics of all included studies.
Table 1. Characteristics of all included studies.
Author and YearUniversity and LocationCourse Subject/Medical or DentalStudy DesignTotal ParticipantsVM Setup UsedConclusion/Results
Waugh S, 2022 [31]Griffith University,
Australia
Histopathology, medical studentsObservational case–control study150BEST slice cloud-based libraryA thematic analysis of the qualitative comments strongly indicated that online histopathology teaching was instrumental, more comfortable to engage in and better structured compared to face-to-face teaching. Compared to the prior cohort completing the same curriculum the mean overall mark was significantly improved.
Sakthi-Velavan S, 2022 [32]Marian University College of Osteopathic Medicine, USAHistology, medical studentsObservational case–control study477VM podcastMost students indicated that the podcasts enabled more efficient study time and improved their confidence in the histology content on examinations. A summary of students’ feedback and academic performance supported that integration of the VMPs into Histology teaching improved the learning experience. The findings align with previous studies on the effectiveness of multimedia-based teaching in histology laboratory modules. There was a significant difference between the average histology performance of earlier classes that did not have access to the VMPs versus the average performance of the classes that had access to the VMPs.
Ahmed S, 2022 [33]Shifa College of Medicine, PakistanPathology, 3rd-year medical studentsRandomized crossover control study111Not specifiedEvidence showed that the microscopic practical skills achieved by virtual microscopy are comparable to or even better than those achieved by light microscopy.
Qing J, 2022 [34]Wuhan University, ChinaHistopathology, dental studentsObservational case–control study156NanoZoomer Digital Pathology sofwareStudy compared results of assignments and exams between VM group and LM group and a questionnaire survey was used to collect feedback. Results showed an increase laboratory final test grades increased and the feedback of the questionnaire was positive, indicating that students were satisfied with the system. This study concluded that VM is an efficient and feasible teaching technology and improves students’ academic performance.
Francis DV, 2022 [35]Christian Medical College, Vellore, IndiaHistology, medical studentsObservational case–control study100 (cohort one), 99 (cohort 2)VM software-Open Microscopy Environment Remote Objects (OMERO), University of Dundee, UK. WSI scanner-Digiscan (https://digiscan.co.in/)Majority students were reported to be enthusiastic about using VM. Some of the benefits of VM as cited by the students were the ease of usage, annotations, the superior quality of images, accessibility to slides outside of lab time, in class internet access to additional learning material, promotion of self-learning and efficient use of their study time. Performance score analysis showed a statistically significant improvement of grades in the VM arm.
Nikas IP, 2021 [36]School of Medicine, European University,
Cyprus
Histology and pathology, medical studentsCross-sectional surveys173Websites e.g.,
Michigan Histology and Virtual Microscopy Learning Resources
Both histology and pathology online delivery was well-accepted by most medical students. Pathology students and students with high final examination scores perceived their virtual education more favorably.
Zhong Y, 2021 [37]Nanjing Medical
University, China
Histopathology, dental studentsComparative cross-sectional192NanoZoomer Digital PathologyThe mean scores of the online group (VM) were significantly higher than those of the traditional group (LM). Furthermore, both remote learning and virtual microscopy courses were well accepted by students according to the questionnaire.
Yakin M, 2021 [38]Adelaide Dental School, University
of Adelaide, Australia
Histology, year 1 and year 3,
dental students
Comparative prospective cohort study43Biomedical Education Skills and Training network (www.best.edu.au)Students obtained significantly higher scores in experimental exam questions than control exam questions. A significantly larger number of students perceived that the adaptive lessons improved their knowledge of the subject.
Chang JYF, 2021 [39]National Taiwan University, TaiwanOral pathology, dental studentsComparative cross-sectional38Dot-slide system developed by Soft Imaging System GmbH (Olympus Deutschland GmbH, Hamburg, Germany)Results showed a significantly higher acceptance rate and a significantly better histopathological diagnosis ability among dental students using the virtual slide learning than those using the glass-slide learning for the oral pathology laboratory course.VM with digitized virtual slides may gradually replace the real microscopy with glass slides for the learning of oral pathology laboratory course.
Darici D, 2021 [40]Westfälische-Wilhelms-University, GermanyHistology, preclinical medical studentsCross-sectional cohort study400Custom histology software-Virtuelle MikroskopieThe study concluded that the implementation of a curricular histology course in an online-format is technically realizable, effective and well accepted among students. The study also reported that availability and prior experience with digitized specimen in VM facilitates transition into an online-only setting.
Tanaka KS, 2021 [41]University of California, USAPathology, fourth year medical studentsCross-sectional cohort study37Custom UCSF digital libraryEnd-of-rotation data showed the remote pathology course performed well when compared to the traditional in-person pathology elective. Core strengths highlighted in this study include a high educational value, flexibility of content and schedule, organization, tailoring to an individual’s learning goals and a positive education environment. Drawbacks were the inability to gross surgical specimens, inadequate observation or feedback about students’ skills, and impaired social connections.
Tauber Z, 2021 [42]Palacky University, Czech RepublicHistology, dental studentsStructured questionnaire82 Dentistry, 192 General medicineNot mentionedAll students in this study indicated that they prefer the use of VM or the combination of VM together with the examination of glass mounted specimens by microscope.
Guiter GE, 2021 [43]Weill Cornell Medicine, QatarPathology, medical studentsCross-sectional surveys29University of Leeds’ Virtual Pathology LibraryStudents conveyed high levels of satisfaction about the elective’s overall quality, their pathology learning and online interactions, with minimal challenges related to the remote nature of the course.
Somera dos Santos F, 2021 [44]Ribeirao Preto Medical School, BrazilHistology, medical studentsCross-sectional Cohort study189NanoZoomer S60 digital whole slide scannerThe study reported positive subjective feedback related to handling, suitability, learning effectiveness, and pleasure using the tools for VM. Although no statistically significant differences were found between groups for academic performance, VM proved to be adequate to the Brazilian medical education in light of Brazilian social contexts and COVID-19 pandemic.
Cruz M, 2021 [45]Cooper Medical School of Rowan University, USAPathology, medical studentsComparative cross-sectional44Web-basedprogram (Aperio)VM could help first- and second-year medical students understand case-based scenarios and clinical pathology more deeply than photomicrographs, particularly with direct faculty support for navigating virtual slides. Participation in and completion of pathology-VM learning modules enhances student learning of pathology-related topics.
Sharma R, 2021 [46]School of Medicine, University of Texas Health San Antonio, USAHistopathology, medical studentsCross-sectional cohort study215 (MS1); 207 (MS2)Not specifiedMajority students agreed that the VM helped in their learning. Students performed better in module examinations in 2020 than in the previous years.
White MJ, 2021 [47]Johns Hopkins University, USAPathology, medical studentsCross-sectional surveys43Leica Aperio AT and Roche iScan HTMost students provided positive objective feedback related to VM use.
Lakhtakia R, 2021 [48]Mohammed Bin Rashid University of Medicine and
Health Sciences, UAE
Pathology, medical studentsCross-sectional surveys49Cirdan PathXL Tutor, Lisburn, IrelandVM usage was reported as a user-friendly resource that helped students develop a strong clinical foundation and clinico-pathological correlation. High student attendance and improved assessment scores on critical thinking were observed. Easy access was a significant student-centric advantage reported by this study.
Liu Q, 2021 [49]Shandong First Medical University, ChinaHistology, embryology and pathology, medical studentsObservational case–control study512Medical Morphology Digital Teaching SystemWith regard to the teaching performance of VM based teaching, students demonstrated a high degree of satisfaction. Majority students achieved high scores in the web-based learning group than in the offline learning control group.
Simok AA, 2021 [50]Universiti Sains, MalaysiaHistology, medical studentsRandomized control study120Pannoramic viewer VM software by 3DHISTECH Ltd.The VM group had a significantly higher satisfaction score towards the learning tool than the LM group. The knowledge acquisition of the VM group was equal to the LM group as they were shown to have a similar improvement in the test scores, comprehension level and learning ability. The study revealed a significant improvement in test scores for VM.
Manou E, 2021 [51]National and Kapodistrian
University of Athens, Greece
Pathology, medical studentsObservational cohort study91e-learning platform HIPON (HistoPathology Online)The study concluded that further research to enhance understanding of the aspects of the e-learning environment towards the formulation
of policies for higher-quality education is needed.
Laohawetwanit T, 2021 [52]Thammasat University, ThailandPathology, second year medical studentsObservational case–control study29PathPresenterThere was a significant improvement between student pre-test scores and post-test scores. VM was viewed as a preferred learning modality, mainly because of its portability, satisfactory quality of images, permitting learning in less time, and stimulating cooperation between students while improving interaction with teachers.
Uraiby H, 2021 [53]University Hospitals of Leicester, UKHistopathology, medical studentsCross-sectional surveys90VM software-Philips Xplore, WSI scanner-Hamamatsu NanoZoomer S210Study showed a significant improvement in interest, confidence and competence in histopathology. The mean performance scores were significantly increased.
Ali SAA, 2020 [54]King Khalid University, Saudi ArabiaHistology, dental studentsCross-sectional surveys129Not specifiedMajority students reported that using VM for practical training sessions makes the oral histology course easier and more interesting.
Samueli B, 2020 [22]Ben Gurion University of the Negev, IsraelPathology, medical studentsCross-sectional surveys59VM software-CaseViewer (3DHistech, Budapest) and Aperio ImageScope (Leica, Illinois). WSI scanner-Pannoramic MIDI automated digital slide scanner (3DHistech, Budapest).Study reported an overall favorable response on questions relating to course interest and improvement in understanding of the covered diseases. The most significant disadvantage was technical challenges in accessing the slides.
Parker EU, 2020 [55]University of Washington School of Medicine, USAPathology, medical studentsStructured questionnaire survey70PathPresenterThe study reported an overwhelmingly positive result regarding understanding of pathology concepts as well as attitudes toward pathology.
Dennis JF, 2020 [56]Kansas City University, USAHistology and pathology, medical studentsCross-sectional surveys200Virtual Microscopy Database (VMD)VM use improved student attitudes towards histology content and had a positive impact on student-faculty rapport. Students self-reporting an increased comfortability and understanding with differential diagnosis suggested a strengthening of self-efficacy skills.
Bacha D, 2020 [57]University of Tunis El Manar, TunisiaPathology, medical studentsObservational cohort study45Not specifiedThis study reported that performance of the VM is comparable to that of the LM. Thus, VM could serve as an alternative tool to LM in teaching students’ general pathological anatomy.
Lee BC, 2020 [58]National Taiwan University, TaiwanHistology and pathology, medical and dental studentsObservational case–control study649EBM Technologies Inc., TaiwanThe study reported a positive effect of the VM platform on laboratory test Grades was associated with prior experience using the VM platform and was synergistic with more interim tests. Both teachers and students agreed that the VM platform enhanced laboratory learning. The incorporation of the VM platform in the context of test-enhanced learning may help more students master microscopic laboratory content.
Amer MG, 2020 [59]Taif University, Saudi ArabiaHistology, medical studentsCross-sectional surveys166VM software-Aperio’s ImageScope. WSI scanner-Aperio AT2 High Volume (Leica Biosystems).The study used VM during online objective structural practical examination (OSPE) of 3rd year medical students. The net students feedback was positive and the students recorded the easy image access at any time and place with
VM as the most distinctive feature.
Romeike BFM, 2019 [60]Jena University Hospital, GermanyHistopathology, medical studentsObservational case–control study140Not specifiedThis study reported impact of VM use in collaborative “buzz groups’ and showed an overall improvement of the histopathological competencies. The course also increased the appreciation of students for histopathology.
King TS, 2019 [61]UT-Health,
San Antonio, USA
Histology and pathology, medical studentsObservational case–control study220VM software-Biolucida (MicroBrightField Bioscience). WSI scanner-BLiSSTM-200 (MicroBrightField Bioscience)The study concluded that VM promoted understanding and encouraged discussion of the topics covered during the week and that group members worked well together and contributed to the completion of the portfolios. Performances
on the Histology and Cell Biology and Pathology sections on the United States Medical Licensing Examination (USMLE) remained consistent and in line with national averages.
Husmann PR, 2019 [62]Indiana University School of Medicine, Indiana, USAAnatomy, medical studentsCross-sectional surveys426Bacus Laboratories (Olympus, 2008)Statistically significant positive correlations were found with use of VM suggesting that increased use of these resources was more common in students with higher exam scores in the class.
Yohannan DG, 2019 [63]Government Medical College, Thiruvananthapuram, IndiaHistopathology, first year medical studentsNonrandomized controlled trial with a crossover design200VM software-Aperio’s ImageScopeMajority students agreed that VM made them understand histology better than LM. Almost 90% students agreed that they preferred VM for viewing a histology slide. A paired t test indicated that the histology knowledge of the students of both control and test groups significantly improved.
Chen CP, 2019 [64]University of Pittsburgh School of Medicine, USAPathology, medical studentsObservational case–control study123 control group and 164 test groupTutor (Philips Pathology, Amsterdam, Netherlands), formerly PathXLThe majority students responded positively that the test questions improved their understanding of pediatric diseases (75%) and test questions were helpful in assessing their knowledge of the pediatric pathology (90%), and relative ease of use for the Tutor program (80%).
Nauhria S, 2019 [20]Windsor University School of Medicine, St. Kitts and NevisPathology, second year medical studentsRandomized crossover control study152VM software-Aperio’s ImageScope.
WSI-IOWA Virtual Slide Box
A majority (83%) of the students preferred to use VM over LM. Students who used VM scored significantly higher in the crossover study compared to those who used LM. This study concluded that using VM to learn histopathology significantly increased student learning and performance compared to using LM.
Tauber Z, 2019 [65]Palacky University, Czech RepublicHistology, dentistry and general medicine studentsObservational case–control study82 dentistry and 126
general medicine students
Not specifiedThis study reported that a combination of both electronic materials (VM) and textbooks was commonly used by students with electronic resources being used regularly by the majority of students. No statistically relevant differences were found between the approaches of dentistry versus general medicine students. Cooperation amongst students for individual presentations was seen to be beneficial by a majority of dentistry students.
Felszeghy S, 2019 [66] University of Eastern Finland, FinlandHistology, medical and dental studentsCross-sectional surveys160Whole-slide imaging platform (Aiforia, Fimmic Oy, Finland).In the open-ended survey, most students viewed collaborative team- and gamification-based learning positively.
Yazid F, 2019 [67]Universiti Kebangsaan Malaysia, MalaysiaOral pathology, fourth year dentistry studentsObservational case–control study53VM software-OlyVIA viewer. WSI-Precipoint M8 microscopescanner.A majority of students preferred VM over LM and agreed that DM was effective for the course purpose. For the diagnosis exercise, all participants managed to answer correctly using VM compared to LM. Thus, indicating that VM should certainly be integrated as a teaching tool to enhance the learning process within the dental curriculum.
Table 2. Summary of quality assessment of cohort studies using NOS scale.
Table 2. Summary of quality assessment of cohort studies using NOS scale.
SelectionComparabilityOutcomes
Author, YearRepresentation of SampleSelection of the Non-Exposed CohortAscertainment of ExposureDemonstration That Outcome of Interest was not Present at Start of StudyComparability of Cohorts on the Basis of the Design or Analysis Controlled for ConfoundersAssessment of OutcomeWas Follow-up Long Enough for Outcomes to OccurAdequacy of Follow-up of Cohorts
Truly representativeSomewhat representativeDrawn from the same community as the exposed cohortDrawn from a different sourceSecure record (e.g., surgical record) Structured interviewYes The study controls for age, sex and marital statusStudy controls for other factors Independent blind assessmentRecord linkageYes Complete follow up- all subject accounted forSubjects lost to follow-up unlikely to introduce bias; number lost less than or equal to 20% or description of those lost suggested no different from those followed
Darici D, 2021 [40]* * * * * *
Tauber Z, 2021 [42] * * * **
Somera dos Santos F, 2021 [44]* * * ** **
Cruz M, 2021 [45] * * **** **
Sharma R, 2021 [46] * * * **
Liu Q, 2021 [49]* * * ** **
Lee BC, 2020 [58]* * ** ** **
Yohannan DG, 2019 [63] ** *** ***
Sakthi-Velavan S, 2022 [32] ** * * ***
Table 3. Summary of quality assessment of cross-sectional studies using the NOS scale.
Table 3. Summary of quality assessment of cross-sectional studies using the NOS scale.
Author, YearSelectionComparabilityOutcome
Sample RepresentationSample Size JustifiedNon-RespondentsAscertainment of the ExposureImportant Confounding Factors ControlledStudy Control for any Additional FactorsOutcome AssessmentStatistical Test
All Subjects/Random SamplingNon-Random Sampling Validated Measurement Tool. **Non-Validated Measurement Tool, but the Tool is Available or Described. * Independent Blind Assessment/Record Linkage. **Self-Report *
Nikas IP, 2021 [36] * ** ** *
Chang JYF, 2021 [39] * *** *
Tanaka KS, 2021 [41] * * **
Guiter GE, 2021 [43] * * * *
White MJ, 2021 [47] * * *
Yakin M, 2021 [38] * *
Lakhtakia R, 2021 [48] * *
Uraiby H, 2021 [53] *
Samueli B, 2020 [22] * *
Bacha D, 2020 [57] * **
Amer M, 2020 [59] * *** *** *
Ali SAA, 2020 [54]* * **
Romeike BFM, 2019 [60]***** *** *
Tauber Z, 2019 [65] * * *
King TS, 2019 [61] * * ** *
Husmann PR, 2019 [62]
Felszeghy S, 2019 [66]* * ** **
Manou E, 2021 [51] * *
Yazid F, 2019 [67]
Laohawetwanit T, 2021 [52] * * ***
Table 4. The summary of quality assessment of randomized controlled studies using NOS scale.
Table 4. The summary of quality assessment of randomized controlled studies using NOS scale.
Author, YearSelectionComparabilityExposure
Adequate Case DefinitionCase RepresentativenessSelection of ControlDefinition of ControlImportant Study ControlStudy Controls for any Additional FactorsAscertainment of ExposureSame Method of Ascertainment for Cases and ControlsNon-Response Rate
Nauhria S, 2019 [20]***** ***
Simok, A.A. 2021 [50]**** ****
Ahmed S, 2022 [33]** * ***
Table 5. Summary of quality assessment of case–control studies using the NOS scale.
Table 5. Summary of quality assessment of case–control studies using the NOS scale.
Author, YearSelectionComparabilityExposure
Adequate Case Definition (Yes, with Independent Validation)Case representativeness (Consecutive or Obviously Representative Series of Cases)Selection of Control (Community Controls)Definition of Control: no History of Disease (Endpoint)Important Study ControlStudy Control for any Additional FactorsAscertainment of ExposureSame Method of Ascertainment for Cases and ControlsNon-Response Rate
Waugh S, 2022 [31]*** ***
Zhong Y, 2021 [37] **** **
Chen CP, 2019 [64]* * ****
Sakthi-Velavan S, 2022 [32]
Yazid F, 2019 [67]* * ***
Qing J, 2022 [34]*** * ***
Francis DV, 2022 [35]**** ****
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Maity, S.; Nauhria, S.; Nayak, N.; Nauhria, S.; Coffin, T.; Wray, J.; Haerianardakani, S.; Sah, R.; Spruce, A.; Jeong, Y.; et al. Virtual Versus Light Microscopy Usage among Students: A Systematic Review and Meta-Analytic Evidence in Medical Education. Diagnostics 2023, 13, 558. https://doi.org/10.3390/diagnostics13030558

AMA Style

Maity S, Nauhria S, Nayak N, Nauhria S, Coffin T, Wray J, Haerianardakani S, Sah R, Spruce A, Jeong Y, et al. Virtual Versus Light Microscopy Usage among Students: A Systematic Review and Meta-Analytic Evidence in Medical Education. Diagnostics. 2023; 13(3):558. https://doi.org/10.3390/diagnostics13030558

Chicago/Turabian Style

Maity, Sabyasachi, Samal Nauhria, Narendra Nayak, Shreya Nauhria, Tamara Coffin, Jadzia Wray, Sepehr Haerianardakani, Ramsagar Sah, Andrew Spruce, Yujin Jeong, and et al. 2023. "Virtual Versus Light Microscopy Usage among Students: A Systematic Review and Meta-Analytic Evidence in Medical Education" Diagnostics 13, no. 3: 558. https://doi.org/10.3390/diagnostics13030558

APA Style

Maity, S., Nauhria, S., Nayak, N., Nauhria, S., Coffin, T., Wray, J., Haerianardakani, S., Sah, R., Spruce, A., Jeong, Y., Maj, M. C., Sharma, A., Okpara, N., Ike, C. J., Nath, R., Nelson, J., & Parwani, A. V. (2023). Virtual Versus Light Microscopy Usage among Students: A Systematic Review and Meta-Analytic Evidence in Medical Education. Diagnostics, 13(3), 558. https://doi.org/10.3390/diagnostics13030558

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop