Next Article in Journal
Insights into the Novel Therapeutics and Vaccines against Herpes Simplex Virus
Next Article in Special Issue
Parental COVID-19 Vaccine Hesitancy for Children and Its Influencing Factors: A Riyadh-Based Cross-Sectional Study
Previous Article in Journal
Information-Seeking Behavior for COVID-19 Boosters in China: A Cross-Sectional Survey
Previous Article in Special Issue
Understanding the Impact of General Vaccine Attitudes on the Intent for Early COVID-19 Vaccination
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Assessment of Innovative High-Fidelity Simulation Vaccination Course Integrating Emergency Cases for Pharmacy Undergraduates—A Randomized Controlled Study

by
Shahzad Ahmad Sayyed
1,*,
Ahmed Reda Sharkas
1,
Bushra Ali Sherazi
1,2,
Armin Dabidian
1,
Holger Schwender
3 and
Stephanie Laeer
1
1
Institute of Clinical Pharmacy and Pharmacotherapy, Heinrich Heine University Duesseldorf, Universitaetsstrasse 1, 40225 Duesseldorf, Germany
2
Institute of Pharmacy, Faculty of Pharmaceutical and Allied Health Sciences, Lahore College for Women University, Lahore 54000, Pakistan
3
Mathematical Institute, Heinrich Heine University Duesseldorf, Universitaetsstrasse 1, 40225 Duesseldorf, Germany
*
Author to whom correspondence should be addressed.
Vaccines 2023, 11(2), 324; https://doi.org/10.3390/vaccines11020324
Submission received: 29 December 2022 / Revised: 20 January 2023 / Accepted: 29 January 2023 / Published: 31 January 2023

Abstract

:
Recently, pharmacists in Germany were allowed to administer influenza and COVID-19 vaccines for people aged 12 years and older in order to increase vaccination coverage rates. In order to adapt the pharmacy curriculum for clinical practice, an innovative, vaccination training course using a high-fidelity simulator (HFS) was developed, implementing clinical scenarios to manage adverse events. In a randomized controlled trial using a pre and post design with pharmacy undergraduates, the intervention group interacted with an HFS, while the control group was trained with low-fidelity injection pads. Before and after the respective training, each participant went through an objective structured clinical examination (OSCE) and completed a self-assessment questionnaire and knowledge quiz. Both training methods showed a significant increase in skills, but there was also a significant greater increase in the intervention group when compared to the control group, particularly with respect to the vaccination process. Furthermore, every individual in the intervention group improved from the pre- to post-training OSCEs. Therefore, HFS has been proven to be an appropriate tool to train pharmacy students for the purposes of vaccine administration and to prepare for future challenges. Particularly, recognizing and managing adverse reactions can be addressed in a very effective way.

1. Introduction

Vaccination is the best and most successful method with respect to preventing infectious diseases [1]. In addition to reducing significant morbidities, disabilities, and mortalities, extensive immunization also possesses non-health benefits, such as improved cost-effectiveness, less of a disease burden, and increased educational achievements among children—due to their subsequent improved health [2,3,4,5]. There has been a substantial need for mass vaccinations since the COVID-19 pandemic began [6,7]. Similar to actions taken against other infectious diseases, immunizing a large number of people through numerous vaccinations is the main purpose. Furthermore, the immunization process is conducted for multiple reasons, including protecting those who cannot receive immunizations [8,9]. A vaccine coverage rate of 60–70% for COVID-19 was initially estimated, although this estimate was subject to change once cases of waning immunity as well as reinfections were reported [9,10]. Therefore, in response to this issue, it was recommended to perform repetitive booster shots [10,11]. As of October 2022, 64.8 million people (77.8% of the population) have received at least one vaccination dose in Germany. Of these, 63.5 million people (76.3%) have already received basic immunization. A total of 51.8 million people (62.2%) have also received a booster vaccination. Moreover, a sum of 8.3 million people (10.0%) have already received a second booster vaccination [12]. Currently, further vaccination is recommended for special population groups, such as people over 60, as well as immunocompromised persons or those working in healthcare institutions [11].
In order to address this demand for immunizations, physicians, veterinarians, dentists, and pharmacists were all asked to support the vaccination program in Germany [13]. However, in contrast to other countries—such as Argentina, the US, the UK, and Portugal—German pharmacists were not authorized to administer vaccines until 2020 [14,15]. It was only until recently, in 2020, that special pharmacist groups were authorized to vaccinate for flu in Germany [16,17]. This was allowed due to the successful vaccination programs that were implemented in about 26 countries around the world [15]. The legal stipulations for immunization administration in pharmacies were established in Argentina as early as 1983. Moreover, in 1996, pharmacists were authorized to administer the influenza vaccine in 14 American states. Pharmacy-based immunization was first introduced in Europe by the UK in 2002, followed by Portugal and Ireland [14]. The influenza vaccination is the most common vaccine administered by pharmacists worldwide [15]. The reason for this is due to the fact that influenza causes local outbreaks and seasonal epidemics all over the world. These outbreaks and epidemics occur due to the constant changes in the viral genome. As such, new vaccines are required and are approved every year, due to demand with respect to an annual booster vaccination [18]. Most pharmacists support the WHO’s target of a 75% vaccination rate for people aged 65 and over or for other risk groups [19,20]. This is due to the fact that retail pharmacies are considered to be the most accessible health care facilities [21]. It must be noted that the involvement of pharmacists in the vaccination process has resulted in an increased coverage rate, awareness, and education [22,23,24,25]. This was most particularly the case for those groups of people who cannot, or do not, want to be reached by conventional means [26].
In order to meet these—as well as future—challenges, vaccination administration training should be implemented into the curriculum of pharmaceutical education. Currently, pharmacists in at least 13 countries are required to complete additional training with respect to vaccination administration [14]. For instance, Australia and the USA have included teaching content related to immunization in the pharmacy curriculum [27,28]. The efficacy of a university course for the purposes of training pharmacy students in vaccine administration has been demonstrated and evaluated by many studies [29,30,31,32]. However, in Germany, additional training with defined content has been offered recently for the purposes of training pharmacists in a continuous education and training program [17]. The training covers the following areas: practical administration of the vaccination; obtaining patient information and consent; observing contraindications; as well as recognizing emergency situations and their measures [16]. The course consists of a theoretical and practical part, in which the injection is performed on a low-fidelity simulator (LFS)—i.e., a model arm or wearable pad with a tissue-like structure (Figure 1). In addition, participants have the option to perform an injection with a sodium chloride solution on a real person after obtaining consent, and the entire course is supervised by a trained doctor.
Using simulation in the training of clinical skills can lead to improved knowledge, performance, and satisfaction among students and health-care professionals [33,34]. Further, high-fidelity simulation (HFS) is the most cutting-edge simulation technique currently available, whereby a mannequin is operated on via the use of a software that is utilized in order to simulate changes in physiological parameters [35] (Figure 2). HFS is intended to aid with developing practice and to demonstrate clinical skills (such as patient handling in critical situations or patient safety awareness in a risk-free and controlled environment [35]). This kind of simulation is already being utilized in medical and nursing education [36,37] and is also being utilized in pharmacy education in order to train various clinical skills, as well as to enhance student competence and knowledge [38,39,40]. The impact of this type of clinical skills training can be measured by the objective structured clinical examination (OSCE), which is a common and established method of assessing clinical skills [41,42,43].
Traditional pharmacy education regarding vaccines only provides didactic knowledge about vaccines and their administration. The authors were not aware of any practical vaccination training courses that were available to pharmacy students at German universities. Neither were there any documented evidence on the integration and impact of HFS for the purposes of training pharmacy students’ vaccination administration skills, nor in regard to the simulation of various emergency scenarios. Therefore, in the present study, the aim is to develop an innovative training course with an HFS approach that integrates emergency handling. In addition, whether the HFS leads to better performance in comparison to the standard training (which utilizes LFS) is investigated; further, this was achieved by using an analytical checklist for the purposes of evaluation. The primary endpoint is, therefore, to demonstrate the difference in performance; additionally, the secondary endpoint is to demonstrate the variations in the participants’ self-assessment and knowledge scores, if any. In this paper, we would like to present our work and have arranged this into methods, results and the following discussion.

2. Materials and Methods

2.1. Study Design and Participants

A pre and post randomized controlled trial with pharmacy students was conducted in order to investigate the effect of the HFS training approach on vaccination administration skills. This was then followed by an OSCE evaluation. The investigation was carried out, in German, from November 2021 to December 2021 as part of the “Clinical Pharmacy” course in the winter semester of 2021/2022. All the data were collected in pseudonymous form and were anonymized in the following analysis. In addition, approval of this study was granted by the responsible ethics committee (Nr.: 2021–1689). In October 2021, 46 fourth-year pharmacy students were invited to participate in the study at the Heinrich-Heine-University in Duesseldorf. After completing the informed consent procedure, participants were randomized either into a control group or into an intervention group using RStudio (Version 1.4.1106) [44]. Participants were first sorted alphabetically and pseudonymized with “WS01” in increasing order. Then, the function “sample()” in the statistical software environment R was used to assign the participants to two equally sized groups A and B, where A was the control group and B the intervention group. Further, the overall study design is illustrated in Figure 3.

2.2. Study Procedure

At the beginning, an introductory lecture on influenza vaccination was conducted in order to ensure the same level of theoretical knowledge among all students. The contents included background information on the influenza virus and influenza vaccination; worldwide community pharmacy-based vaccination practices; the current status and legal requirements for vaccination administration in Germany; and the possible role of a community pharmacist. On the same day, the participants were informed in detail about the study and the consent forms for participation were then distributed. After 4 weeks, the participants completed a pre-training OSCE, a multiple-choice test, and a self-assessment questionnaire. In the next week, the respective vaccination administration training was conducted, which included emergency scenarios that was initiated for both groups. The control group received the standard training by using injection pads. The intervention group was trained via undertaking the HFS approach [45]. Finally, one week later, the participants completed a post-training OSCE, a second multiple-choice test, and another self-assessment questionnaire.

2.3. Objective Structured Clinical Examination

Participants were assessed individually with respect to vaccination administration through pre- and post-training OSCEs. This was conducted with an intent to measure any differences in performance, if present. Five OSCE cases were prepared and reviewed by faculty members during focused group discussions. During the OSCEs, each participant was required to simulate a pharmacy-based vaccination administration process involving a standardized patient and was assessed by an observer who utilized an analytical checklist. A pharmacy-like environment was created for this purpose, where all necessary items were available. Participants were provided with individual time slots and received a brief description of the whole simulation process after registration. An OSCE lasted a maximum of 12 min. Faculty members and eighth-semester pharmacy students, who did not participate in the study, were trained and instructed to serve either as standardized patients or as observers. Standardized patients were replaced after each OSCE, while observers were replaced after every five OSCEs. After obtaining the participants’ consent, certain OSCEs were recorded for quality assurance purposes. Randomly selected videos were then evaluated independently by two faculty members and the checklist scores were adjusted, as necessary.

2.4. Training Sessions

The 2.5 h-long training sessions were conducted separately for each study group. Both groups received blended theoretical and practical training with respect to anamnesis; patient education and information; vaccination preparation and administration; potential emergency situations; and the necessary measures to deal with them. The control group was trained in vaccination administration skills via the standard approach using LFS, i.e., utilizing injection pads. The intervention group interacted with an HFS and injected the vaccine intramuscularly. In addition, participants could talk directly to the HFS via an integrated microphone. A faculty member controlled the simulator remotely and responded to the participants. Further, various emergency scenarios were simulated by changing vital parameters through an in-built software program.

2.5. Instruments

2.5.1. High- and Low-Fidelity Simulator

For the purposes of training participants’ vaccination administration skills, two different kinds of simulators were employed. The control group practiced intramuscular injection using a wearable LFS injection pad with a tissue-like structure (Erler-Zimmer Impftrainer; Figure 1); it must be noted that, currently, standard training uses simulators of this kind. In order to simulate the insertion of a needle into tissue, the injection pad enables for proper placement around the arm, as well as simulating the actual depth of injection and withdrawal of the needle. The intervention group completed the vaccination administration training on an HFS (Gaumard HAL® S1000; Figure 2). The simulator can be operated on by an in-built software and includes various controllable features. Important features include palpable pulse, heart and lung sounds, chest and abdominal movements, and an attached cuff for blood pressure measurement. A built-in microphone allows a person to speak directly through the mannequin to communicate with participants. An intramuscular injection can be performed on the upper arm. Changes of vital parameters, such as heart/respiratory rate or blood pressure, can be transferred either immediately or after specified time on the simulator.

2.5.2. Cases for OSCEs

Five different patient cases with emergency scenarios were developed and reviewed by faculty members during focused discussion groups and faculty meetings. The emergency scenarios dealt with asthma exacerbation, hypoglycemic events, angina attacks, anaphylactic shock, and vasovagal syncope [45] following vaccine administration. All cases possessed the pattern of a patient coming to the pharmacy for a flu vaccination and an emergency arising after receiving the vaccination. In addition, a medication plan was also prepared for each case. In the case of an asthma attack and angina attack, there were also emergency medications, which the standardized patients carried with them. Specific checklists were prepared for each case, which differed in content only in Station 4 (which is related to emergency scenarios). Standardized Patients were faculty members or pharmacy students who were trained to imitate respective emergency situations with verbal and non-verbal cues. Particular attention was paid to acting breathing and case-specific symptoms. Pathological characteristics, according to the emergency situation, were given in a short case description (Supplemental Material S7).

2.5.3. Analytical Checklist

In order to quantify the performance of the participants, they were assessed during the OSCEs by an observer using an analytical checklist. The analytical checklist was created by faculty members and thoroughly discussed during several meetings. However, it must be stated that the Federal Chamber of Pharmacists’ official guidelines for flu vaccination in community pharmacies were followed in order to ensure that all relevant points and steps were included [46]. The checklist was also reviewed by a medical specialist and consisted of four stations. Each station contained subcategories and subitems with different total scores. Station 1 was related to taking a patient’s medical history, with a total of 8 or 9 points, depending on the individual cases. This station also dealt with identifying the patient’s eligibility for receiving the vaccination. Station 2 comprised tasks related to providing patient education and the necessary information regarding the vaccine and vaccination process. Station 3 included the necessary hygienic measures for the preparation of vaccines, the preparation on a personal basis and of the premises, and vaccination administration tasks. Further, Stations 2 and 3 each contained 12 points. Finally, Station 4 possessed 7 achievable points, which included tasks related to recognizing emergency situations and, thus, taking the necessary course of action. If a respective subitem was fulfilled, 1 point was awarded and if not zero points were given.

2.5.4. Multiple-Choice Test

In order to determine the participants’ knowledge related to the influenza virus and the vaccination process, a multiple-choice test was developed consisting of five multiple-choice questions. There were different sets of questions for the pre- and post-training OSCEs.

2.5.5. Self-Assessment Questionnaire

In order to ascertain the participants’ self-assessment regarding their competency and use of simulations in vaccine administration and pharmacy teaching, a pre- and post-training OSCE self-assessment questionnaire was developed. This consisted of nine questions with a 6-point Likert scale where 1 was full disagreement and 6 was full agreement. Questions 1 to 6 were related to personal ability regarding the vaccination process and questions 7 to 9 were related to the use of simulations in clinical skill-based pharmacy training sessions. The same survey was also completed in the pre- and post-training OSCEs.

2.6. Statistical Methods

In this study, the effects of the HFS training approach on vaccination administration skills compared to the standard training (with LFS methods) through OSCEs were analyzed. The results of these are given in percentages in order to ensure comparability between pre- and post-training OSCEs, as well as the intervention and control groups. Since proportions, i.e., percentages of achieved points in the OSCEs, were considered in the comparison of the performance of the intervention and the control group, non-parametric tests were used for these comparisons. More precisely, in order to measure the success between pre- and post-training OSCEs of the respective groups, a one-sided paired Wilcoxon signed-rank test with a significance level of alpha = 0.05 was performed. In order to determine the difference between the intervention group and the control group with respect to the pre- and post-training OSCEs, a one-sided Mann–Whitney test was performed with a significance level of alpha = 0.05. Hence, a p-value below 0.05 was considered significant. In addition, Microsoft Excel 2019 [47] was utilized for the purposes of data entry and OriginPro 2021 [48] for statistical analysis.

3. Results

3.1. Participant Characteristics

Forty-two students in their fourth year of pharmacy studies, after providing their informed consent, were available to participate in this study. Only one participant was excluded from the analysis of the self-assessment questionnaire due to missing information. Table 1 describes the participant characteristics for both the intervention and the control groups.

3.2. Analytical Checklist Score of OSCEs

The participants’ performance during the OSCEs was assessed and quantified using an analytical checklist. The analytical checklist scores reflect the participants’ ability to successfully conduct the vaccination process, i.e., from initiation to handling the untoward reactions. In total, 39 or 40 points could be achieved, depending on the individual case. The point-based scores were then converted to percentage points in order to enable comparisons between the groups and different OSCEs. For visualization of the data, box plots were generated. At baseline, the control group performed significantly better than the intervention group (p < 0.01; Table 2; Figure 4). Additionally, both groups demonstrated significant improvement in their overall performance from pre- to post-training OSCEs (intervention group: p < 0.01; control group: p < 0.01; Figure 4). However, the intervention group showed a significantly greater improvement in their analytical checklist scores when compared to the control group (p < 0.01; Figure 5). Accordingly, the intervention group showed significantly greater improvement in each station (p < 0.01 for station 2–4; Figure 6) except in Station 1, which is related to taking patient history, in comparison to the control group (p = 0.210 for station 1; Figure 6). It is interesting to note that every individual of the intervention group improved from pre- to post-training OSCEs (Figure 4). In Station 4, which is related to handling emergency situations, the intervention group demonstrated a significantly improved performance (p= 0.014) from pre- to post-training OSCEs when compared to the control group (p= 0.216).

3.3. Multiple-Choice Test

The participants showed no significant (p = 0.471) increase in knowledge scores points in both groups from the pre- to post-training multiple-choice tests (see Table 3).

3.4. Self-Assessment Questionnaire

Both groups demonstrated a similar increase in self-assessment scores when evaluated through a 6-point Likert scale. There were no significant differences between the intervention and control groups in regard to baseline (p = 0.505). This was also the case for the post-training self-assessment questionnaire scores (p = 0.568). Both groups reached significantly greater scores (intervention and control group: p < 0.01) from the pre- to post-training self-assessments. However, on question 5—which concerns the competency of recognizing and classifying possible vaccination reactions within the first 15 min after vacation—certain participants from the intervention group showed signs of disagreement (Figure 7). A few participants from both the intervention and control group disagreed with the statement regarding their self-efficacy for acting appropriately in an emergency situation during the first 15 min (Figure 7). Statistical computation of the questionnaire and results for question 7 to 9 are depicted in Appendix A (Table A1, Figure A1).

4. Discussion

In the present study, simulation-based training for pharmacy students in order to better educate them regarding vaccination administration was successfully implemented. In this study, positive students’ outcomes, as evidenced in the improved performance and overall self-assessment scores when compared to the control group who were trained in the standard teaching method, were demonstrated. Both groups significantly improved their performance from pre- to post-training. However, the participants of the intervention group with their HFS-based training were able to perform significantly better in terms of dealing with patient information, vaccination administration, and the handling of emergency situations. Importantly, the HFS training proved to be an effective teaching tool as every individual in the intervention group improved their performance; whereas in the standard training, some participants remained at the same level and some even decreased in ability.
High-fidelity simulation proved to be very effective for the purposes of vaccination training and resulted in significantly better outcomes in terms of participants’ performance. This may be attributed to the fact that HFS offers a patient-centered experience and can truly imitate the situation in a safe environment [49]. Other studies undertaking simulation-based vaccination training for pharmacy students showed similar results [50,51]. However, the comparability to our study is partially limited as they have not utilized a high-fidelity mannequin. For instance, Skoy et al. used two forms of simulators: an injection arm as a higher fidelity form of a simulator and an injection pad [51]. Similarly, Bushell et al. utilized roleplays, low-fidelity mannequins, standardized patients, and a mixed reality in order to create a realistic experience [50]. Both reported improved knowledge and confidence level among students. Furthermore, a key focus of this study was to train the participants in safe vaccination administration skills. Through the application of HFS in this study, there was an integration of different emergency cases—potentially arising after vaccination administration—that may or may not be directly related to vaccination, such as asthma exacerbation. As an aside, other studies on vaccination training have only focused on anaphylactic reactions [50,52,53]. Students in the HFS group particularly demonstrated significantly better performance in terms of recognizing and handling emergency situations. In addition, they also demonstrated a better performance in terms of the station dealing with patient information and vaccination administration. Abajas-Bustillo et al. found that communication skills could also be promoted by using HFS [54]. In addition, Tokunaga and colleagues demonstrated that students’ self-reports increased in understanding in monitoring vital signs and their measurements, including intramuscular injection [55]. In line with our findings, it could be shown that HFS training enhances competence with respect to specific clinical areas and skills. However, in contrast, Massoth et al. demonstrated that HFS did not lead to a significant improvement in performance, but the participants in this group were overconfident in their self-assessment [56].
We believe that through interaction with the HFS, clinical skills can be perceived and performed more efficiently. In our study, every single participant improved after training with the HFS, while certain participants who did not receive training with the HFS performed lower in their pre- to post-training OSCEs. Improved performances were, however, reported in several studies among nursing [57,58], medical [59], and pharmacy students [60,61,62]. This was specifically in regard to teaching clinical skills by the use of HFS. However, training should ultimately qualify and improve each participant. In a previous study, simulation performance was shown to correlate with clinical performance [63]. Thus, simulation performance was considered the best predictor of clinical performance [63]. Therefore, it seems appropriate that simulation-based learning should be included in the curriculum in order to teach clinical skills at an early stage.
The fact that simulation-based teaching is generally accepted by students is also shown in the results of the self-assessment questionnaire. The questions seven to nine, regarding using simulations in pharmacy education, were all answered with a general agreement both before and after the respective trainings. It was surprising to note that despite the improved performances, certain students disagreed in their self-assessment regarding their ability in recognizing and handling emergency situations. This fact contrasts with the findings reported by Zamami. Y and colleagues. Their study demonstrated a higher confidence with respect to the participants in handling emergency patients after undertaking pharmaceutical life-saving skills training [64]. This lack of agreement in our study could be attributed to two factors. Firstly, the participants have had no patient interaction, nor exposure to clinical situations during their pharmacy studies in Germany; as such, they will still, therefore, possess a certain lack of self-assurance. Secondly, the training sessions were their first hands-on experience in which they had to make real time decisions in a close-to-real environment. Therefore, nervousness could be a possible reason for the low confidence level reported as well [62]. However, it must be stressed that these participants’ perception of their ability was at variance from their actual performance during the study. Their lack of confidence could be addressed by scheduling trainings at an early stage and assigning the students with a responsibility to vaccinate, such as what was demonstrated by Peter R. Caroll and colleagues when they developed a student-led vaccination clinic for the purposes of training medical, nursing, and pharmacy students [52].
We are aware that our study is subject to certain limitations. Firstly, the present study did not determine any significant increase in terms of knowledge among the participants. The questions asked in the pre-training OSCE, as well as in the post-training OSCE, were of a general nature and, therefore, are possibly solvable, independently of the training. Therefore, the results of the multiple-choice tests cannot be correlated with the results of performance. Secondly, the patients were played by pharmacists, technical assistants, or pharmacy students instead of professional actors. In order to avoid a possible bias, both instructive and demonstrative instructions were given in several sessions. These included, in addition to medical history and medication, acting out certain symptoms and signs for emergency situations. In addition, the actors were not the observers filling out the checklist. The reason for this was to keep the focus entirely on their role rather than on completing a checklist. Additionally, the actors were given at least 15 min between OSCEs in order to prepare for the next case. Thirdly, the observers were pharmacists or pharmacy students, and in order to avoid possible inter-observer scoring bias, the analytical checklist was discussed in several sessions and example sentences or actions were explained. Additionally, each participant was assessed by the same observer in the pre- and post-training OSCE. In order to maintain concentration, the observers changed after every five examinations. The students who assisted in conducting the OSCEs were involved in a pilot study and, therefore, participated as members of the study team. Fourthly, due to legal and ethical reasons, it was not possible to allow students to perform an injection on a real person, as is offered in the standard training. Additionally, the constant presence of a doctor for supervision is still difficult to facilitate. Therefore, we used standardized patients, who wore a vaccination pad around their upper arm during the OSCEs, in order to imitate a real vaccination process in a community pharmacy. In addition, a pharmacy-like environment was created in order to simulate the situation as realistically as possible. Fifthly, despite randomization, all participant with previous pharmaceutical work experience were in the control group. This could be a possible explanation, that the control group reached significant greater scores during pre-Training OSCEs compared to the intervention group. In addition, the difference in Station 2 in pre-OSCE between the two groups was very high. However, when asked about pharmaceutical work experience, participants were also asked to specify whether they had worked or were working as a pharmaceutical technical assistant, in vaccination centers or similar, or in other areas. None of the participants worked in vaccination centers or similar, excluding previous experience in this field. We performed a sensitivity analysis in this respect excluding the six participants with pharmaceutical work experience. All results remain the same except for Station 2 (patient information) where no statistically significant difference could be shown in terms of performance between the two groups. The results of the sensitivity analysis are given in the Supplementary Materials. Finally, the number of participants seems to be low, and the study was only conducted at one university. Therefore, a power analysis was performed using the resulting means, standard deviations, and sample sizes, which yielded a power of 92%. Therefore, even though number of participants seems to be low, a statistical power was reached that is larger than the usually targeted power of 80 or 90%. However, further studies with a larger number of participants as well as the inclusion of more universities are recommended. Moreover, the training courses employing the high-fidelity simulator can be very expensive [37], especially for low-income countries where there is a high need for pharmacist-led vaccination administration. Collaborations at the university or even at the national level can address this issue, as the simulator can be transported. This could also increase vaccination rates in poorer or rural communities.

5. Conclusions

Pharmacists are becoming increasingly involved in vaccination in Germany as well as in many other countries. In order to ensure safe vaccinations being conducted by pharmacists, training with HFS proved to be superior to standard training in this study. Particularly, it could be shown that emergency situations can be addressed in a very effective manner. Furthermore, the introduction of such a course into the pharmacy curriculum should be considered in order to prepare students for future challenges.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/vaccines11020324/s1, Supplemental Material S1: OSCE-Checklist Station 1–3, Supplemental Material S2: OSCE-Checklist Station 4 case 1, Supplemental Material S3: OSCE-Checklist Station 4 case 2, Supplemental Material S4: OSCE-Checklist Station 4 case 3, Supplemental Material 5S: OSCE-Checklist Station 4 case 4, Supplemental Material S6: OSCE-Checklist Station 4 case 5, Supplemental Material S7: short case descriptions and Medication Plan Supplemental Material S8: Multiple Choice Tests; Supplemental Material S9: sensitivity analysis.

Author Contributions

Conceptualization, S.A.S., A.R.S. and S.L.; methodology, S.A.S., A.R.S. and S.L.; formal analysis, S.A.S. and H.S.; investigation, S.A.S., B.A.S., A.R.S., A.D.; resources, S.A.S., S.L.; writing—original draft preparation, S.A.S.; writing—review and editing, S.A.S., B.A.S., H.S. and S.L.; visualization, S.A.S.; project administration, S.A.S., S.L.; All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge that the publication fees were funded by the Heinrich Heine University Duesseldorf.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Faculty of Medicine of the Heinrich-Heine-University Dusseldorf (2021–1689, 04.11.2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The dataset presented in this study is available from the corresponding author on reasonable request.

Acknowledgments

The authors thank the faculty members Jutta Tins, Anke Bartel for taking over the role of standardized patients and Sabina Schlottau for taking over the role of rater during the OSCEs. They thank the students Tom Altenhövel and Mohammad Mehdi Vahidian for taking over the role of standardized patients and Tabea Sophie Krause and Bao Quyen Michelle Do for taking over the role of rater during the OSCEs. The research work of B.A.S. was supported by a scholarship from Higher Education Commission (HEC), Pakistan in collaboration with the German Academic Exchange Program (DAAD), Germany.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Appendix A

Table A1. Achieved scores by intervention and control group in pre- and post-training self-Assessment.
Table A1. Achieved scores by intervention and control group in pre- and post-training self-Assessment.
GroupPre-TrainingPost-Trainingp-Value
(Intragroup)
Mean
(CI)
Mean
(CI)
Intervention32.45
3.10
41.60
2.77
p < 0.01
Control33.92
2.96
41.33
2.10
p < 0.01
p-Value
(intergroup)
p = 0.505p = 0.568
n = 20 for intervention group and n = 21 for control group; CI = Confidence interval (α = 0.05).
Figure A1. Forest Plot of mean values with 95% confidence interval of self-assessment scores for question 7 to 9 in post-Training (6-point Likert scale). White dots (○) = intervention group (n = 20); grey square () = control group (n = 21).
Figure A1. Forest Plot of mean values with 95% confidence interval of self-assessment scores for question 7 to 9 in post-Training (6-point Likert scale). White dots (○) = intervention group (n = 20); grey square () = control group (n = 21).
Vaccines 11 00324 g0a1

References

  1. Vaccines work. Nat. Commun. 2018, 9, 1666. [CrossRef] [PubMed] [Green Version]
  2. Leidner, A.J.; Murthy, N.; Chesson, H.W.; Biggerstaff, M.; Stoecker, C.; Harris, A.M.; Acosta, A.; Dooling, K.; Bridges, C.B. Cost-effectiveness of adult vaccinations: A systematic review. Vaccine 2019, 37, 226–234. [Google Scholar] [CrossRef] [PubMed]
  3. Ehreth, J. The global value of vaccination. Vaccine 2003, 21, 596–600. [Google Scholar] [CrossRef] [PubMed]
  4. Bärnighausen, T.; Bloom, D.E.; Cafiero-Fonseca, E.T.; O’Brien, J.C. Valuing vaccination. Proc. Natl. Acad. Sci. USA 2014, 111, 12313–12319. [Google Scholar] [CrossRef] [Green Version]
  5. Arsenault, C.; Harper, S.; Nandi, A. Effect of vaccination on children’s learning achievements: Findings from the India Human Development Survey. J. Epidemiol. Community Health 2020, 74, 778–784. [Google Scholar] [CrossRef] [PubMed]
  6. Dye, C. The benefits of large scale covid-19 vaccination. BMJ 2022, 377, o867. [Google Scholar] [CrossRef]
  7. Paudyal, V.; Fialová, D.; Henman, M.C.; Hazen, A.; Okuyan, B.; Lutters, M.; Cadogan, C.; da Costa, F.A.; Galfrascoli, E.; Pudritz, Y.M.; et al. Pharmacists’ involvement in COVID-19 vaccination across Europe: A situational analysis of current practice and policy. Int. J. Clin. Pharm. 2021, 43, 1139–1148. [Google Scholar] [CrossRef]
  8. Betsch, C.; Böhm, R.; Korn, L.; Holtmann, C. On the benefits of explaining herd immunity in vaccine advocacy. Nat. Hum. Behav. 2017, 1, 0056. [Google Scholar] [CrossRef]
  9. Kadkhoda, K. Herd Immunity to COVID-19. Am. J. Clin. Pathol. 2021, 155, 471–472. [Google Scholar] [CrossRef]
  10. Krause, P.R.; Fleming, T.R.; Peto, R.; Longini, I.M.; Figueroa, J.P.; Sterne, J.A.C.; Cravioto, A.; Rees, H.; Higgins, J.P.T.; Boutron, I.; et al. Considerations in boosting COVID-19 vaccine immune responses. Lancet 2021, 398, 1377–1380. [Google Scholar] [CrossRef]
  11. Federal Ministry of Health. Auffrischungsimpfung. 2022. Available online: https://www.zusammengegencorona.de/faqs/impfen/auffrischungsimpfung/ (accessed on 7 October 2022).
  12. Federal Ministry of Health. Aktueller Impfstatus: Wie ist der Fortschritt der COVID19 Impfung? Available online: https://impfdashboard.de/ (accessed on 7 October 2022).
  13. Infection Protection Act: IfSG. 2001. Available online: https://www.gesetze-im-internet.de/ifsg/__20c.html (accessed on 16 August 2022).
  14. International Pharmaceutical Federation. An Overview of Current Pharmacy Impact on Immunisation: A Global Report. Available online: https://www.fip.org/files/fip/publications/FIP_report_on_Immunisation.pdf (accessed on 16 August 2022).
  15. International Pharmaceutical Federation. An Overview of Pharmacy’s Impact on Immunisation Coverage: A Global Survey. The Hague. 2020. Available online: https://www.fip.org/file/4751 (accessed on 16 August 2022).
  16. Social Code, Book Five (V): SGB. 1989. Available online: https://www.gesetze-im-internet.de/sgb_5/__132j.html (accessed on 16 August 2022).
  17. Eickhoff, C.; Griese-Mammen, N.; Müeller, U.; Said, A.; Schulz, M. Primary healthcare policy and vision for community pharmacy and pharmacists in Germany. Pharm. Pract. (Granada) 2021, 19, 2248. [Google Scholar] [CrossRef] [PubMed]
  18. Paules, C.; Subbarao, K. Influenza. Lancet 2017, 390, 697–708. [Google Scholar] [CrossRef] [PubMed]
  19. World Health Organization. Seasonal Influenza Vaccines: An Overview for Decision-Makers. Available online: https://apps.who.int/iris/bitstream/handle/10665/336951/9789240010154-eng.pdf (accessed on 30 August 2022).
  20. OECD. Influenza Vaccination Rate (indicator). 2023. Available online: https://www.oecd-ilibrary.org/social-issues-migration-health/influenza-vaccination-rates/indicator/english_e452582e-en (accessed on 20 January 2023).
  21. Kelling, S.E. Exploring Accessibility of Community Pharmacy Services. Innov. Pharm. 2015, 6. [Google Scholar] [CrossRef]
  22. Isenor, J.E.; Edwards, N.T.; Alia, T.A.; Slayter, K.L.; MacDougall, D.M.; McNeil, S.A.; Bowles, S.K. Impact of pharmacists as immunizers on vaccination rates: A systematic review and meta-analysis. Vaccine 2016, 34, 5708–5723. [Google Scholar] [CrossRef] [PubMed]
  23. The Pharmaceutical Society of Ireland. Report on the Evaluation of the Seasonal Influenza Vaccination Service in Pharmacy 2014/2015. 2015. Available online: https://www.thepsi.ie/Libraries/Pharmacy_Practice/PSI_2014_15_Report_on_Seasonal_Influenza_Vaccination_Service.sflb.ashx (accessed on 18 August 2022).
  24. Czech, M.; Balcerzak, M.; Antczak, A.; Byliniak, M.; Piotrowska-Rutkowska, E.; Drozd, M.; Juszczyk, G.; Religioni, U.; Vaillancourt, R.; Merks, P. Flu Vaccinations in Pharmacies-A Review of Pharmacists Fighting Pandemics and Infectious Diseases. Int. J. Environ. Res. Public Health 2020, 17, 7945. [Google Scholar] [CrossRef] [PubMed]
  25. Steyer, T.E.; Ragucci, K.R.; Pearson, W.S.; Mainous, A.G. The role of pharmacists in the delivery of influenza vaccinations. Vaccine 2004, 22, 1001–1006. [Google Scholar] [CrossRef]
  26. Ecarnot, F.; Crepaldi, G.; Juvin, P.; Grabenstein, J.; Del Giudice, G.; Tan, L.; O’Dwyer, S.; Esposito, S.; Bosch, X.; Gavazzi, G.; et al. Pharmacy-based interventions to increase vaccine uptake: Report of a multidisciplinary stakeholders meeting. BMC Public Health 2019, 19, 1698. [Google Scholar] [CrossRef] [Green Version]
  27. Bushell, M.-J.A.; Yee, K.C.; Ball, P.A. Case for Pharmacist Administered Vaccinations in Australia. J. Pharm. Pract. Res. 2013, 43, 292–296. [Google Scholar] [CrossRef]
  28. Prescott, W.A.; Bernhardi, C. Immunization Education in US Pharmacy Colleges and Schools. Am. J. Pharm. Educ. 2019, 83, 6765. [Google Scholar] [CrossRef]
  29. Turner, C.J.; Ellis, S.; Giles, J.; Altiere, R.; Sintek, C.; Ulrich, H.; Valdez, C.; Zadvorny, E. An introductory pharmacy practice experience emphasizing student-administered vaccinations. Am. J. Pharm. Educ. 2007, 71, 3. [Google Scholar] [CrossRef] [Green Version]
  30. Terriff, C.M.; McKeirnan, K. Training student pharmacists to administer emergency pediatric influenza vaccine: A comparison of traditional vs. just-in-time training. Curr. Pharm. Teach. Learn. 2017, 9, 560–567. [Google Scholar] [CrossRef] [PubMed]
  31. Mills, S.; Emmerton, L.; Sim, T.F. Immunization training for pharmacy students: A student-centered evaluation. Pharm. Pract. (Granada) 2021, 19, 2427. [Google Scholar] [CrossRef]
  32. Donohoe, K.L.; Mawyer, T.M.; Stevens, J.T.; Morgan, L.A.; Harpe, S.E. An active-learning laboratory on immunizations. Am. J. Pharm. Educ. 2012, 76, 198. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Bradley, P. The history of simulation in medical education and possible future directions. Med. Educ. 2006, 40, 254–262. [Google Scholar] [CrossRef] [PubMed]
  34. Korayem, G.B.; Alshaya, O.A.; Kurdi, S.M.; Alnajjar, L.I.; Badr, A.F.; Alfahed, A.; Cluntun, A. Simulation-Based Education Implementation in Pharmacy Curriculum: A Review of the Current Status. Adv. Med. Educ. Pract. 2022, 13, 649–660. [Google Scholar] [CrossRef]
  35. Lin, K.; Travlos, D.V.; Wadelin, J.W.; Vlasses, P.H. Simulation and introductory pharmacy practice experiences. Am. J. Pharm. Educ. 2011, 75, 209. [Google Scholar] [CrossRef] [Green Version]
  36. Basak, T.; Unver, V.; Moss, J.; Watts, P.; Gaioso, V. Beginning and advanced students’ perceptions of the use of low- and high-fidelity mannequins in nursing simulation. Nurse Educ. Today 2016, 36, 37–43. [Google Scholar] [CrossRef]
  37. Vyas, D.; Bray, B.S.; Wilson, M.N. Use of simulation-based teaching methodologies in US colleges and schools of pharmacy. Am. J. Pharm. Educ. 2013, 77, 53. [Google Scholar] [CrossRef] [Green Version]
  38. Morris, A.; Young, G.; Roller, L.; Li, F.; Takamoto, P.; Baumgartner, L. High-fidelity simulation increases pharmacy resident perceived competence during medical emergencies. Curr. Pharm. Teach. Learn. 2019, 11, 1016–1021. [Google Scholar] [CrossRef]
  39. Vyas, D.; Wombwell, E.; Russell, E.; Caligiuri, F. High-fidelity patient simulation series to supplement introductory pharmacy practice experiences. Am. J. Pharm. Educ. 2010, 74, 169. [Google Scholar] [CrossRef] [Green Version]
  40. Bingham, A.L.; Sen, S.; Finn, L.A.; Cawley, M.J. Retention of advanced cardiac life support knowledge and skills following high-fidelity mannequin simulation training. Am. J. Pharm. Educ. 2015, 79, 12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Awaisu, A.; Abd Rahman, N.S.; Nik Mohamed, M.H.; Bux Rahman Bux, S.H.; Mohamed Nazar, N.I. Malaysian pharmacy students’ assessment of an objective structured clinical examination (OSCE). Am. J. Pharm. Educ. 2010, 74, 34. [Google Scholar] [CrossRef] [PubMed]
  42. Harden, R.M. Revisiting ‘Assessment of clinical competence using an objective structured clinical examination (OSCE)’. Med. Educ. 2016, 50, 376–379. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Harden, R.M.; Gleeson, F.A. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med. Educ. 1979, 13, 39–54. [Google Scholar] [CrossRef]
  44. RStudio Team. RStudio: Integrated Development Environment for R. RStudio, PBC, Boston, MA. 2021. Available online: http://www.rstudio.com/ (accessed on 30 August 2022).
  45. Sharkas, A. Vaccination Training Project Using High-Fidelity Simulation for Pharmacy Undergraduates. Master’s Thesis, Heinrich-Heine-University, Düsseldorf, Germany, Martin-Luther-University, Halle, Germany, September 2021. Available online: https://www.pharmazie.hhu.de/institut-fuer-klinische-pharmazie-und-pharmakotherapie/veroeffentlichungen/diplomarbeiten (accessed on 30 August 2022).
  46. Bundesapothekerkammer. Durchführung von Grippeschutzimpfungen in Öffentlichen Apotheken. Available online: https://www.abda.de/fuer-apotheker/qualitaetssicherung/leitlinien/leitlinien-und-arbeitshilfen/ (accessed on 20 September 2022).
  47. Microsoft Excel 2019; Microsoft Corporation: Redmond, WA, USA, 2019.
  48. Origin(Pro); Version 2021; OriginLab Corporation: Northampton, MA, USA, 2021.
  49. Yuan, H.B.; Williams, B.A.; Fang, J.B.; Ye, Q.H. A systematic review of selected evidence on improving knowledge and skills through high-fidelity simulation. Nurse Educ. Today 2012, 32, 294–298. [Google Scholar] [CrossRef]
  50. Bushell, M.; Frost, J.; Deeks, L.; Kosari, S.; Hussain, Z.; Naunton, M. Evaluation of Vaccination Training in Pharmacy Curriculum: Preparing Students for Workforce Needs. Pharmacy 2020, 8, 151. [Google Scholar] [CrossRef] [PubMed]
  51. Skoy, E.T.; Eukel, H.N.; Frenzel, J.E. Comparison of Low- and Higher-Fidelity Simulation to Train and Assess Pharmacy Students’ Injection Technique. Am. J. Pharm. Educ. 2013, 77, 33. [Google Scholar] [CrossRef] [PubMed]
  52. Carroll, P.R.; Hanrahan, J. Development and evaluation of an interprofessional student-led influenza vaccination clinic for medical, nursing and pharmacy students. Pharm. Pract. (Granada) 2021, 19, 2449. [Google Scholar] [CrossRef]
  53. Lau, E.T.L.; Rochin, M.E.; DelDot, M.; Glass, B.D.; Nissen, L.M. “There’s No Touching in Pharmacy”: Training Pharmacists for Australia’s First Pharmacist Immunization Pilot. Can. J. Hosp. Pharm. 2017, 70, 281–287. [Google Scholar] [CrossRef] [Green Version]
  54. Abajas-Bustillo, R.; Amo-Setién, F.; Aparicio, M.; Ruiz-Pellón, N.; Fernández-Peña, R.; Silio-García, T.; Leal-Costa, C.; Ortego-Mate, C. Using High-Fidelity Simulation to Introduce Communication Skills about End-of-Life to Novice Nursing Students. Healthcare 2020, 8, 238. [Google Scholar] [CrossRef]
  55. Tokunaga, J.; Takamura, N.; Ogata, K.; Yoshida, H.; Setoguchi, N.; Matsuoka, T.; Hirokane, T.; Yamaoka, A.; Sato, K. Vital sign monitoring using human patient simulators at pharmacy schools in Japan. Am. J. Pharm. Educ. 2010, 74, 132. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Massoth, C.; Röder, H.; Ohlenburg, H.; Hessler, M.; Zarbock, A.; Pöpping, D.M.; Wenk, M. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med. Educ. 2019, 19, 29. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  57. La Cerra, C.; Dante, A.; Caponnetto, V.; Franconi, I.; Gaxhja, E.; Petrucci, C.; Alfes, C.M.; Lancia, L. Effects of high-fidelity simulation based on life-threatening clinical condition scenarios on learning outcomes of undergraduate and postgraduate nursing students: A systematic review and meta-analysis. BMJ Open 2019, 9, e025306. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  58. Alinier, G.; Hunt, B.; Gordon, R.; Harwood, C. Effectiveness of intermediate-fidelity simulation training technology in undergraduate nursing education. J. Adv. Nurs. 2006, 54, 359–369. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. McCoy, C.E.; Rahman, A.; Rendon, J.C.; Anderson, C.L.; Langdorf, M.I.; Lotfipour, S.; Chakravarthy, B. Randomized Controlled Trial of Simulation vs. Standard Training for Teaching Medical Students High-quality Cardiopulmonary Resuscitation. West. J. Emerg. Med. 2019, 20, 15–22. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  60. Branch, C. Pharmacy Students’ Learning and Satisfaction with High-Fidelity Simulation to Teach Drug-Induced Dyspepsia. Am. J. Pharm. Educ. 2013, 77, 30. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  61. Gilliland, I.; Frei, B.L.; McNeill, J.; Stovall, J. Use of high-fidelity simulation to teach end-of-life care to pharmacy students in an interdisciplinary course. Am. J. Pharm. Educ. 2012, 76, 66. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Lee Chin, K.; Ling Yap, Y.; Leng Lee, W.; Chang Soh, Y. Comparing effectiveness of high-fidelity human patient simulation vs case-based learning in pharmacy education. Am. J. Pharm. Educ. 2014, 78, 153. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Yang, C.-W.; Ku, S.-C.; Ma, M.H.-M.; Chu, T.-S.; Chang, S.-C. Application of high-fidelity simulation in critical care residency training as an effective learning, assessment, and prediction tool for clinical performance. J. Formos. Med. Assoc. 2019, 118, 1347–1355. [Google Scholar] [CrossRef]
  64. Zamami, Y.; Imai, T.; Imanishi, M.; Takechi, K.; Shiraishi, N.; Koyama, T.; Sagara, H.; Shiino, Y.; Sendo, T.; Ishizawa, K. Evaluation of pharmaceutical lifesaving skills training oriented pharmaceutical intervention. J. Pharm. Health Care Sci. 2016, 2, 21. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Low-fidelity Simulator.
Figure 1. Low-fidelity Simulator.
Vaccines 11 00324 g001
Figure 2. High-fidelity Simulator with Software showing vital functions.
Figure 2. High-fidelity Simulator with Software showing vital functions.
Vaccines 11 00324 g002
Figure 3. Flow Chart of the randomized controlled study. OSCE = objective structured clinical Examination.
Figure 3. Flow Chart of the randomized controlled study. OSCE = objective structured clinical Examination.
Vaccines 11 00324 g003
Figure 4. Box plots of analytical Checklist scores between pre- and post-Training OSCEs. The grey dots and lines show the difference in performance of each participant. The black diamonds (♦) indicate the outliers. A one-sided paired Wilcoxon signed-rank test with a significance level of alpha = 0.05 was used to compare OSCE scores between pre- and post-Training of the respective groups.
Figure 4. Box plots of analytical Checklist scores between pre- and post-Training OSCEs. The grey dots and lines show the difference in performance of each participant. The black diamonds (♦) indicate the outliers. A one-sided paired Wilcoxon signed-rank test with a significance level of alpha = 0.05 was used to compare OSCE scores between pre- and post-Training of the respective groups.
Vaccines 11 00324 g004
Figure 5. Box plots of analytical checklist score difference between pre- and post-Training OSCE. A one-sided Mann–Whitney test with a significance level of alpha = 0.05 was used to compare OSCE scores between groups.
Figure 5. Box plots of analytical checklist score difference between pre- and post-Training OSCE. A one-sided Mann–Whitney test with a significance level of alpha = 0.05 was used to compare OSCE scores between groups.
Vaccines 11 00324 g005
Figure 6. Box plots of analytical Checklist score differences for each station between pre- and post-training OSCE for respective groups. The black diamonds (♦) indicate the outliers. A one-sided Mann–Whitney test with a significance level of alpha = 0.05 was used to compare OSCE scores between groups.
Figure 6. Box plots of analytical Checklist score differences for each station between pre- and post-training OSCE for respective groups. The black diamonds (♦) indicate the outliers. A one-sided Mann–Whitney test with a significance level of alpha = 0.05 was used to compare OSCE scores between groups.
Vaccines 11 00324 g006
Figure 7. Forest plot of mean values with 95% confidence interval of self-assessment scores for question 1 to 6 in post-Training (6-point Likert scale). White dots () = intervention group (n = 20); grey square () = control group (n = 21).
Figure 7. Forest plot of mean values with 95% confidence interval of self-assessment scores for question 1 to 6 in post-Training (6-point Likert scale). White dots () = intervention group (n = 20); grey square () = control group (n = 21).
Vaccines 11 00324 g007
Table 1. Participant Characteristics.
Table 1. Participant Characteristics.
Control Group (n = 21)Intervention Group (n = 21)p-Values
Age
Mean (±SD)
Median
Range
25 (±2.67)
24
22–32
24.38 (±2.35)
23
22–31
0.337
Gender
Female, n (%)
Male, n (%)
17 (81)
4 (19)
18 (86)
3 (14)
1
Previous or current experience (e.g., pharmaceutical technician, vaccination centre)
Yes (%)
No (%)
6 (29)
15 (71)
0 (0)
21 (100)
0.021
Table 2. Achieved scores by intervention and control group in each station of analytical checklist during pre- and post-Training OSCEs.
Table 2. Achieved scores by intervention and control group in each station of analytical checklist during pre- and post-Training OSCEs.
GroupPre-Training
OSCE-Score
Post-Training
OSCE-Score
Score Difference
Mean (SD) %Mean (SD) %Mean (SD) %
Station 1
Intervention26.06 (14.81)69.38 (15.72)43.34 (23.18)
Control27.65 (18.53)63.89 (18.92)36.24 (21.54)
Station 2
Intervention7.54 (9.83)45.64 (17.00)38.10 (16.79)
Control22.22 (13.26)43.25 (28.34)21.03 (32.13)
Station 3
Intervention49.60 (15.47)84.52 (11.87)34.92 (17.60)
Control53.18 (17.38)67.86 (22.10)14.68 (26.10)
Station 4
Intervention51.70 (19.42)65.99 (17.77)14.29 (27.85)
Control61.22 (26.40)63.95 (27.71)2.72 (19.50)
Total
Intervention32.10 (7.70)66.12 (8.89)34.03 (11.66)
Control39.73 (8.21)58.79 (19.84)19.06 (18.20)
Depending on case, different maximum scores were achievable. (OSCE = objective structured clinical examination, SD= standard deviation).
Table 3. Achieved scores by intervention and control group in pre- and post- training multiple-choice-test.
Table 3. Achieved scores by intervention and control group in pre- and post- training multiple-choice-test.
GroupPre-Training Post-Training
Mean (%)Mean (%)
Intervention3.00 (60)3.43 (68.57)
Control2.7 (55.24)2.86 (57.14)
n = 21 each for intervention and control group.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sayyed, S.A.; Sharkas, A.R.; Ali Sherazi, B.; Dabidian, A.; Schwender, H.; Laeer, S. Development and Assessment of Innovative High-Fidelity Simulation Vaccination Course Integrating Emergency Cases for Pharmacy Undergraduates—A Randomized Controlled Study. Vaccines 2023, 11, 324. https://doi.org/10.3390/vaccines11020324

AMA Style

Sayyed SA, Sharkas AR, Ali Sherazi B, Dabidian A, Schwender H, Laeer S. Development and Assessment of Innovative High-Fidelity Simulation Vaccination Course Integrating Emergency Cases for Pharmacy Undergraduates—A Randomized Controlled Study. Vaccines. 2023; 11(2):324. https://doi.org/10.3390/vaccines11020324

Chicago/Turabian Style

Sayyed, Shahzad Ahmad, Ahmed Reda Sharkas, Bushra Ali Sherazi, Armin Dabidian, Holger Schwender, and Stephanie Laeer. 2023. "Development and Assessment of Innovative High-Fidelity Simulation Vaccination Course Integrating Emergency Cases for Pharmacy Undergraduates—A Randomized Controlled Study" Vaccines 11, no. 2: 324. https://doi.org/10.3390/vaccines11020324

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop