1. Introduction
If a systematic campus epidemic prevention guide can be established and provided to schools around the world as a reference, it can effectively reduce the risk of spreading Coronavirus disease 2019 (COVID-19) on campus and ensure students’ right for education [
1,
2]. In order to reduce the spread of COVID-19, some countries prevent and control cross-infection by restricting contact among people. Governments of various countries recommend or order restrictions on social activities, including schooling. In order to slow the spread of the virus, colleges and universities have to be closed to protect students, teachers, and staff. Many college and universities have resorted to distance learning and online classes. However, the learning effect of distance teaching is not as good as in-person teaching [
3]. In December 2019, the first outbreak of COVID-19 occurred in Wuhan, China. Many institutions and organizations have put forward emergency response guidelines for epidemic control. Since then, a series of COVID-19 prevention research has been greatly developed [
4]. Unfortunately, research on campus epidemic prevention is still scarce. Most academic research is still centered on distance teaching and the psychological impact of students. If the virus infection can be effectively controlled, the university can restart the campus. Therefore, this study aims to develop a framework for the prevention of COVID-19 for colleges and universities. Specifically, the research scope and objectives of this study include the following:
- (i)
Identifying important epidemic prevention works, with the purpose of proposing a systematic hierarchical structure of campus epidemic prevention work/measure.
- (ii)
Integrating the opinions of multiple experts, and obtaining quantifiable information from the content of qualitative interviews through a multiple criteria decision-making (MCDM) approach.
- (iii)
Determining the priority order of epidemic prevention work, so as to provide suggestions for epidemic prevention in colleges and universities around the world.
In order to achieve the research objectives, this study uses the MCDM concept to construct an epidemic prevention assessment framework. The research of MCDM usually deals with decision-making problems in complex environments and seeks an ideal solution from numerous constraints or conflicting criteria. This method does not require large sample data as well as basic statistical assumptions [
5]. Whether it is the qualitative data of expert interviews or the quantitative data obtained through measurement, MCDM can conduct an analysis and make summaries through some soft computing tools and provide effective management suggestions to support decision makers to formulate the ideal strategies [
6].
The research process of this study can be briefly divided into two stages. First, we invited 32 persons in charge of epidemic prevention from colleges and universities to form a decision-making group. Most experts have experience in participating in the prevention of severe acute respiratory syndrome (SARS) in 2003. Therefore, the decision-making group is professional in campus epidemic prevention. The decision-making group conducted a literature review and screening of epidemic prevention works, and finally determined 36 criteria (epidemic prevention works). Next, this paper uses a new weight calculation method to determine the importance of the criteria, that is, the Bayesian best worst method (Bayesian BWM) [
7]. Bayesian BWM optimizes the conventional BWM. It can effectively integrate the evaluation data of multiple experts to generate a set of optimal group weights and understand the consensus of all experts. The weight and priority of epidemic prevention works can be obtained. According to the management suggestions put forward in this study, it can reduce the time and cost of trial and error for colleges and universities that have not yet established epidemic prevention work, thereby reducing the infection rate of all personnel in colleges and universities. The overall advantages and contributions of this study are summarized as follows:
- (i)
A multiple criteria campus epidemic prevention framework is proposed to strengthen the epidemic prevention capabilities of colleges and universities.
- (ii)
Bayesian BWM is used to effectively integrate expert opinions to obtain more reliable results.
- (iii)
Anti-epidemic management recommendations for colleges and universities are provided to effectively reduce the infection of COVID-19.
- (iv)
The research process and structure are reproducible and referenceable, and serve as a reference for the epidemic prevention of relevant organizations and groups.
The rest of this paper is arranged as follows.
Section 2 introduces the dimensions and criteria of COVID-19 prevention in colleges and universities.
Section 3 describes the applied methodology and calculation procedures.
Section 4 introduces the process of data collection and analysis.
Section 5 discusses the results and explains the management implications.
Section 6 summarizes the conclusions of the whole paper and provides future research works.
2. The Proposed Framework for Campus Epidemic Prevention
This section explains the proposed framework for the prevention of COVID-19 by colleges and universities. The governments of some countries have implemented large-scale lockdowns and used the media to promote the concept of “stay at home” to reduce the spread of COVID-19 [
8]. Before the epidemic has slowed down, campus epidemic prevention work is even more important. To maintain the continuation of education, there must be a complete epidemic prevention mechanism to protect the health of students during school hours. In Taiwan, in order to effectively prevent the spread of COVID-19 on campus, the Ministry of Education of Taiwan has successively promulgated many campus epidemic prevention measures to maintain the public health of schools, including “the handling principles of 14-day home quarantine compiled by colleges and universities for students entering Taiwan with a history of travel in China, Hong Kong, and Macau”, “precautions and reports for home quarantine of college students”, “management and epidemic prevention measures for Hong Kong and Macau students”, and “the outlines of the prevention and treatment of severe and special infectious pneumonia in colleges and universities” [
9,
10]. These guiding principles and epidemic prevention measures have all contributed to the epidemic prevention work of colleges and universities in Taiwan.
This study established a decision-making group to jointly formulate a framework for the epidemic prevention work of colleges and universities. A total of 32 persons in charge of epidemic prevention in Taiwan’s colleges and universities were invited to participate in the formulation of the framework. Most of the experts have been in the academic field for more than 10 years, and approximately 72% of the experts have experience in SARS prevention in 2003.
Table 1 presents the experts’ academic qualifications, years of school service, and whether they have participated in SARS prevention.
A total of 52 criteria were drafted in the initial campus epidemic prevention work framework. Through a Delphi method, the 32 experts were asked to select the epidemic prevention criteria they deem necessary. The Delphi questionnaire was distributed to experts at different times for review. Then, based on their experience, experts could propose other criteria that had not yet been proposed. After several meetings of the 32 experts have been held for revising and adjusting the definition of the criteria, the final framework was determined.
The final dimensions-criteria hierarchical structure is based on the epidemic prevention guidelines proposed by the Ministry of Education and the Ministry of Health and Welfare [
9,
10]. It can be classified into five main dimensions, including establishment of epidemic prevention organizations and control of campus epidemic (
D1), formulation of campus epidemic prevention measures (
D2), health management of faculty, staff, and students (
D3), establishment of remote teaching and contingency measures (
D4), and student extracurricular affairs management (
D5). These dimensions can be divided into a total of 36 criteria.
2.1. Establishment of EpidemicPrevention Organization and Control of Campus Epidemic
“Establishment of epidemic prevention organization and control of campus epidemic (
D1)” is one of the most important dimensions of epidemic prevention work. Schools must systematically plan and coordinate all epidemic prevention matters in order to be able to deal with emergencies quickly. In addition, the top leaders of epidemic prevention must grasp the health status of all faculty and staff and confirm whether anyone has contracted COVID-19. The establishment of information systems, the planning of epidemic prevention budgets, the control of epidemic prevention materials, and thorough inspections of personnel entry and exit, etc., are all critical items in this dimension [
11,
12].
Table 2 introduces the criteria and descriptions included in
D1.
2.2. Formulation of Campus Epidemic Prevention Measures
The requirements of campus sanitation and environmental sanitation cannot be ignored. “Formulation of campus epidemic prevention measures (
D2)” focuses on the sanitation and safety of the entry and exit of all personnel and the environment. Surveillance should be strengthened around the campus to prevent loopholes in epidemic prevention. All hardware equipment and public activity spaces must be disinfected, including restaurants, classrooms, stadiums, buses, etc. [
13,
14]. In addition, the entry and exit of visitors outside the school must be strictly controlled, and non-school personnel must be prohibited from entering when necessary [
11]. Some specific works are presented in
Table 3.
2.3. Health Management of Faculty, Staff and Students
The personal hygiene and health status of faculty, staff, and students are evaluated by the “Health management of faculty, staff, and students (
D3)” dimension. In this dimension, the proposed works are based on the premise that there are no cases or only a few cases. The Ministry of Health and Welfare has repeatedly echoed the importance of self-health management to the public through media communication and other means. The school must also strengthen publicity to require students to manage self-health. More importantly, once people who have been in contact with a confirmed case are found, the school must notify the relevant government unit as soon as possible and bring them to hospitals for testing and treatment [
14,
15,
16].
Table 4 lists the criteria and descriptions of
D3.
2.4. Establishment of Remote Teaching and Contingency Measures
If there is unfortunately a case of COVID-19 infection on the campus, it is necessary to take immediate contingency measures and conduct remote teaching to maintain the student’s right to education. “Establishment of remote teaching and contingency measures (
D4)” focuses on enrollment and teaching quality to ensure that the school can operate stably and teach safely. In addition, the immigration management of foreign students is an urgent task to prevent foreign students from bringing the virus into Taiwan [
17,
18,
19].
Table 5 gives specific suggestions on how to respond.
2.5. Student Extracurricular Affairs Management
“Student extracurricular affairs management (
D5)” includes gatherings, student organization activities, and internships. To reduce the chance of group infection, the handling of each activity should be carefully evaluated and reviewed before deciding whether to continue according to the original plan [
20,
21,
22].
Table 6 lists the criteria and descriptions included in
D5.
3. Bayesian BWM
BWM was proposed by Rezaei [
23]. It aims to improve the two shortcomings of AHP, including reducing the number of pairwise comparisons and obtaining better consistency results. Assuming that an evaluation system has
n criteria, AHP requires
n(
n−1)/2 pairwise comparisons, but BWM only requires 2
n−3 times. The operating concept of BWM is very simple. First, the best and worst criteria are selected. Then, the best criterion is compared with other criteria to obtain the BO (Best-to-Others) vector. Similarly, other criteria are used to compare with the worst criteria to form an OW (Others-to-Worst) vector. The judgment provided by each expert is not necessarily the same. If different best and worst criteria are selected, the meaning of the formed vectors information is different. If the arithmetic average is used to aggregate the opinions of multiple experts, some information will be lost [
3]. Mohammadi and Rezaei [
7] proposed a method of using a statistical probability model to determine weights, which finds the optimal group criteria weights in the probability distribution environment. Suppose there are
n criteria in a specific evaluation system, namely
cj,
j = 1, 2,…,
n. In addition,
wj is expressed as the weight of criterion
cj. From a statistical point of view, the criterion
cj is a random event, and the weight
wj is the probability of a random event. In probability theory, it is required that
and
, which are fully consistent with the concept of MCDM. There have been many studies using Bayesian BWM to discuss the weight determination of various issues. For example, hospital waste management [
24], sustainable sports tourism development [
4], business risk assessment [
25], etc. The detailed Bayesian BWM execution steps and inference steps are as follows:
The decision-making group draws up a hierarchical structure for the evaluation. The structure contains n appropriate criteria, namely cj, j = 1, 2,.., n. In this paper, epidemic prevention works are regarded as criteria.
The evaluation framework proposed in the study is divided into 5 dimensions, so the BWM questionnaire survey must be performed 6 times (the importance of the dimensions and the importance of the criteria under each dimension). When each expert implements BWM, he/she chooses the most important and least important criteria. The most important and least important criteria selected by each expert can be different.
Before the pairwise comparisons of criteria, the importance scale should be set first. Its linguistic variables are shown in
Table 7 [
23]. Experts evaluate the importance of the best criterion
B to other criteria
j (
) to generate BO vector, which is expressed as:
Experts evaluate the importance of other criteria
j to the worst criterion
W (
) to generate OW vector, which is expressed as:
Here, the scale required for self-comparison is “Equally important, E”, namely aBB = 1 and. aWW = 1.
Since the elements of
ABj and
AjW (
aBj and
ajW) are all positive integers, the probability mass density function of the polynomial distribution of
AjW is recorded as:
where
wj is the weight probability distribution of criterion
j. The probability of
wj is proportional to the number of occurrences and the total number of experiments (
ajW), as shown in Equation (4).
If Equation (4) is reasonable,
aWW = 1 is substituted into Equation (4), then
is as shown in Equation (5).
Equations (4) and (5) are combined to get Equation (6).
Equation (6) echoes the concept of conventional BWM. However, the information acquisition methods of
ABj and
AjW are different. The former is that criterion
B is compared to criterion
j. The larger
aBj is, the smaller
wj will be; the latter is that criterion
j is compared to criterion
W, and the larger
AjW is, the larger
wj will be. Therefore,
ABj and
wj have a reciprocal relationship, as shown in Equations (7) and (8).
Similarly, if
aWW = 1 is substituted into Equation (8), then
wB is shown in Equation (9).
Dirichlet probability distribution meets the requirements of MCDM (the weight is greater than or equal to 0, and the total weight is equal to 1), so the Dirichlet probability distribution is used to construct the model, as shown in Equation (10).
where
is a vector parameter. Here,
is set to 1, because this parameter does not affect the prior probability.
Using the Dirichlet probability distribution model to regard
wj as the prior probability distribution, and then, based on the Dirichlet distribution
wj for Bayesian estimation, the posterior probability distribution model is
where
and
.
Next, the steps of Bayesian BWM integrating the evaluation data of multiple experts are as follows:
Suppose there are
j criteria,
k experts,
j = 1, 2,..,
n;
k = 1,2,…,
K. The weight of each criterion generated by each expert is
, and the weight of the integrated group is
. The BO vectors of all experts can be constructed into a matrix such as
. Similarly,
represents the OW vector of all experts.
and
are based on the data surveyed by expert interviews to construct a joint probability distribution, as shown in Equation (12).
Each expert’s
and
will generate the weight
, and the group’s weight depends on each expert. The calculation logic of Bayesian is to obtain the final weight through continuous iteration. After the evaluation data of each expert is entered, Bayesian BWM will continuously update to the group’s weight
, and the joint probability of the Bayesian model is shown in Equations (13) and (14).
From Equation (14), the Dirichlet distribution of
under the condition of
can be constructed, as shown in Equation (15).
where
is the average of Dirichlet distribution, and
is a non-negative parameter.
will approximate
to the average value of the Dirichlet distribution, and the degree of approximation is determined by the parameter
, as shown in Equation (16). This method is an important operation of the Bayesian model [
26].
where
a and
b are the shape and scale parameters assigned by gamma.
Finally,
is set to 1
will obey the Dirichlet allocation, as shown in Equation (17).
Bayesian BWM uses the Markov-chain Monte Carlo (MCMC) technique to simulate continuously to calculate the posterior probability distribution to obtain the optimal group weight .
After Bayesian BWM calculations, the researchers must understand whether the generation of
is consistent with the opinions of all experts. We use the concept of Credal Ranking to examine its confidence. Suppose there are two criteria, namely
and
. Then the probability that
is better than
is shown in Equation (18).
where
is the posterior probability of
, and I is the conditional parameter, and it can be calculated only when
is true, otherwise, it is 0. The ranking confidence is calculated by the sample number Q obtained by MCMC, as shown in Equations (19) and (20).
where
represents q
’s from MCMC samples. The higher the ranking confidence, the better, which means that experts have a consensus on the importance of the criteria. For a more detailed introduction of Bayesian BWM, please refer to Mohammadi and Rezaei [
7].
4. Data Collection, Treatment, and Analysis
Bayesian BWM is used to calculate the survey data of this research, and through the valuable epidemic prevention experience of 32 experts, to understand which epidemic prevention criteria are urgent. After the SARS outbreak in 2003, the Taiwanese government paid special attention to the prevention of cross-infection during social activities. Therefore, many private enterprises, organizations, institutions, and groups have formulated preventive measures against serious infectious diseases. Proper use of personal protective equipment and the implementation of infection control measures may help reduce the spread of SARS-CoV-2. Currently, colleges and universities in Taiwan have made many contributions to epidemic control.
According to the framework proposed in
Section 2, Bayesian BWM is used for calculation and analysis. Researchers designed the Bayesian BWM questionnaire for this study. During the interview, the concept of Bayesian BWM and the type of input data were explained in detail. After confirming that the experts understood the content and interview procedures, the researchers began to ask questions and record responses. First, each expert is asked to select the best and worst dimensions/criteria. Next, they conduct an evaluation according to the linguistic variables presented in
Table 7 to obtain
and
.
We use the calculation of dimensions to make an explanation. The interview data of 32 experts are shown in
Table 8 and
Table 9 (the linguistic variables have been converted into crisp values). In
Table 8, the first expert considers
D3 to be the best criterion B, and compares
D3 with other criteria
j, thus generating a BO vector
, which means that the importance of
D3 is the same as that of
D1, and the importance of
D3 is about 3 times that of
D2. The rest can be done in the same manner. Besides, the data in
Table 9 have undergone matrix transposition, so the interpretation direction is opposite to the BO vector.
D4 is considered as the worst criterion. Comparing other criteria
j with
D4, the generated OW vector is
, which means that the importance of
D4 is about 3 times that of
D1, and the importance of
D4 and
D2 is equal.
All experts answered the BWM questionnaire in the same way, and the information obtained was two
matrices (
Table 8 and
Table 9). The criteria under each dimension are similar to the above examples to operate. Therefore, an expert needs to fill out 6 questionnaires. Before the implementation of Bayesian BWM, each BWM questionnaire would be checked for consistency. This step is to ensure the logic and reliability of each expert when they fill out the questionnaire. The average consistency ratio of all the questionnaires is 0.023, indicating a high degree of consistency [
23].
In this study, the MATLAB program provided by Mohammadi and Rezaei [
7] was adopted as the Bayesian BWM calculation software. The Bayesian BWM results are shown in
Table 10. In the dimension part, Health management of faculty, staff, and students (
D3) is the most important factor in the prevention of COVID-19 in colleges and universities (the weight is 0.245), emphasizing that personal health management and hygiene awareness are more important than other dimensions. In addition, looking at the overall evaluation results, it can be seen that the top five are Disinfection of campus environment (
C28), putting those in close contacts with confirmed cases in quarantine (
C38), indoor space ventilation management (
C25), establishment of campus epidemic prevention team (
C11), and formulation of measures for the management of overseas students (
C43). Further discussion and management implications will be presented in
Section 5.
The confidence test of ranking is to check whether the obtained analysis results meet the consensus of most experts. Taking dimensions as an example, the confidence matrix of ranking can be established according to Equations (18)–(20), as shown in
Table 11. For example, the confidence that
D1 is more important than
D2 is 27.02%, and the confidence that
D2 is more important than
D1 is 72.97%, indicating that most experts believe that
D2 is more important than
D1. It is worth mentioning that the difference in confidence between
D2 and
D3 is not that much, indicating that the importance of
D2 and
D3 is quite similar. We observe that the weights of the two dimensions are 0.240 and 0.245, respectively. This result shows that the confidence can correspond to the weight of Bayesian BWM. In general, the average consensus of the experts is as high as 87.25%, including dimensions and all criteria, indicating that the analysis results of the study are reliable.
5. Results and Discussion
The analysis results of this study can be found in
Table 10. Our analysis results echo Chang et al.’s [
27] research. They also believe that the establishment of campus protection measures at a college is an important task. We reviewed many literatures [
27,
28,
29,
30,
31] on campus epidemic prevention and summarized specific findings. The result of this study can provide some management suggestions for the coordinators and decision-makers of campus epidemic prevention.
Figure 1 and
Figure 2 are drawn based on the results of
Table 10.
Figure 1 is a radar chart showing the local weights of the criteria. The larger the local weight, the higher the importance of the criterion in the corresponding dimension. In addition,
Figure 2 is a bar graph constructed by the global weights of the criteria. It is a comprehensive evaluation system (taking into account the weight of dimensions). Decision makers can quickly understand which criteria are important based on these visualizations.
This study discusses the first three important criteria for each dimension. In terms of the establishment of epidemic prevention organizations and control of campus epidemic (
D1), the top three with the highest weights are the establishment of campus epidemic prevention team (
C11), the consolidation of campus epidemic prevention status (
C12), and the establishment of the campus epidemic prevention information system (
C13). Schools must systematically plan a campus epidemic prevention organization to coordinate and assign the members of each organization to collect COVID-19-related information, and to formulate epidemic prevention policies and responses. The stable operation of the epidemic prevention team can effectively implement management and supervise all faculty, staff, and students on campus, which helps to control the epidemic and reduce the risk of infection. In addition, the accurate collection of the overall campus epidemic prevention status can immediately control the infection cases of all faculty, staff, and students, so as to avoid the rapid spread of the virus without knowing it. The campus epidemic prevention information system must achieve transparency in epidemic information so that all faculty, staff, and students can understand the overall situation of the school epidemic, which is conducive to calming faculty, staff, and students on the campus and easing panic over the epidemic. The establishment of an information system also helps government health agencies know about the impact of the epidemic situation of colleges and universities [
28].
In the formulation of campus epidemic prevention measures (
D2), campus environment disinfection (
C28) is particularly important. Alcohol and sodium hypochlorite are used to dehydrate, coagulate, and denature the protein of bacteria or viruses to inhibit the normal function of the protein or destroy its structure to achieve the disinfection effect. This eliminates the virus remaining on public goods and reduces the risk of infection in contact with objects. COVID-19 is also spread by respiratory droplets or direct contact. Therefore, indoor space ventilation management (
C25) is also an important item for epidemic prevention. Although there is no way to completely filter all COVID-19 virus strains through the central air-conditioning circulation system, having a good ventilation environment can effectively reduce the density of the virus and reduce the risk of infection. Anti-epidemic measures, such as access control and body temperature measurement, help screen personnel entering. For the external visitor access management (
C24), through the real-name system and reserved personal epidemic prevention information, it can reduce the entry of outsiders into the campus, which can the risk of external infection on the campus. If there is an epidemic situation, it will help the school to track it afterwards [
27].
In terms of health management of faculty, staff, and students (
D3), putting those in close contacts with confirmed cases in quarantine (
C38) is to first classify close contacts and general contacts. Under the premise of taking protective measures, suspicious cases and close contacts are transferred to quarantine rooms for detailed investigation to prevent cross-infection. To prevent the spread of COVID-19, it can be done through the strengthening of personal hygiene practices (
C34), such as washing hands frequently, wearing masks, and avoiding crowded places. Good hygiene practices to strengthen self-cleaning can help reduce the chance of infection. For people with symptoms of fever, cough, dizziness, fatigue, headache, diarrhea, and difficulty breathing, relevant notification units and channels inside and outside the school should be drawn up. Notification of suspected/confirmed cases (
C31) to campus epidemic prevention units or government health units helps control the spread of the epidemic and reduce the risk of infection [
28,
30].
In terms of remote teaching and contingency measures (
D4), the formulation of measures for the management of foreign students (
C43) is to give priority to relaxing the entry restriction of foreign students from countries with less severe epidemics. Through formulating relevant policies of overseas epidemic prevention and isolation equipment, the standard operating procedures for airport border control, epidemic prevention transportation, and quarantine venues are implemented to ensure that the rights of overseas students are not affected while conducting the epidemic prevention operations. The formulation of contingency measures for admissions interview and selection (
C45) refers to the preparation of relevant contingency measures, such as interview and selection for admissions through video communications, or meeting discussions through videoconference, when people encounter irresistible matters so that campus activities will not be delayed, suspended, or terminated. Contingency measures help prevent school administration from shutting down due to the epidemic. If the school has two confirmed cases, all of the classes must be suspended (
C42) to avoid the spread of the epidemic on campus, and to maintain the safety and health of students and staff on campus. The government has stipulated that if a student or instructor is listed as a confirmed case on campus, all classes the student takes or classes taught by the instructor will be suspended. If more than two instructors or students are listed as confirmed cases, the school will suspend all classes. The number of infected persons determines the number of days of class suspension [
28].
In terms of student extracurricular affairs management (
D5), the school uses internships to expose students to workplace work early. However, due to the epidemic situation, many overseas internship opportunities have been suspended. It is necessary to re-formulate responding measures (abroad) of relevant overseas internship (
C55) to modify the measures for overseas internships and back-to-Taiwan internships, so that students can have corresponding supporting measures during the epidemic. In response to reported cases, suspected cases, or confirmed cases on campus, formulation of home quarantine measures for dormitories on campus (
C56) is proposed to plan and adjust ahead of time which dormitories on campus are quarantine dormitories and which dormitories are non-quarantine dormitories to ensure that the campus provides effective quarantine dormitories and at the same time protects the original boarding students’ right to stay. In addition to formulating contingency measures for oversea internships, it also needs to formulate internship responding measures for domestic internships (domestic) (
C54). By adjusting and delaying students’ domestic internship opportunities, other courses and plans are arranged to overcome the inconvenience during the epidemic [
31].
For the overall results, the top 10 epidemic prevention works can be ranked through the Bayesian BWM analysis as
C28C38C25C11C43C34C24C31C37C12. The priority of the criteria can provide a basis for colleges and universities to establish epidemic prevention measures. As long as the epidemic prevention is done well, colleges and universities can reopen their campuses safely and as soon as possible [
29].