Next Article in Journal
Urban and Rural Disparities in Pneumococcal Carriage and Resistance in Jordanian Children, 2015–2019
Next Article in Special Issue
The Long and Winding Road: Uptake, Acceptability, and Potential Influencing Factors of COVID-19 Vaccination in Austria
Previous Article in Journal
Animal Models Utilized for the Development of Influenza Virus Vaccines
Previous Article in Special Issue
Predictors of COVID-19 Vaccine Hesitancy: Socio-Demographics, Co-Morbidity, and Past Experience of Racial Discrimination
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Efficiency in COVID-19 Vaccination Campaigns—A Comparison across Germany’s Federal States

Department of Economics, Justus Liebig University Giessen, Licher Strasse 62, 35394 Giessen, Germany
*
Author to whom correspondence should be addressed.
Vaccines 2021, 9(7), 788; https://doi.org/10.3390/vaccines9070788
Submission received: 27 May 2021 / Revised: 7 July 2021 / Accepted: 9 July 2021 / Published: 14 July 2021
(This article belongs to the Special Issue Vaccines: Uptake and Equity in Times of the COVID-19 Pandemic)

Abstract

:
Vaccination programs are considered a central pillar of the efforts to stop COVID-19. However, vaccine doses are scarce and several organizational and logistical obstacles, such as the timing of and reserves for second shots and delivery failures, apparently slow down vaccination roll-outs in several countries. Moreover, it is an open question as to where vaccines are administered as efficiently as possible (vaccination centers, hospitals, doctor’s offices, pharmacists, etc.). The first aim of our study was to systematically evaluate the efficiency of a country’s vaccination campaign. The second aim was to analyze how the integration of doctors’ offices into a campaign that formerly relied only on vaccination centers affected the speed of that campaign. Using data on vaccine deliveries and vaccinations given in Germany, we find considerable differences across federal states in terms of efficiency, defined as the ability to administer the most vaccinations out of a given number of available doses. Back-of-the-envelope calculations for January to May 2021 show that vaccinations would have been 3.4–6.9% higher if all federal states had adopted a similar ratio between vaccinations given and vaccines stored, as the most efficient states did. This corresponds to 1.7–3.3% of Germany’s total population. In terms of our second research goal, we find evidence that the integration of doctors’ offices into the vaccination campaign significantly increased the ratio of vaccinations administered out of a given stock of vaccine doses. On average, there appears to be a structural break in this ratio after doctors’ offices were integrated into the vaccination campaign on 5 April 2021. On average, an additional 11.6 out of 100 available doses were administered each week compared to the period prior to that date. We conclude that there are considerable regional differences in the efficiency of the vaccination roll-out. Systematic efficiency analyses are one step to detecting inefficiencies and to identify best practices that can be adopted to eventually speed up the vaccination roll-out in a country.

1. Introduction

On 31 December 2019, the World Health Organization was informed of a new kind of infectious disease that was first identified in Wuhan, China [1]. It took only a few months for the virus, later known as SARS-CoV-2, to become a pandemic and spread across the globe [2,3]. By the time this paper was written, the total number of casualties was over 3.9 million worldwide, with over 180 million confirmed cases (data provided by WHO as of 28 June 2021, see https://covid19.who.int/, accessed on 28 June 2021).
Vaccination is considered a central pillar in the effort to stop the COVID-19 pandemic [4]. Despite the scarcity of vaccines, and subject to a prioritization of vulnerable and/or exposed individuals within the population [5,6], the policy goal is clear: roll out the available doses as quickly and efficiently as possible. However, the administrative and logistical challenges are substantial [7,8,9]. For instance, many countries report difficulties in the logistics of the vaccination roll-out, including unexpected delivery failures and the timing of second shots [10]. To overcome these obstacles, vaccine reserves are built. When reserves are too low, appointments have to be re-scheduled and no more shots can be given. When reserves are too high, more vaccinations could be given without compromising second shots. Vaccinations are at a sub-optimal level in both situations. It is important to detect and eventually avoid these inefficiencies that prolong the pandemic and cost lives [11,12,13]. This article analyzes this problem using Germany and its federal states as an example.
Another important aspect of the vaccination roll-out’s efficiency is the question of where the population can receive vaccinations. Potential candidates include vaccination centers, hospitals, retail pharmacies or doctors’ offices. The integration of general practitioners into a country’s vaccination campaign has been especially discussed in the literature, for instance, in terms of overcoming vaccine “hesitancy” in the population [14].
The vaccination roll-out in Germany started in December 2020. Even though every federal state faces essentially the same problem of determining the optimal level of vaccine reserves to maintain a smooth vaccination campaign, the 16 federal states show noticeable differences in the progress of their respective vaccination roll-outs. The vaccination campaign in Germany was based in vaccination centers until 5 April 2021, when doctors’ offices were officially integrated into the campaign (https://bit.ly/35PaZoi, accessed on 28 June 2021).
The aims of our study are two-fold. The first aim is to determine a measure of the efficiency of the federal states’ vaccination campaigns. Data Envelopment Analysis (DEA) is used to analyze relative efficiency by systematically comparing vaccine deliveries and stocks (input) with vaccinations given (output). Those federal states that are able to maintain a smooth vaccination campaign with the lowest vaccine reserves are identified as efficient. Efficiency is interpreted in relative terms, thus the most efficient federal states constitute a lower bound on efficiency. The benefits of decreasing inefficiencies can be approximated in a counterfactual scenario where it is assumed that every federal state adopts the ratio between vaccinations given to available doses as the most efficient states. The second aim of our study is to investigate the effect the integration of doctors’ offices had on Germany’s vaccination campaign. We do so using a fixed effects panel regression.

2. Materials and Methods

2.1. Dataset & Ethical Approval

Our dataset is comprised of two sources of data. Data on vaccine deliveries are available on the website of the Federal Ministry of Health, https://bit.ly/3vQAu3a (accessed on 28 June 2021). Data on daily vaccinations are published online by the Robert Koch Institute (RKI), https://impfdashboard.de/ (accessed on 28 June 2021). On the official website of the RKI, only recent data on vaccinations are available. However, historical data are made available via github.com by members of the German public broadcaster ARD, https://bit.ly/3vWPzQH (accessed on 28 June 2021). Our observation period was 27 December 2020 (when the first delivery arrived) to 16 May 2021.
The data used in this study are publicly available, highly aggregated and completely anonymized. We therefore consider this study exempt from ethical review.
In Germany, two mRNA-based vaccines produced by Biontech/Pfizer and Moderna and one vector-based vaccine produced by Astra-Zeneca were used. Towards the end of the observation period, a second vector-based vaccine produced by Johnson&Johnson was approved. According to contemporary guidelines in Germany, immunization with mRNA-based vaccines (and the vaccine produced by Astra-Zeneca) required two shots that had to be given within 6 weeks (12 weeks). Only one dose of the vaccine produced by Johnson & Johnson was required. Official guidelines were provided by the Federal Institute of Vaccines and Biomedicines (Paul Ehrlich Institute) (https://bit.ly/2Qud8le, accessed on 28 June 2021); an overview of the relevant information on storage requirements can be found, for example, here: https://bit.ly/2RmHy9J (accessed on 28 June 2021).
The data published by RKI are frequently revised ex post. Occasionally, RKI reported daily vaccinations of zero for some federal states. Missing vaccinations are apparently attributed to subsequent days by RKI. As a consequence, the data presented here might differ slightly from the aggregated figures published by RKI.

2.2. Method: DEA

A DEA is a method for comparing the relative efficiencies of different Decision Making Units (DMUs). The method was formalized by [15]. Since then, it has been used to analyze the performance of water [16] or electricity [17] suppliers as well as railroad firms [18]. In the health care sector, the method has been applied to hospitals [19,20] and also to vaccination centers [21]. The concept is closely related to cost-effectiveness and cost-utility analyses in health economics [22,23]. For an extensive review of the various applications and refinements of the technique, see [24].
In a DEA, efficiency is measured as a deterministic ratio between inputs and outputs. In the original formulation of [15], there are j = 1 , , n DMUs with r = 1 , , s outputs and k = 1 , , m inputs. The known values of output r and input k of DMU j are denoted by y r j and x k j , respectively. To find the most efficient among the n DMUs, the following program can be used:
max u r , v k       h 0 = r = 1 s u r y r 0 k = 1 m v k x k 0 s . t . r = 1 s u r y r j k = 1 m v k x k j 1   j = 1 , , n , v r , u k 0   r = 1 , , s , k = 1 , m .
The weights v r , u k are endogenously determined by a comparison of all DMUs included as a reference. The problem can then be reformulated to yield a program that is solvable via linear programming. A detailed derivation can be found in [15] or in textbooks such as [25].
In addition to a DEA with constant returns to scale (CRS), DEAs were computed under the assumption of variable returns to scale (VRS). In a VRS DEA, the production possibility frontier is non-linear and defined by multiple DMUs. The concept of VRS DEA goes back to [26] and is sometimes also referred to as the BCC model. Note that the BCC model has a slightly different optimization problem; for a more detailed overview, see Chapter 2 in [25]. The question of whether CRS or VRS is assumed is especially important in applications in the health care sector [25], Ch. 16.4.4.2, especially when it comes to the analyses of vaccination centers [21].
The DEA is an appropriate method for analyzing the relative efficiency levels of the vaccination roll-out of Germany’s federal states for the following reasons. The DEA is a non-parametric method, that is, no assumptions on the functional form of the production function have to be imposed. Second, the DEA is used to analyze the relative performance of not-for-profit entities. In the case at hand, the overall policy goal is to maximize output, that is, to roll out as many vaccinations as possible given the available doses. This is in contrast to, for example, a profit maximizing firm that takes into account the price effects of its output choice.
Three types of models were computed with different output variables. In models T, 1S and 2S, the respective output variables are the total number of shots given, the total number of first shots given and the total number of second shots given in week t. The observation period for model 2S starts on 17 January 2021, the day the first second shot was recorded. Comparing the results of models 1S and 2S allows for an identification of the prioritization of federal states. A federal state that has high scores in model 2S but performs relatively poorly in model 1S can be considered to prioritize the full immunization of the population.
The input variable is the sum of vaccine deliveries in week t and vaccine reserves in week t 1 . This variable approximates the amount of doses available for vaccination in week t. Even though this variable potentially overestimates the number of available doses in absolute terms (e.g., because doses arriving towards the end of week t might not be available for vaccination in that week), it does not systematically bias the comparison of the federal states because every state is affected in the same way (see the fluctuations in deliveries presented in Section 3.1 The results are robust to variations in the input variable. As an example, the results of DEAs computed with vaccine reserves in t 1 are presented in Appendix A.
In this study, separate DEAs were computed for each week. A federal state can then be considered efficient if it receives high scores in many periods. This was done because the scores of a single DEA might be biased, for example, due to large deliveries to a federal state (or the lack thereof) towards the end of the respective observation period, which can lead to relatively high (or low) inputs in relation to outputs compared to federal states that did not (or did) receive larger shipments. A further advantage of examining the results of multiple DEAs is that the results become more robust against outliers resulting from, for example, errors in the data or public holidays in some but not all federal states.

2.3. Method: Counterfactual Scenario

To illustrate the potential impact of improvements in efficiency on the progress of the vaccination campaign, a back-of-the-envelope calculation was carried out. A ratio of total vaccinations given in week t (output) to vaccine deliveries in week t and vaccine reserves at the end of week t 1 (input) was determined. Formally, federal state i’s share in week t reads:
s i , t = vaccinations i , t deliveries i , t + reserves i , t 1 .
For example, s i , t = 0.6 would indicate that in federal state i in week t, 60 % of the doses available for vaccination in week t are actually administered, whereas the remaining 40 % are held back as reserves.
The following counterfactual scenario was assumed to compute the potential gain in vaccinations administered when efficiency is improved. Suppose federal states k and l are identified as the most and second most efficient federal states, respectively, by the DEA described in Section 2.2. In the counterfactual analysis, it was assumed that each federal state that is identified as inefficient by the DEA adopts the ratio of vaccinations given to available doses in k in each week t. Formally, s i , t = s k , t for all i and t. A more conservative perspective was taken by assuming that each federal state, except for k, adopts the ratio of the second most efficient federal state l, s i , t = s l , t for all i k and t.

2.4. Method: Vaccination at Doctor’s Offices

Based on the data, it was tested whether there was a structural break in s i , t , as defined in Equation (2), after 5 April 2021, when general practitioners were integrated into Germany’s vaccination campaign. In doing so, the following fixed effects panel regression was estimated:
s i , t = α + β t + δ D April 5 + D i + ϵ i , t .
The dependant variable in Equation (3) is the share s i , t . Note that this is the ratio between (unweighted) output and input of DEA model T (see above). The observed shares are depicted in Section 3.1 for each federal state.
In Equation (3), s i , t is explained by a time trend t, the variable D April 5 takes the value 1 for the period after 5 April 2021 and 0 otherwise, as well as a federal state specific fixed effect D i . The latter controls for time-invariant effects specific to a federal state. This approach allows for an investigation of whether the integration of doctors’ offices into the German vaccination campaign potentially improved the efficiency of the campaign on average.

3. Results

3.1. Results: Descriptive Statistics

In Figure 1, daily vaccine deliveries and vaccines administered are depicted for each federal state as well as for Germany as a whole (DE) for the period from 27 December 2020 to 16 May 2021. One can see that deliveries are relatively infrequent and their magnitude varies. This corroborates the organizational challenge of the vaccination campaign, especially against the background that it is necessary to administer two shots to achieve full immunization. Remarkably, Saarland (SL) received a delivery of over 80,000 vaccines at the end of March. These deliveries, however, seem to have barely affected contemporary vaccinations. Given that Saarland continued to receive relatively high deliveries in subsequent weeks, this indicates that reserves built up. Recall that observations of zero or even negative vaccinations administered stem from errors in the data, which are corrected by RKI ex post.
Table 1 presents an overview of total deliveries, vaccinations broken down by first and second shots, and storage quotas for the first quarter of 2021. The storage quota relates deliveries to total vaccinations. For instance, Bremen (HB) had 6164 doses in stock, which was approximately 4.66% of total deliveries. Note that Table 1 provides a snapshot: storage quotas are inflated in some federal states (e.g., Saarland (SL); see above) that received large shipments by the end of the first quarter whereas others did not.
Figure 2 presents vaccine reserves broken down by federal states for the period from 27 December to 16 May 2021. For Germany as a whole (DE), towards the end of the observation period there were almost 6 million doses in stock. This constitutes jabs for over 7 % of Germany’s population (83,190,556 people as of 30 September 2020, based on information provided by the Federal Statistical Office, https://bit.ly/3bOABoR, accessed on 28 June 2021). One can see a sawtooth-like shape of deliveries and vaccinations given; however, the level of reserves drastically increases over time. Even though some federal states, such as Bremen (HB), apparently reduced vaccine reserves to some degree during the observation period towards mid May, every federal state seems to have built up substantial vaccine reserves. Again, daily data have to be interpreted with care due to the ex-post revisions of RKI.
Finally, Table 2 presents descriptive statistics on reserves per first doses given. For instance, in Brandenburg, an average of 0.47 doses were held as reserves per first shot given with a median of 0.39 . Consistent with the observations described above, Bremen shows relatively low median reserves whereas federal states, such as Saarland (SL) and Lower-Saxony (NI), apparently had relatively high median reserves.
Figure 3 illustrates that s i , t has substantial fluctuations over time in most federal states and differs remarkably between them. For instance, in Bremen (HB), that share relatively quickly increases to values over 0.4 and even jumps to over 0.8 , whereas in Saarland (SL) the share never exceeds 0.5 .

3.2. Results: DEA

Table 3 presents the results of the mean DEA scores in Models T, 1S and 2S of DEAs performed for each week of our observation period. Here, constant returns to scale (CRS) were assumed.
Table 3 shows that Bremen was assigned the highest average DEA score with 0.8289 in model T, 0.7842 in model 1S and 0.689 in model 2S. This indicates that Bremen (HB) had the most efficient vaccination roll-out in Germany under the CRS assumption.
One might argue that the results of a small federal state, such as Bremen with a total population of less than 600,000, are not applicable to larger federal states such as Bavaria (BY) or Northrhine-Westphalia (NW) with populations of 13.8 million and almost 18 million, respectively, and a lower population density. Likewise, Bremen receives fewer vaccine deliveries (see above), which potentially eases the organizational burden of the vaccination roll-out. In other words, a vaccination campaign might be susceptible to decreasing returns to scale so that it becomes increasingly difficult to distribute vaccinations the larger the input of vaccines. Thus, the scores of VRS DEAs for each week of the observation period were computed. The average scores are presented in Table 4.
The results presented in Table 4 show that Bremen is assigned average DEA scores of 1 in every model. This means that Bremen is among the federal states that define the production possibility for every week. In contrast to the CRS DEA, larger federal states, such as North Rhine-Westphalia, were assigned significantly higher DEA scores.
Potential drivers of the different levels of efficiency are explained in Section 4. Appendix A contains a more thorough discussion of the results of the DEA as well as a robustness check.
The results presented in Table 3 and Table 4 indicate differences in the prioritization of first and second shots between federal states. Apparently, federal states with lower scores in model 1S than in model 2S (e.g., Saxony, SN) focus on full immunization of the population whereas federal states with lower scores in model 2S than in model 1S (e.g., Lower Saxony, NI) seem to prioritize first shots.

3.3. Result: Counterfactual Scenario

Assuming that all federal states adopt the ratio (2) for Bremen ( s HB , t ) or North Rhine-Westphalia ( s NW , t ) in each week t, we compute hypothetical vaccinations given per federal state. The results are presented in Table 5.
The results presented in Table 5 indicate that over 2.7 million ( + 6.85 % ) more vaccinations would have been given until 16 May 2021 if all federal states had adopted s HB , t in each week t. This corresponds to 3.29% of the German population.
A comparison with North Rhine-Westphalia, whose vaccination roll-out is remarkably efficient given the size of the federal state, yielded less optimistic, yet noticeable results. According to the figures presented in Table 5, almost 1.4 million more doses would have been administered if all federal states (except for Bremen) had adopted North Rhine-Westphalia’s ratio between vaccinations given and reserves and deliveries. This still corresponds to 1.65% of the entire population and constitutes a plus of around 3.44%.

3.4. Results: Vaccination at Doctor’s Offices

The results of the fixed effects panel regression Equation (3) can be found in Table 6.
The results presented in Table 6 indicate that there was a statistically significant structural break on 5 April 2021, for Germany. That is, s i , t increased by 11.6 % on average in the period after 5 April 2021, compared to the period prior to that date. In other words, the share of doses held back as reserves decreased by the same fraction on average. This means that, on average, 11.6 more out of 100 available doses—measured by vaccine reserves plus vaccine deliveries—were given each week.
The results indicate that the structural break diagnosed on average for Germany seems to be driven by some federal states that exhibit a relatively strong structural break (e.g., NW). Not every federal state shows a statistically significant structural break in the period after 5 April 2021. Moreover, on average, based on the results presented in Table 6, no statistically significant time trend was diagnosed. These findings are supported by the various robustness checks presented in Appendix B. These findings not only capture the effect of the integration of doctors’ offices into the vaccination campaign as is discussed in Section 4.

4. Discussion

The primary aim of the present study was to determine a lower bound on efficiency in the German federal states’ vaccination campaigns. Several DEAs were performed and Bremen apparently defines the efficiency frontier during the observation period. Among the larger federal states, North Rhine-Westphalia receives remarkably high efficiency scores. With VRS, this federal state has relatively high average efficiency scores, whereas under CRS its average scores are relatively low.
A counterfactual scenario was computed based on a back-of-the-envelope calculation. It was shown that an increase in efficiency could have led to an increase in vaccinations in the magnitude of 3.44–6.85%, which corresponds to 1.65–3.29% of the German population. This shows that analyses of the efficiency of vaccination roll-outs can play an integral role in overcoming the COVID-19 pandemic. Avoiding excessive reserves is crucial—a vaccine that is unused cannot save lives. That countries handle the vaccine doses available to them as efficiently as possible seems to be particularly important against the background of pronounced vaccine scarcities in low-income countries (e.g., [27]).
By the time this paper was written, 53% (34.5%) of the German population had received a first (second) shot. In comparison to the other 30 countries of the EU/EEA, Germany ranks eighth (sixth) when it comes to first (second) shots. The German vaccination campaign was slower compared to some non-EU countries: the United States (first shots: 53.5%, second shots: 45.5%), Canada (67.4%, 25.6%), Israel (64%, 59.6%) and the United Kingdom (65%, 47%) (see https://ourworldindata.org/covid-vaccinations, accessed on 28 June 2021). In the literature, organizational and country-specific factors that influence the speed and efficiency of the COVID-19 vaccination roll-out are identified. Potential drivers of the high speed of Israel’s vaccination campaign include the small size of the country both in terms of area and population, a relatively young population, an efficient health care system with IT-heavy organization, large vaccine orders and a clear prioritization system for vaccinations within the population in the early phases of the distribution process [28,29]. In particular, Israel relaxed its prioritization system at some point to avoid diminishing returns [30]. A similar strategy was pursued in the USA [31]. There is also evidence that the use of online communication effectively increased the speed of the United States’ vaccination campaign [31,32]. In contrast to that, for example in the UK, appointments were initially allocated mostly by text messages or mobile phone calls. The vaccination campaign in the UK was sped up when officials decided—as one of the first countries worldwide—to extend the interval between first and second shots of two important vaccines in order to vaccinate as many people as possible at least once [33].
Given the little information that is publicly available regarding the administrative processes of the vaccination roll-out in the different federal states, it is difficult to pinpoint certain aspects where the federal states’ organization of the vaccination roll-out differs. Possible explanations for the observed differences in efficiency include diverging practices when it comes to building reserves to, for example, avoid the re-scheduling of future appointments (https://bit.ly/2RoBAoO; all links in this section accessed on 28 June 2021), the handling of appointments for the different priority groups (https://bit.ly/3ob1Leu), the use of more efficient syringes (https://bit.ly/3hyfDyj) and the administration of appointments (https://bit.ly/3tFoi4h).
According to the results presented in Section 3.2, Bremen’s vaccination campaign is apparently the most efficient. It is remarkable that the state’s vaccination campaign was not solely planned and executed by Bremen’s government. Local firms have supported the campaign by establishing a vaccination initiative (“Bremen impft”, https://bit.ly/3x1JmVd). This collaboration between private firms and public officials is responsible for the administration of the—by the contemporary standards as of March 2021—largest vaccination center in Germany (https://bit.ly/3gWP05b). Moreover, it is documented that there was close cooperation with health insurance companies to systematically identify and allocate appointments to high-risk patients in Bremen (https://bit.ly/3y1Bi6Y).
The second aim of this study was to analyze the effect that the integration of general practitioners into Germany’s vaccination campaign on 5 April 2021 had on efficiency. The results indicate that there was a structural break for Germany as a whole in the period after that integration. On average, 11.6 more out of 100 available doses were vaccinated per week compared to the period before 5 April. This indicates that the integration of doctors’ offices into the campaign has sped up the vaccination roll-out.
While in other countries, such as the UK, general practitioners have been part of the vaccination campaign from the beginning (https://nyti.ms/2UOTi6h), in Germany, doctors’ offices were officially integrated into the campaign roughly four months after the beginning of the vaccination roll-out. Approximately 35,000 general practitioners started to administer COVID-19 vaccinations in the week after Easter in Germany. With around 102,000 doctors’ offices in Germany, this is around one third (https://bit.ly/35Y3748). In total, practitioners have ordered 1.4 million doses for vaccination in calendar week 14 (https://bit.ly/3x2yLcw). This number has continuously increased in subsequent weeks. Based on the dataset used in this paper, deliveries to doctors’ offices were around 2.5 million doses in calendar week 19, on a par with those to vaccination centers.
General practitioners order the desired number of vaccine doses for week t + 1 until Tuesday of week t at local pharmacies. The orders of each federal state are centrally monitored to ensure a fair allocation of doses across Germany. Physicians are informed on Thursday of week t about how many doses they will receive in week t + 1 . Appointments are scheduled at the general practitioner’s discretion (see https://bit.ly/3qEHPSB). Practitioners were officially constrained by the prioritization system until 7 June 2021, when the system was abandoned (see https://bit.ly/3qxJPMs). Administering COVID-19 vaccinations is associated with a relatively large bureaucratic burden on general physicians, which is considered especially cumbersome because those vaccinations are an extra service offered by practitioners [34].
The results of the present paper have implications for clinical management. First, expectation management seems to be important. An efficient vaccination roll-out with as little reserves as possible can make it necessary to communicate that appointments (especially for first shots) might be re-scheduled in case of delivery disruptions. Second, integrating doctors’ offices into a vaccination campaign can apparently speed up a vaccination roll-out that is otherwise based on vaccination centers. Third, the results above indicate that the more efficient management of appointments (reserves for second shots, (re-)scheduling, identification of vulnerable individuals) can be considered a way to improve efficiency. The German vaccination campaign appears to be characterized by a high degree of bureaucracy. Even though further research is necessary, more flexible, innovative and IT-based solutions can be expected to speed up the vaccination roll-out.
The present study has some limitations. First, it constitutes a rather high level approach. A lower bound on efficiency, rather than an optimal inventory management, was determined. The latter could be analyzed, for example, in an (s,S)-model [35]. Such an approach requires a more sophisticated dataset including, for instance, information about planned vaccine deliveries. Moreover, the decision makers’ expectations have to be accounted for and the trade-off between first and second shots has to be discussed [36]. Second, the study at hand suffers from a lack of information about the administrative details and the causes of the differences in detected efficiency levels. The DEAs could also be enriched by more detailed information about health care workers, the number of vaccination centers, demographic and geographic factors, and so forth. Third, based on the data available to the authors by the time this paper was written it was impossible to analyze whether the vaccination of the most vulnerable individuals in terms of their risk of mortality was actually prioritized. Fourth, systematic, historical data on vaccine deliveries to doctors’ offices and to vaccination centers per federal state were also not available to the authors. This study therefore relied on a statistical analysis of the time series of vaccinations given and the available doses. As such, the structural break we identified in Section 3.2 might not only be driven by doctor’s offices being integrated into the vaccination campaign. It cannot be excluded that other factors also affected s i , t (see Equation (2)) and influenced the results. For instance, one of these factors could be the findings of [37] that a 12-week, rather than a shorter, timespan between first and second shots of the vaccine produced by Astra-Zeneca does not reduce protection against COVID-19. This might have led decision makers to reduce stock holdings of Astra-Zeneca’s vaccine, that is, all else being equal, leading to an increase in s i , t . If this happened (with some delay) in the period after 5 April 2021, the effect of the integration of doctors’ offices into the vaccination campaign would be overestimated.
Most of the above limitations stem from a lack of appropriate data. If these data become available in the future, further analyses on the topic will be fruitful.

5. Conclusions

This study is a first attempt to systematically analyze the efficiency of the COVID-19 vaccination roll-out in different regions of a country. This exercise allows one to identify a lower bound of efficiency of that country’s vaccination campaign. Similar analyses can be performed for other countries as well, especially because data requirements are minimal. We used Germany as an example. Our findings indicate that efficiency comparisons, such as DEA, can be valuable for detect ing inefficiencies in a vaccination roll-out. Our results on the effect of integrating general practitioners into the vaccination campaign indicate an important avenue for how the administration of vaccinations might be sped up.

Author Contributions

Conceptualization, G.G. and D.H.; methodology, J.T.S., P.-A.K. and D.H.; software, J.T.S. and P.-A.K.; validation, G.G., D.H., J.T.S. and P.-A.K.; formal analyses, G.G., D.H.; investigation, G.G., D.H.; data curation, J.T.S.; writing—review and editing, G.G. and D.H.; visualization, J.T.S. and P.-A.K.; supervision, G.G. and D.H.; project administration, D.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study, because publicly available, highly aggregated and anonymized data were used.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data used in our study are publicly available on the website of the Federal Ministry of Health (https://www.bundesgesundheitsministerium.de/coronavirus/faq-covid-19-impfung.html; accessed on 28 June 2021), the Robert-Koch-Insitute (RKI) (https://impfdashboard.de/; accessed on 28 June 2021) and Github (https://github.com/ard-data/2020-rki-impf-archive/tree/master/data/9_csv_v2; accessed on 28 June 2021).

Acknowledgments

We would like to thank Samuel de Haas, Maximilian Gail, Peter Tillmann, Stefan Seifert, Walter Krämer and Jens Brunner for helpful comments. We thank Michael Kreil for continuously updating RKI-data on github.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
RKIRobert-Koch-Institute
DEAData Envelopment Analysis
DMUDecision making unit
CRSConstant returns to scale
VRSVariable returns to scale
BCCBanker, Charnes and Cooper
DEGermany
HBBremen
THThuringia
BEBerlin
BBBrandenburg
SHSchleswig-Holstein
NILower Saxony
HHHamburg
BYBavaria
BWBaden-Wuertemberg
HEHesse
RPRhineland Palatinate
STSaxony-Anhalt
NWNorthrhine-Westphalia
MVMecklenburg Western Pomerania
SNSaxony
SLSaarland

Appendix A. DEA

The influence of diminishing returns to scale was controlled for in the VRS DEA. However, there are further factors potentially affecting the results.
It is documented that there were occasional failures to deliver vaccines to certain areas (https://bit.ly/3uGEIul; accessed on 28 June 2021). Even though these are out of the control of the decision makers, it is unlikely that these delivery failures to individual federal states systematically affects the DEA scores over a period of over 4 months. The same holds for large-scale delivery failures of the vaccine of Astra-Zeneca (https://bit.ly/3jok2oe; accessed on 28 June 2021)). Moreover, the delivery failure of Astra-Zeneca’s vaccine affected Germany as a whole so that it should not affect the relative efficiencies of the federal states’ vaccination roll-outs.
One could argue that it is more difficult for the elderly to make and keep their appointments. This means that the broader the range of age cohorts eligible of being vaccinated the more strongly this could affect the DEA scores because, e.g., it requires more effort to vaccinate the elderly. In the first quarter the majority of vaccinations were given to the groups with highest (aged 80+) and second highest (aged 70–79) priority. Note that in the official regulation (“CoronaImpfV”) priority groups within the population are not only defined by age but also by other factors, such as prior diseases, social relevance or exposition to infected people. The official regulation can be found here: https://bit.ly/2TbIpdR (accessed on 28 June 2021). It does not appear to be the case that demographics largely impact our results. Despite some overlaps, the federal states’ age profiles (see https://bit.ly/349YNhb; accessed on 28 June 2021) do not seem to affect the results of our DEA. The following example illustrates this. If demographics had a significant impact on the relative success of the federal states’ vaccination roll-outs, federal states with a younger population such as Hamburg (HH) with an average age of 42.1 would have an advantage over those with an older population such as Thuringia (TH) with an average age of 47.4 years. Hamburg and Thuringia have about the same population while Hamburg is significantly smaller in terms of area. However, according to the results presented in Table 3 and Table 4 Hamburg is not unambiguously more efficient than Thuringia.
By the same token, our results do not seem to be largely driven by the federal states’ geography. For instance, Bremen (HB), the most efficient federal state, and Saarland (SL), among the federal states with the lowest efficiency scores, are both relatively small federal states. However, the scores of the federal states with the lowest population density, Mecklenburg Western Pomerania (MV) and Brandenburg (BB) might be driven by the countries’ geographies at least to some extent. Note that Mecklenburg Western Pomerania is assigned relatively high scores in model T (see Table 1 and Table 2 in the main text), which means that the federal state performs relatively well despite its dispersed population, anyway. In these countries one would expect that it is relatively difficult for people in rural areas to reach vaccination centers and that doctor’s offices are more efficient distributors of vaccination than large vaccination centers. Indeed, our analyses presented in Section 3.4 provide evidence that the integration of doctor’s offices into those country’s vaccination campaigns might have substantially increased efficiency. A fruitful extension would be to cluster the federal states. This would allow the researcher to identify the most suitable candidates for benchmarking.
A DEA with a different input is presented to demonstrate the robustness of the results presented in the main text. Table A1 and Table A2 present the average DEA scores of CRS and VRS DEAs computed for the period 27 December 2020 to 16 May 2021 with only vaccine reserves in week t 1 as the input variable (rather than vaccine reserves in t 1 plus vaccine deliveries in week t). The results remain largely unchanged.
Table A1. Average efficiency scores for the period 27 December 2020 to 16 May 2021 for DEAs performed on a weekly basis under the CRS assumption using vaccine reserves at the end of the previous week as the input variable. Models T, 1S and 2S use total, first and second shots given as the respective output variable.
Table A1. Average efficiency scores for the period 27 December 2020 to 16 May 2021 for DEAs performed on a weekly basis under the CRS assumption using vaccine reserves at the end of the previous week as the input variable. Models T, 1S and 2S use total, first and second shots given as the respective output variable.
Federal StateT1S2S
BB0.42860.39880.3399
BE0.58220.5620.6169
BW0.41860.42760.3587
BY0.6090.62210.5104
HB0.79610.78460.7055
HE0.40810.41750.3945
HH0.5090.52380.4301
MV0.60640.56130.4875
NI0.38680.40550.3063
NW0.47730.51120.3465
RP0.60690.57520.4555
SH0.59250.57110.43
SL0.39990.42430.3289
SN0.37880.35430.4116
ST0.39340.39790.353
TH0.53830.52570.5536
Table A2. Weekly average DEA efficiency scores for the period 27 December 2020 to 16 May 2021 under the VRS assumption using the vaccine stock at the end of the previous week as the input variable. Models T, 1S and 2S uses total, first and second shots given as the respective output variable.
Table A2. Weekly average DEA efficiency scores for the period 27 December 2020 to 16 May 2021 under the VRS assumption using the vaccine stock at the end of the previous week as the input variable. Models T, 1S and 2S uses total, first and second shots given as the respective output variable.
Federal StateT1S2S
BB0.53510.5130.4278
BE0.74660.70670.7372
BW0.63720.66440.5538
BY0.93060.9020.7484
HB0.97650.97650.9753
HE0.56240.5580.4916
HH0.61150.63410.5095
MV0.71520.70760.5812
NI0.5880.59770.4124
NW10.9470.8212
RP0.77480.72570.6129
SH0.73140.71870.5911
SL0.49280.52450.4633
SN0.49220.45050.5259
ST0.49480.50520.4366
TH0.6430.61790.6849

Appendix B. Estimations

In the remainder of the Appendix, additional information to Section 3.4 are presented. First, we present an alternative estimation to analyze the effect of the integration of doctor’s offices into Germany’s vaccination campaign. The following fixed effects regression is estimated:
s i , t = α + β t + γ i D i × t + δ D April 5 + D i + ϵ i , t .
In Equation (A1), the share s i , t is explained by a time trend, a federal state dummy D i interacted with the time trend and the dummy variable D April 5 which takes the value 1 in the period starting on 5 April 2021 and 0 otherwise. Federal state-specific fixed effects are denoted D i . With this specification, it is possible to disentangle how the share of vaccinations given in week t in relation to deliveries in week t and reserves in week t 1 evolves over time in the different federal states. The fixed effects are chosen such that the effect of the interaction term D i × t has to be interpreted relative to the federal state Bremen (HB), as will be explained in more detail below. The results are presented in Table A3.
The results indicate that the share s i , t is significantly higher (1%-level) in the period after 5 April, which means that, on average, there is a structural break. The order of magnitude of the effect is the same as that presented in the main text. Note that this effect can be driven by doctor’s offices being integrated into Germany’s vaccination campaign, even though we cannot exclude that other factors also affected the results (see the discussion in the main text).
According to the results presented in Table A3 the share s i , t evolves over time on average. Every week, the share s i , t increases by 0.0108 plus the coefficient of the federal state dummy interacted with the time trend. This follows from s i , t t = β + γ i D i based on Equation (A1). For instance, e.g., in Brandenburg (BB) the share of vaccinations given in week t in relation to deliveries in week t and reserves in week t 1 decreases by 0.0157 0.0108 = 0.0049 per week (see Figure 3 in the main text).
Table A3. Output table for Equation (A1).
Table A3. Output table for Equation (A1).
Dep. Var. s i , t
D April 5 0.116 **(3.98)
Time trend0.0108 ***(5.86)
BB × Time trend−0.0157 ***( 3.17 × 10 14 )
BE × Time trend−0.0152 ***( 5.25 × 10 14 )
BW × Time trend−0.00465 ***( 1.62 × 10 14 )
BY × Time trend−0.0138 ***( 4.37 × 10 14 )
HE × Time trend−0.00836 ***( 1.58 × 10 14 )
HH × Time trend−0.0111 ***( 3.27 × 10 14 )
MV × Time trend−0.0209 ***( 4.46 × 10 14 )
NI × Time trend−0.00235 ***( 8.04 × 10 13 )
NW × Time trend−0.000310 ***( 1.08 × 10 13 )
RP × Time trend−0.0168 ***( 4.15 × 10 14 )
SH × Time trend−0.0167 ***( 5.78 × 10 14 )
SL × Time trend−0.0105 ***( 3.57 × 10 14 )
SN × Time trend−0.00858 ***( 2.98 × 10 14 )
ST × Time trend−0.00943 ***( 3.19 × 10 14 )
TH × Time trend−0.00311 ***( 1.08 × 10 14 )
Constant0.333 ***(26.80)
Observations320
R 2 0.424
R 2 adjusted0.360
t statistics in parentheses; two and three asterisks correspond to p < 0.01 and p < 0.01 , respectively.
To completely interpret the results, consider the federal state Bremen. The constant 0.333 can be interpreted as the starting value of the share s HB , t for the federal state. Week t = 1 in our sample is the last week of December 2020. Subsequently, i.e., in calender weeks t [ 1 , 2 , , 19 ] of 2021, that share increases by 0.0108 per week. For weeks 14–19, i.e., the calender weeks starting on 5 April 2021, the level of s HB , t increases further by 0.116 . Thus, in the last week, the average effect assigned to Bremen would be 0.6542 .
Whereas we observe a clear time trend in the data for Bremen and, for instance, for Thuringia (TH) (see Figure 3 in the main text), other states do not exhibit such an obvious trend. In Equation (A1), we, therefore, still allow for a general time trend but do not impose such a trend for each federal state. In contrast, as a next step we approach the problem differently by allowing at the same time the analysis of whether the potential effect of the integration of doctor’s offices into Germany’s vaccination campaign differs between federal states.
s i , t = α + β t + ρ D April 5 + η i D i × D April 5 + D i + ϵ i , t .
In Equation (A2), s i , t is explained by a time trend t, the variable D April 5 that takes the value 1 for the period after 5 April 2021, and 0 otherwise as well as a federal state specific fixed effect D i . The federal state dummy D i is also interacted with D April 5 to investigate whether a change in s i , t potentially triggered by the integration of doctor’s offices into the vaccination campaign differs between federal states. This approach enables an investigation of whether the integration of doctor’s offices into the vaccination campaign potentially improved efficiency of the vaccination campaign on average and whether this effects differs between federal states at the same time. The interaction term D i × D April 5 is defined such that the results of each federal state have to be interpreted relative to Bremen. The results of the regression are presented in Table A4.
Table A4. Output table for Equation (A2).
Table A4. Output table for Equation (A2).
Dep. Var. s i , t
D April 5 0.247 ***(8.87)
D April 5 × BB−0.206 ***( 8.18 × 10 13 )
D April 5 × BE−0.185 ***( 7.26 × 10 13 )
D April 5 × BW−0.0927 ***( 3.74 × 10 13 )
D April 5 × BY−0.181 ***( 4.04 × 10 13 )
D April 5 × HE−0.124 ***( 4.77 × 10 13 )
D April 5 × HH−0.158 ***( 5.35 × 10 13 )
D April 5 × MV−0.142 ***( 5.20 × 10 13 )
D April 5 × NI−0.0713 ***( 2.87 × 10 13 )
D April 5 × NW0.0120 ***( 4.82 × 10 12 )
D April 5 × RP−0.186 ***( 7.37 × 10 13 )
D April 5 × SH−0.183 ***( 6.61 × 10 13 )
D April 5 × SL−0.198 ***( 7.99 × 10 13 )
D April 5 × SN−0.136 ***( 5.44 × 10 13 )
D April 5 × ST−0.108 ***( 4.35 × 10 13 )
D April 5 × TH−0.147 ***( 5.93 × 10 13 )
Time trend0.000941(0.34)
Constant0.333 ***(14.03)
Observations320
R 2 0.40
R 2 adjusted0.332
t statistics in parentheses; three asterisks correspond to p < 0.01 .
One can see that the coefficient of the dummy D April 5 is significant at the 0.1%-level. The coefficient of 0.247 reported in Table A4 implies that, all else equal, in the period after 5 April, 24.7 % moreout of 100 available doses in a given week were vaccinated on average, or, in other words, 24.7 % less doses were held back as reserves in Bremen. In interpreting the results, the potential effect of the integration of doctor’s offices into the vaccination campaign is a jump in s i , t by 24.7% for Bremen. That jump is lower for all other federal states except for Northrhine-Westphalia, where the jump is 0.247 + 0.0120 = 0.259 . The lowest increase occurs in Brandenburg (BB) where the apparent effect of the integration of doctor’s offices into the vaccination campaign is 0.247 0.206 = 0.041 .
A more detailed discussion on the differences between Regressions (A1) and (A2) is appropriate. The main difference is that (A1) allows the time trend to vary between federal states whereas (A2) allows the effect of the dummy D April 5 to be federal state-specific. In contrast to (A1), in (A2) all differences in the time dimension between federal states is absorbed by the interaction term D i × D April 5 so that the time trend eventually becomes insignificant. Based on a graphical analysis of Figure 3 in the main text one cannot clearly state which approach is more appropriate. For instance, Lower-Saxony (NI) and Hesse (HE) show similar patterns after 5 April, however, Lower-Saxony shows a clearer time trend. This indicates that Equation (A1) appears to be a more suitable approach to identify differences in the time dimension between federal states. On the other hand, comparing Bremen and Lower-Saxony, one can see that Bremen has a more pronounced effect of D April 5 . One could argue that there is a more visible structural break in Bremen than in Lower-Saxony. In that case, Equation (A2) seems more appropriate to identify differences in the time dimension. Based on these observations, it seems appropriate to discuss both variations. In any case, both estimations indicate structural breaks after 5 April, so that the results presented here confirm the findings outlined in the main text.
Finally, it can be analyzed which federal states show a time trend and for whom a structural break after 5 April can be diagnosed. In doing so, we estimate the following regression for each federal state:
s i , t = α i + β i t + ρ i D April 5 + γ i D April 5 × t .
In Equation (A3), we test whether each federal state has a time trend, a structural break after April 5 and whether the time trend changes after April 5. The results are presented in Table A5.
Table A5. Time trend and structural break after 5 April 2021, and the interaction between the time trend and the structural break in s i , t for each federal state. The number of stars indicates the p-values of the respective t-statistics. In contrast to the previous analyses, *** indicates the p 0.01 , ** p 0.05 and * p 0.1 .
Table A5. Time trend and structural break after 5 April 2021, and the interaction between the time trend and the structural break in s i , t for each federal state. The number of stars indicates the p-values of the respective t-statistics. In contrast to the previous analyses, *** indicates the p 0.01 , ** p 0.05 and * p 0.1 .
Federal StateTime Trend (t)Structural Break ( D April 5 )Interaction ( D April 5 × t )
BBnonepositive **none
BEnonepositive ***negative ***
BWnonepositive **none
BYnonepositive *none
HBnonepositive ***negative **
HEnonenonenone
HHnonepositive *none
MVnegative ***nonepositive **
NInonenonenone
NWnonepositive ***none
RPnonenonenone
SHnonenonenone
SLnonenonenone
SNnonepositive ***negative ***
STnonepositive ***negative **
THpositive **positive ***negative ***
Table A5 shows that 10 out of 16 federal states exhibit a structural break after 5 April 2021. That structural break is positive, i.e., an upward jump in s i , t is observed. However, starting from that higher level, one can see that in 5 of these federal states (HB, BE, SN, ST, TH) the shares s i , t start to decline again, which follows from the negative sign of the coefficient γ i of the interaction term D April 5 × t . This indicates that in these federal states there was a strong initial impetus on s i , t at the beginning of 5 April, which began to level out afterwards. In the remaining 5 federal states (BB, BW, BY, HH, NW) the shares remain at a higher level. For Mecklenburg Western Pomerania (MV), we do not find a structural break, however, a negative time trend is found with an opposing positive trend after 5 April (positive coefficient of the interaction term). No effect of the integration of doctor’s offices into the vaccination campaign is found for 5 federal states (HE, NI, RP, SH, SL).
As a further robustness check, a Zivot-Andrews structural break test [38] was performed. This can be seen as a conservative approach because the test identifies endogenously at most one structural break. Based on the data, a structural break was identified in calender weeks 13 and 14 (i.e., the weeks around 5 April) in 6 federal states (including, in particular, Bremen and Northrhine-Westphalia) despite the scarcity of observations. These findings are consistent with the interpretation outlined in the main text that the identified effect is driven by those federal states where the integration of general practitioners into the vaccination campaign had a particularly strong effect.

References

  1. WHO. Novel Coronavirus (2019-nCoV). Situation Report—22, Data as Reported by 11 February 2020. Technical Report. World Health Organization, 2020. Available online: https://apps.who.int/iris/handle/10665/330991 (accessed on 28 June 2021).
  2. Hua, J.; Shaw, R. Corona virus (Covid-19)“infodemic” and emerging issues through a data lens: The case of china. Int. J. Environ. Res. Public Health 2020, 17, 2309. [Google Scholar] [CrossRef] [Green Version]
  3. El Zowalaty, M.E.; Järhult, J.D. From SARS to COVID-19: A previously unknown SARS-related coronavirus (SARS-CoV-2) of pandemic potential infecting humans–Call for a One Health approach. ONE Health 2020, 9, 100124. [Google Scholar] [CrossRef]
  4. Mallapaty, S. Can COVID vaccines stop transmission? Scientists race to find answers. Nat. News 2021. [Google Scholar] [CrossRef]
  5. Bubar, K.M.; Reinholt, K.; Kissler, S.M.; Lipsitch, M.; Cobey, S.; Grad, Y.H.; Larremore, D.B. Model-informed COVID-19 vaccine prioritization strategies by age and serostatus. Science 2021, 371, 916–921. [Google Scholar] [CrossRef] [PubMed]
  6. Jahn, B.; Sroczynski, G.; Bicher, M.; Rippinger, C.; Mühlberger, N.; Santamaria, J.; Urach, C.; Schomaker, M.; Stojkov, I.; Schmid, D.; et al. Targeted COVID-19 Vaccination (TAV-COVID) Considering Limited Vaccination Capacities—An Agent-Based Modeling Evaluation. Vaccines 2021, 9, 434. [Google Scholar] [CrossRef] [PubMed]
  7. McKee, M.; Rajan, S. What can we learn from Israel’s rapid roll out of COVID 19 vaccination? Isr. J. Health Policy Res. 2021, 10, 5. [Google Scholar] [CrossRef] [PubMed]
  8. Mills, M.C.; Salisbury, D. The challenges of distributing COVID-19 vaccinations. EClinicalMedicine 2021, 31, 100674. [Google Scholar] [CrossRef]
  9. Goel, R.K.; Nelson, M.A. Drivers of COVID-19 vaccinations: Vaccine delivery and delivery efficiency in the United States. NETNOMICS Econ. Res. Electron. Netw. 2021. [Google Scholar] [CrossRef]
  10. ECDC. Rollout of COVID-19 Vaccines in the EU/EEA: Challenges and Good Practice. Technical Report, European Centre for Disease Prevention and Control. 2021. Available online: https://www.ecdc.europa.eu/en/publications-data/rollout-covid-19-vaccines-eueea-challenges-and-good-practice (accessed on 28 June 2021).
  11. Rossman, H.; Shilo, S.; Meir, T.; Gorfine, M.; Shalit, U.; Segal, E. COVID-19 dynamics after a national immunization program in Israel. Nat. Med. 2021, 27, 1055–1061. [Google Scholar] [CrossRef] [PubMed]
  12. Vilches, T.N.; Zhang, K.; Van Exan, R.; Langley, J.M.; Moghadas, S.M. Projecting the impact of a two-dose COVID-19 vaccination campaign in Ontario, Canada. Vaccine 2021, 39, 2360–2365. [Google Scholar] [CrossRef] [PubMed]
  13. Pageaud, S.; Ponthus, N.; Gauchon, R.; Pothier, C.; Rigotti, C.; Eyraud-Loisel, A.; Bertoglio, J.P.; Bienvenüe, A.; Gueyffier, F.; Vanhems, P.; et al. Adapting French COVID-19 vaccination campaign duration to variant dissemination. medRxiv 2021. [Google Scholar] [CrossRef]
  14. Ratzan, S.; Schneider, E.C.; Hatch, H.; Cacchione, J. Missing the Point—How Primary Care Can Overcome Covid-19 Vaccine “Hesitancy”. N. Engl. J. Med. 2021, 384, e100. [Google Scholar] [CrossRef]
  15. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the efficiency of decision making units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  16. Thanassoulis, E. DEA and its use in the regulation of water companies. Eur. J. Oper. Res. 2000, 127, 1–13. [Google Scholar] [CrossRef]
  17. Agrell, P.J.; Bogetoft, P.; Tind, J. DEA and dynamic yardstick competition in Scandinavian electricity distribution. J. Product. Anal. 2005, 23, 173–201. [Google Scholar] [CrossRef]
  18. Shi, F.X.; Lim, S.H.; Chi, J. Railroad productivity analysis: Case of the American Class I railroads. Int. J. Product. Perform. Manag. 2011, 60, 372–386. [Google Scholar] [CrossRef]
  19. Staat, M. Efficiency of hospitals in Germany: A DEA-bootstrap approach. Appl. Econ. 2006, 38, 2255–2263. [Google Scholar] [CrossRef] [Green Version]
  20. Kounetas, K.; Papathanassopoulos, F. How efficient are Greek hospitals? A case study using a double bootstrap DEA approach. Eur. J. Health Econ. 2013, 14, 979–994. [Google Scholar] [CrossRef] [PubMed]
  21. Valdmanis, V.; Walker, D.; Fox-Rushby, J. Are vaccination sites in Bangladesh scale efficient? Int. J. Technol. Assess. Health Care 2003, 19, 692–697. [Google Scholar] [CrossRef] [Green Version]
  22. Birch, S.; Gafni, A. Cost effectiveness/utility analyses: Do current decision rules lead us to where we want to be? J. Health Econ. 1992, 11, 279–296. [Google Scholar] [CrossRef]
  23. Nas, T.F. Cost-Benefit Analysis: Theory and Application; Lexington Books: Lanham, MD, USA, 2016. [Google Scholar]
  24. Aldamak, A.; Zolfaghari, S. Review of efficiency ranking methods in data envelopment analysis. Measurement 2017, 106, 161–172. [Google Scholar] [CrossRef]
  25. Cooper, W.W.; Seiford, L.M.; Zhu, J. Handbook on Data Envelopment Analysis; Springer: Berlin, Germany, 2011. [Google Scholar]
  26. Banker, R.D.; Charnes, A.; Cooper, W.W. Some models for estimating technical and scale inefficiencies in data envelopment analysis. Manag. Sci. 1984, 30, 1078–1092. [Google Scholar] [CrossRef] [Green Version]
  27. Torres, I.; Lopez-Cevallos, D.; Artaza, O.; Profeta, B.; Kang, J.; Machado, C.V. Vaccine scarcity in LMICs is a failure of global solidarity and multilateral instruments. Lancet 2021, 397, 1804. [Google Scholar] [CrossRef]
  28. Rosen, B.; Waitzberg, R.; Israeli, A. Israel’s rapid rollout of vaccinations for COVID-19. Isr. J. Health Policy Res. 2021, 10, 6. [Google Scholar] [CrossRef]
  29. Shilo, S.; Rossman, H.; Segal, E. Signals of hope: Gauging the impact of a rapid national vaccination campaign. Nat. Rev. Immunol. 2021, 21, 198–199. [Google Scholar] [CrossRef] [PubMed]
  30. Cylus, J.; Panteli, D.; van Ginneken, E. Who should be vaccinated first? Comparing vaccine prioritization strategies in Israel and European countries using the Covid-19 Health System Response Monitor. Isr. J. Health Policy Res. 2021, 10, 1–3. [Google Scholar] [CrossRef] [PubMed]
  31. Tewarson, H.; Greene, K.; Fraser, M.R. State Strategies for Addressing Barriers during the Early US COVID-19 Vaccination Campaign. Am. J. Public Health 2021, 111, 1073–1077. [Google Scholar] [CrossRef] [PubMed]
  32. Goel, R.K.; Nelson, M.A. COVID-19 internet vaccination information and vaccine administration: Evidence from the United States. J. Econ. Financ. 2021. [Google Scholar] [CrossRef]
  33. Sim, F. Early Covid-19 vaccination rollout: A commentary from England. Isr. J. Health Policy Res. 2021, 10, 1–4. [Google Scholar] [CrossRef]
  34. Jentzsch, A.; Bleckwenn, M. Corona vaccination in a family practice: A first experience report. MMW Fortschritte Med. 2021, 163, 12–17. [Google Scholar] [CrossRef]
  35. Caplin, A.; Leahy, J. Economic Theory and the World of Practice: A Celebration of the (S, s) Model. J. Econ. Perspect. 2010, 24, 183–202. [Google Scholar] [CrossRef] [Green Version]
  36. Geoffroy, F.; Traulsen, A.; Uecker, H. Vaccination strategies when vaccines are scarce: On conflicts between reducing the burden and avoiding the evolution of escape mutants. medRxiv 2021. [Google Scholar] [CrossRef]
  37. Voysey, M.; Clemens, S.A.C.; Madhi, S.A.; Weckx, L.Y.; Folegatti, P.M.; Aley, P.K.; Angus, B.; Baillie, V.L.; Barnabas, S.L.; Bhorat, Q.E.; et al. Single-dose administration and the influence of the timing of the booster dose on immunogenicity and efficacy of ChAdOx1 nCoV-19 (AZD1222) vaccine: A pooled analysis of four randomised trials. Lancet 2021, 397, 881–891. [Google Scholar] [CrossRef]
  38. Zivot, E.; Andrews, D.W.K. Further evidence on the great crash, the oil-price shock, and the unit-root hypothesis. J. Bus. Econ. Stat. 2002, 20, 25–44. [Google Scholar] [CrossRef]
Figure 1. Daily number of people vaccinated and deliveries by Federal State.
Figure 1. Daily number of people vaccinated and deliveries by Federal State.
Vaccines 09 00788 g001
Figure 2. Daily number of vaccines in stock by Federal State.
Figure 2. Daily number of vaccines in stock by Federal State.
Vaccines 09 00788 g002
Figure 3. The share of vaccinations given in week t in relation to deliveries in week t and reserves in week t 1 s i , t = vaccination i , t deliveries i , t + reserves i , t 1 for all federal states.
Figure 3. The share of vaccinations given in week t in relation to deliveries in week t and reserves in week t 1 s i , t = vaccination i , t deliveries i , t + reserves i , t 1 for all federal states.
Vaccines 09 00788 g003
Table 1. Summary statistics for q1.2021 by Federal State.
Table 1. Summary statistics for q1.2021 by Federal State.
Federal StateDeliveriesTotal VaccinatedFirstFullStorage Quota
HB132,255126,09190,23435,8574.66%
TH432,150403,299280,682122,6176.68%
BE697,200635,103427,101208,0028.91%
BB472,590429,998328,564101,4349.01%
SH550,575494,930378,776116,15410.11%
NI1,503,8251,328,867920,694408,17311.63%
DE15,974,17514,005,6869,763,8054,241,88112.32%
HH347,325301,837211,08090,75713.10%
BY2,569,6352,232,8811,516,433716,44813.11%
BW2,085,0751,798,0071,253,952544,05513.77%
HE1,188,4201,022,298691,217331,08113.98%
RP790,185676,868495,688181,18014.34%
ST418,200351,265251,86599,40016.01%
NW3,363,3002,739,9831,913,865826,11818.53%
MV300,225234,839159,25075,58921.78%
SN856,875654,525405,999248,52623.61%
SL266,340176,290129,28747,00333.81%
Table 2. Summary statistics on reserves per first dose given for the period from 11 January 2021 to 16 May by Federal State. The first two weeks of the campaign were left out here due to the low number of vaccinations in relation to deliveries.
Table 2. Summary statistics on reserves per first dose given for the period from 11 January 2021 to 16 May by Federal State. The first two weeks of the campaign were left out here due to the low number of vaccinations in relation to deliveries.
Index#WeeksMeanStdMin25%50%75%Max
BB180.470.220.240.310.390.580.88
BE180.350.140.160.250.320.430.68
BW180.560.320.20.280.50.761.34
BY180.350.120.190.240.330.410.55
DE180.420.170.20.240.420.510.7
HB180.280.160.030.130.290.410.55
HE180.560.280.210.30.510.781.05
HH180.390.160.20.220.40.430.82
MV180.360.210.070.180.260.560.68
NI180.620.340.190.280.590.921.12
NW180.540.30.140.190.590.751.08
RP180.310.110.170.210.270.410.51
SH180.310.120.150.230.260.40.56
SL180.580.290.210.340.530.811.2
SN180.580.250.280.350.550.741.12
ST180.520.240.210.260.550.690.9
TH180.460.350.130.230.380.511.55
Table 3. Average efficiency scores for the period from 27 December 2020 to 16 May 2021 for DEAs performed on a weekly basis under the CRS assumption.
Table 3. Average efficiency scores for the period from 27 December 2020 to 16 May 2021 for DEAs performed on a weekly basis under the CRS assumption.
Federal StateT1S2S
BB0.56990.52480.4321
BE0.71950.67080.6857
BW0.58910.5840.4581
BY0.73710.72760.5477
HB0.82890.78420.689
HE0.59930.5970.4873
HH0.64950.6430.4942
MV0.71650.65910.4911
NI0.54420.54830.3971
NW0.64280.65540.4438
RP0.71130.64550.5263
SH0.71250.65310.5363
SL0.55270.56430.4078
SN0.53210.48140.5457
ST0.58980.57120.4695
TH0.65440.61550.6566
Table 4. Weekly average DEA efficiency scores for the period from 27 December 2020 to 16 May 2021 under the VRS assumption.
Table 4. Weekly average DEA efficiency scores for the period from 27 December 2020 to 16 May 2021 under the VRS assumption.
Federal StateT1S2S
BB0.64870.60770.5159
BE0.80420.73750.7332
BW0.73460.73970.6222
BY0.94080.90670.7495
HB111
HE0.69940.68130.5605
HH0.71850.71870.5909
MV0.78870.76020.6215
NI0.6820.67710.4849
NW0.97930.93470.8258
RP0.80040.73170.6078
SH0.78730.74040.6273
SL0.64460.66620.5935
SN0.60710.54330.5984
ST0.64990.63290.5401
TH0.72770.68070.7274
Table 5. Counterfactual scenario where it is assumed that less efficient federal states adopt s i , t for i = Bremen or i = North Rhine-Westphalia every week t.
Table 5. Counterfactual scenario where it is assumed that less efficient federal states adopt s i , t for i = Bremen or i = North Rhine-Westphalia every week t.
BremenNorthrhine-Westphalia
Federal StateAct. VaccHyp. Vacc%-GainHyp. Vacc%-Gain
BB1,114,3861,273,34914.26%1,232,57310.61%
BE1,703,6551,881,65010.45%1,819,4746.80%
BW5,268,4105,630,8276.88%5,449,3603.43%
BY6,368,4896,813,9096.99%6,594,5663.55%
HB357,057357,0570357,0570%
HE2,967,3203,213,9958.31%3,110,3204.82%
HH854,467927,9928.60%898,9885.21%
MV794,509825,5453.91%798,2120.47%
NI3,817,3254,089,3427.13%3,955,7023.62%
NW8,869,6649,171,4533.40%8,869,6640%
RP1,970,3692,086,1205.87%2,018,9642.47%
SH1,396,9321,486,8866.44%1,438,8253.00%
SL523,240582,24611.28%565,8578.14%
SN1,912,2942,144,31512.13%2,079,4668.74%
ST1,024,7321,120,0439.30%1,084,7815.86%
TH1,041,8791,120,8977.58%1,086,0814.24%
Total39,984,72842,725,6276.85%41,359,8883.44%
Table 6. Output table for Equation (3).
Table 6. Output table for Equation (3).
Dep. Var. s i , t
D April 5 0.116 **(4.08)
Time trend0.000941(0.35)
Constant0.333 ***(13.43)
Observations320
R 2 0.348
R 2 adjusted0.311
t statistics in parentheses; two and three asterisks correspond to p < 0.001 and p < 0.01 , respectively.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Götz, G.; Herold, D.; Klotz, P.-A.; Schäfer, J.T. Efficiency in COVID-19 Vaccination Campaigns—A Comparison across Germany’s Federal States. Vaccines 2021, 9, 788. https://doi.org/10.3390/vaccines9070788

AMA Style

Götz G, Herold D, Klotz P-A, Schäfer JT. Efficiency in COVID-19 Vaccination Campaigns—A Comparison across Germany’s Federal States. Vaccines. 2021; 9(7):788. https://doi.org/10.3390/vaccines9070788

Chicago/Turabian Style

Götz, Georg, Daniel Herold, Phil-Adrian Klotz, and Jan Thomas Schäfer. 2021. "Efficiency in COVID-19 Vaccination Campaigns—A Comparison across Germany’s Federal States" Vaccines 9, no. 7: 788. https://doi.org/10.3390/vaccines9070788

APA Style

Götz, G., Herold, D., Klotz, P. -A., & Schäfer, J. T. (2021). Efficiency in COVID-19 Vaccination Campaigns—A Comparison across Germany’s Federal States. Vaccines, 9(7), 788. https://doi.org/10.3390/vaccines9070788

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop