Next Article in Journal
Factors Influencing COVID-19 Vaccine Uptake among Nepali People in the UK: A Qualitative Study
Previous Article in Journal
Evaluation of Meningococcal Serogroup C Bactericidal Antibodies after Primary Vaccination: A Multicentre Study, Italy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Real-World Effectiveness of the mRNA COVID-19 Vaccines in Japan: A Case–Control Study

1
Department of Preventive Medicine, Faculty of Medicine, Saga University, 5-1-1 Nabeshima, Saga 849-8501, Japan
2
Fukuoka City Office, 1-8-1 Tenjin, Chuohku, Fukuoka 810-8620, Japan
3
Saga-Ken Medical Centre Koseikan, 400 Kase-Town, Saga 840-8571, Japan
4
Department of Emergency Medicine, Saga University Hospital, 5-1-1 Nabeshima, Saga 849-8501, Japan
5
Fukuoka City Jonan Ward Public Health Center, 6-1-1 Torikai, Jonan Ward, Fukuoka 814-0192, Japan
6
Fukuoka City Higashi Ward Public Health Center, 2-54-1 Hakozaki, Higashi Ward, Fukuoka 812-8653, Japan
7
Fukuoka City Hakata Ward Public Health Center, 2-9-3 Hakataeki-Mae, Hakata Ward, Fukuoka 812-8512, Japan
8
Fukuoka City Sawara Ward Public Health Center, 2-1-1 Momochi, Sawara Ward, Fukuoka 814-8501, Japan
9
Kanenokuma Hospital, SOUSEIKAI Medical Group (Medical Co. LTA), Hakata-Ku, Fukuoka 812-0863, Japan
10
SOUSEIKAI Medical Group (Medical Co. LTA), Hakata-Ku, Fukuoka 812-0025, Japan
11
Clinical Epidemiology Research Center, SOUSEIKAI Medical Group (Medical Co. LTA), Higashi-Ku, Fukuoka 813-0017, Japan
*
Author to whom correspondence should be addressed.
Vaccines 2022, 10(5), 779; https://doi.org/10.3390/vaccines10050779
Submission received: 28 March 2022 / Revised: 11 May 2022 / Accepted: 11 May 2022 / Published: 14 May 2022

Abstract

:
The real-world effectiveness of the coronavirus disease 2019 (COVID-19) vaccines in Japan remains unclear. This case–control study evaluated the vaccine effectiveness (VE) of two doses of mRNA vaccine, BNT162b2 or mRNA-1273, against the delta (B.1.617.2) variant in the Japanese general population in the period June–September 2021. Individuals in close contact with COVID-19 patients were tested using polymerase chain reaction (PCR). A self-administered questionnaire evaluated vaccination status, demographic data, underlying medical conditions, lifestyle, personal protective health behaviors, and living environment. Two vaccine doses were reported by 11.6% of cases (n = 389) and 35.2% of controls (n = 179). Compared with controls, cases were younger and had a lower proportion who always performed handwashing for ≥20 s, a higher proportion of alcohol consumers, and a lower proportion of individuals living in single-family homes or with commuting family members. After adjusting for these confounding factors and day of PCR testing by multivariate logistic regression analysis, the VE in the period June–July (delta variant proportion 45%) was 92% and 79% in the period August–September (delta variant proportion 89%). The adjusted VE for homestay, hotel-based isolation and quarantine, and hospitalization was 78%, 77%, and 97%, respectively. Despite declining slightly, VE against hospitalization remained robust for ~3 months after the second dose. Vaccination policymaking will require longer-term monitoring of VE against new variants.

1. Introduction

The messenger RNA (mRNA) vaccine against severe acute respiratory syndrome–coronavirus 2 (SARS-CoV-2) was developed rapidly and found to be highly efficacious by clinical trials [1,2]. The efficacy against symptomatic coronavirus disease 2019 (COVID-19) was 95.0% for BNT162b2 (Pfizer Inc., New York, NY, USA; BioNTech Manufacturing GmbH, Mainz, Germany; Comirnaty) [1] and 94.1% for mRNA-1273 (Moderna Inc., Cambridge, UK; MA, USA; Spikevax) [2]. In Israel, where BNT162b2 was authorized for emergency use and administered to the public for the first time, significant effectiveness against COVID-19 was reported after 14 days from the first dose, and the adjusted estimate of vaccine effectiveness (VE) against SARS-CoV-2 infection at ≥7 days after the second dose was 95.3% (95% confidence interval [CI]: 94.9–95.7) [3]. Adjusted estimates of VE against symptomatic COVID-19, COVID-19-related hospitalization, severe or critical COVID-19-related hospitalization, and COVID-19-related death were 91.5% (95% CI: 90.7–92.2%), 97.2% (95% CI: 96.8–97.5%), 97.5% (95% CI: 97.1–97.8%), and 96.7% (95% CI: 96.0–97.3%), respectively [3]. Since that time, real-world evidence of high VE against COVID-19 was reported by epidemiologic studies [4,5]. However, concerns about reduced VE against COVID-19 infection due to reductions in neutralizing activity from waning immunity induced by the mRNA vaccine and the appearance of virus variants have been raised [6,7,8]. On the other hand, VE against serious illnesses requiring hospitalization was reported to still be high not only 3 months after the second vaccination but also 6 months after [9,10,11,12,13,14]. The degree of VE varies depending on the age and sex of the target population, underlying diseases, immune attenuation due to the time since the last vaccination, and the status of the primary epidemic strains; however, studies thoroughly examining these factors in Asian countries such as Japan remain limited [15].
Non-pharmaceutical public health measures other than vaccines and personal health prevention behaviors reportedly prevent COVID-19 [16,17,18]. A meta-analysis revealed that the incidence of COVID-19 is negatively associated with handwashing (relative risk [RR]: 0.47, 95% CI: 0.19–1.12), mask-wearing (RR: 0.47, 95% CI: 0.29–0.75), and physical distancing (RR: 0.75, 95% CI: 0.59–0.95) [17]. Randomized trials of the effectiveness of non-pharmaceutical interventions such as wearing a surgical mask against COVID-19 infection also reported preventive effects [19]. However, to the best of our knowledge, no VE studies have adjusted for personal protective health behaviors and preventive measures. Most real-world studies examining VE against COVID-19 have been test-negative case–control and cohort studies using large databases to obtain information regarding vaccination, laboratory testing, clinical infection, and demographic characteristics [15]. If these databases did not include information regarding personal protective health behaviors, the VEs were not adjusted for those behaviors.
In Japan, mRNA vaccination with BNT162b2 and mRNA-1273 has been promoted since February 2021, with priority given to healthcare workers, the elderly, and high-risk individuals. Vaccination targeting later expanded to include generally healthy individuals and those over 12 years of age, and by the end of 2021, approximately 70% of the population of Japan had been vaccinated with two doses [20]. As of February 2022, a booster vaccination campaign for a third dose was being conducted in response to the rapid spread of a new mutant strain designated omicron [20]. Evaluating VE is extremely difficult in Japan because there is no framework in place to collect information on vaccination history, morbidity, and hospitalization at the individual level for use in research. Only a few case–control studies using a test-negative design conducted in fever outpatient clinics in Japan have been reported [21,22,23,24]. Significant protective effects were reported from 14 days after the first vaccination, and the VE against symptomatic COVID-19 was reported >90% after 14 days from the second vaccination dose [21,22]. The VE against delta (B.1.617.2) variant-related symptomatic COVID-19 was slightly lower, at approximately 80% [22,24]. However, disease severity-specific VE has not been evaluated yet. In addition, as the prevalence and mortality rates of COVID-19 in Japan were lower than those in other countries even before the introduction of the vaccine [25,26], a positive effect of lifestyle and protective health behaviors among the Japanese population has been suggested. However, factors such as protective health behaviors have not been considered in previous studies of VE [21,22,23,24].
The purpose of this study was to evaluate VE in Japan, adjusting for confounding factors such as personal protective health behavior in relation to the duration since the last vaccination and the proportion of delta variants during the period studied.

2. Materials and Methods

2.1. Study Setting and Participants

We conducted a case–control study to evaluate VE against SARS-CoV-2 infection and COVID-19-related hospitalization in Saga Prefecture and Fukuoka Prefecture, both of which are in southern Japan. Cases included symptomatic or asymptomatic SARS-CoV-2–infected patients (≥16 years of age) who were diagnosed by polymerase chain reaction (PCR) test taken at public health centers as part of an epidemiologic survey for close-contact subjects between 4 June and 26 September 2021. This survey period coincided with the end of the fourth wave of COVID-19, driven by the alpha variant, and the entirety of the fifth wave of COVID-19, driven by the delta (B.1.617.2) variant [27]. According to reports from the public health centers in the study area, the proportion of delta variants during June and July was 45%, while that of August and September was 89%. During the study period in Japan, patients with asymptomatic or minor cases of SARS-CoV-2 infection were advised to stay at home or in a hotel for 10 days, and those requiring treatment were admitted to a hospital for at least 10 days. Patients with mild cases were asked to participate in this study when the public health center reported their PCR results, and hospitalized patients were asked to participate when they were discharged. Controls were selected from individuals with negative SARS-CoV-2 PCR test results who were in close contact with cases and either lived in the same household or had been in face-to-face proximity of within 1 m with a case-patient for 15 min without wearing a face mask.
The sample size needed for the study was calculated as follows: assuming α = 0.05/number of variables (20 items) = 0.0025, β = 0.20, VE = 50–70%, and the proportion of vaccination uptake among controls = 40–60%, the required sample size was 35 to 110 cases and 105 to 330 controls.
Participants provided written informed consent after receiving an explanation of the study purpose and contents and the conditions of cooperation in the study. The study protocol was approved by the Ethics Committee of Saga University (approval nos. R2-39, R3-28).

2.2. Data Collection

The following data were obtained using a self-administered questionnaire: sex, date of birth, area of residence, weight, height, and underlying medical conditions (such as respiratory disease, heart disease (including hypertension), kidney disease, liver disease (but excluding fatty liver and chronic hepatitis), diabetes, blood diseases (but excluding iron deficiency anemia), diseases that reduce immune function (including malignancies receiving treatment or palliative care), and others). Participants were also asked about their history of pneumonia, general health condition, smoking history, alcohol drinking history, physical activity, sleep, eating habits, frequency of going out, use of daycare, occupation, education, blood type, family members living together, size of residential space, and whether or not there were any COVID-19-infected people around them. Regarding personal protective health behaviors and measures, we asked whether participants had taken any of the following measures: mask-wearing, washing their hands for at least 20 s upon returning home, use of chlorine- or ethanol-based disinfectants, physical distancing, regular ventilation of the home, avoid eating meals with 5 or more persons, and regularly obtaining COVID-19 information. Vaccinated individuals responded to a questionnaire regarding the vaccine used (Pfizer-BioNTech: BNT162b2 or Moderna: mRNA-1273), lot number, number of doses, and date of vaccination, based on their vaccination certificate. Cases responded to whether they had symptoms of COVID-19 and, if so, the type of symptoms, date and time of symptom onset, duration, and severity. Information about the places of care or stay was obtained from the patient, the city office, and the hospital.

2.3. Statistical Analysis

The primary analysis assessed the VE against SARS-CoV-2 infection and hospitalization of at least one dose of either vaccine, two doses, or partial vaccination (only one dose) compared with no vaccination. Subgroup analyses were performed to estimate VE according to duration since the last vaccination dose, severity, and strain-specific protection at the time of diagnosis. We first performed bivariate analyses to assess differences in indicators of background characteristics such as area of residence, date of PCR testing, lifestyle, and personal protective health behaviors between cases and controls using the chi-square test or Wilcoxon rank-sum test. Background characteristic variables that exhibited a p-value < 0.0025 (0.05/20) or appeared to be medically related to COVID-19 and vaccination status were considered potential confounders for adjustment. Multivariable logistic regression models were constructed to calculate odds ratios (ORs) with 95% confidence intervals (CIs). We employed the following continuous and categorical variables for adjustment: sex, age (in 10-year intervals), area of residence, underlying medical conditions, date of PCR test, handwashing for 20 s, current alcohol drinking, residence in a single-family home, and family members commute to work or school. Adjusted VE was calculated as (1–adjusted OR) × 100 (%). Commercial software (ver. 9.4 for Windows; SAS Institute, Cary, NC, USA) was used for all statistical analyses.

3. Results

During the survey period, we explained the purpose of the study and then mailed questionnaires to 612 potential cases, and a total of 398 (65.0%) responded. A small number of close contacts of the cases tested negative by PCR; thus, 222 subjects became control candidates. We explained the purpose of the study to the potential controls and then mailed each a questionnaire, receiving responses from 179 (80.6%) candidates. In total, we enrolled 398 cases (male: 208, female: 190; mean age: 41.7 ± 14.7 years) and 179 controls (male: 69, female: 110; mean age: 46.9 ± 19.3 years) for this analysis.
Table 1 summarizes the characteristic of the study subjects. There were no significant differences in terms of the date of PCR testing or the presence of underlying diseases. In terms of protective health behaviors and living environment, cases were significantly less likely than controls to spend more than 20 s washing their hands, to live in a single-family home, and to have a family member living with them who commuted to and from work or school.
Table 2 summarizes the vaccination status of the study subjects. The proportion of unvaccinated cases was significantly higher than that of controls, and even among those vaccinated, the largest proportion was less than 13 days after the first dose. There was no significant difference in terms of which vaccine was used. Cases diagnosed in June and July were mostly elderly, whereas those diagnosed in August and September were generally younger (Figure S1).
Table 3 summarizes factors associated with COVID-19 infection. One dose or two doses of COVID-19 vaccine, female sex, washing hands for >20 s each time, living in a single-family home, and having family members who commute to work or school were negatively associated with COVID-19 infection. In contrast, age and alcohol consumption were positively associated with infection. After adjustment for these factors and PCR test date, adjusted ORs for one and two doses of vaccine in June and July, when the proportion of delta variant was 45%, were 0.38 (95% CI: 0.07–2.10) and 0.08 (95% CI: 0.01–0.65), respectively, and adjusted ORs for one and two doses of vaccine in August and September, when the delta variant proportion was 89%, were 0.32 (95% CI: 0.17–0.60) and 0.21 (95% CI: 0.11–0.40), respectively (Table 4). Adjusted ORs for one and two doses of COVID-19 vaccine against COVID-19-related hospitalization were lower than those against COVID-19-related hotel-based isolation and quarantine, or homestay.
Figure 1 shows adjusted values of VE against COVID-19 infection and COVID-19–related hospitalization according to time since vaccination. The adjusted VE values against COVID-19 infection were statistically significant after more than 14 days from the first dose, with peak effectiveness occurring less than 13 days from the second dose. In contrast, the adjusted VE values against COVID-19-related hospitalization were statistically significant even less than 13 days from the first dose and increased overtime after the second dose.
Unlike the effectiveness against COVID-19-related hotel-based isolation and quarantine or homestay, VE against COVID-19-related hospitalization did not decline (Table S1). We estimated the adjusted VE against COVID-19 during the time in which the delta was predominant (August and September) according to the place of care or stay. The adjusted VE against COVID-19 with homestay or hotel-based isolation for two doses of vaccine was 74% (95% CI: 50–87%), whereas that against hospitalization was 98% (95% CI: 85–99%). There were no significant differences for aOR against COVID-19 for the age group (<60 and ≥60 years old or vaccine manufacturer (Pfizer and Moderna) (Table S1).

4. Discussion

In this case–control study conducted from June to September 2021 in Japan, we found that the overall VE of the mRNA COVID-19 vaccine was 65% (95% CI: 39–80%) for a single dose and 81% (95% CI: 65–89%) for two doses. The adjusted VE of two doses against COVID-19 infection in August and September, when the delta variant was predominant, was 79% (95% CI: 60–89%), which was slightly lower than that in June and July (92%, 95% CI: 35–99%) when the proportion of delta variant was less than 50%. Importantly, the adjusted VE of two doses of mRNA vaccine against hospitalization was robust, at 98% (95% CI: 85–99%), even when the delta variant was predominant (August and September). We also examined the VE against COVID-19 in Japan after adjusting for confounding factors, including personal protective health behaviors.
Both asymptomatic and symptomatic mild cases of COVID-19 were included in this analysis. In contrast, case–control studies conducted in Japan using a test-negative design at clinics for fever outpatients during the same period were limited to symptomatic cases [21,23]. Arashiro et al. reported that the VE against symptomatic COVID-19 in August 2021 in a metropolitan area for two doses of mRNA vaccine was 87% (95% CI: 80–91%) [21]. Maeda et al. reported that the VE during the July to September 2021 period in a nationwide setting was 88.7% (95% CI: 78.8–93.9%) [22]. The overall VE of our study was slightly lower, owing to the inclusion of asymptomatic cases; however, the CIs of the present study overlapped with those of other studies conducted in Japan. Thus, we believe that our VE estimates are comparable, despite the differences in sites, study design, and case definitions.
Observational studies have reported lower VE against delta variant COVID-19 infection compared with the alpha variant, especially among vulnerable groups; however, the VE in those studies was still high in the short term after the second vaccine dose [10,11,12]. A systematic review reported that the VE of two doses of the mRNA vaccine against COVID-19 infection was 74% (95% CI: 62–85%) for the delta variant [13]. Our results are in line with previous reports, with a VE against infection after two doses of any vaccine of 79% (95% CI: 60–89%) during the period in which the delta variant was dominant. Although lower than the VE against infection with the alpha variant, this value met the minimum VE of 50% recommended by the World Health Organization [28]. The VE against severe disease requiring hospitalization was quite high, even when the delta variant was dominant. The adjusted VE against COVID-19-related hospitalization was 98% (95% CI: 85–99%) in our study (Table S1), which is similar to the pooled VE against severe outcomes after two doses reported in a recent meta-analysis of 98.5% (95% CI: 95–99%) [29]. These results suggest that the mRNA vaccines help prevent severe COVID-19 breakthrough infection. Some recent studies reported a diminished VE against omicron (B1.1.529) variant COVID-19 infection [30,31] due to the potential for immune evasion, which was supported by in vitro neutralization assays [8,32,33,34]. In contrast to the VE against the delta variant, the VE against the omicron variant in terms of hospitalization was reportedly lower, at 65% (95% CI: 51–75%), although it remained above 50% [35]. However, it was reported that the VE against hospitalization improved to 86% (95% CI: 77–91%) after three doses of the vaccine [8,35]. Recent studies on SARS-CoV-2 evolutions have reported the intrinsically high recombination and mutation rate in the Spike genes, which may increase binding affinity to human ACE2 receptors [36,37]. Further studies to monitor VE against the omicron variant, which had the highest number of recurrent mutations [37], are needed to understand the role of prevention measures with vaccination and to develop effective vaccination policies.
Several studies have reported the effectiveness of non-vaccine public health measures and personal health protection behaviors in preventing COVID-19 [16,17,18,19]. A systematic review and meta-analysis reported RRs of COVID-19 infection for handwashing, mask-wearing, and physical distancing of 0.47 (95% CI: 0.19–1.12), 0.47 (95% CI: 0.29–0.75), and 0.75 (95% CI: 0.59–0.95), respectively [17]. In this study, the OR of handwashing for more than 20 s each time against COVID-19 infection was 0.60 (95% CI: 0.41–0.88), which indicates that personal protective health behaviors are negatively associated with COVID-19 infection. People who take precautions such as thorough hand washing are likely to be protected not only from contact infection but also from other routes of infection. Alcohol consumption was more prevalent in the case group, which may reflect more opportunities for drinking or socializing and, thus, more opportunities for infection. In addition, fewer people in the case group lived in a single-family home or had family members who commuted to work or school, reflecting the fact that many of the cases were younger. Few studies using large databases conducted in other countries have adjusted for confounding associated with protective health behaviors and residential environment. One of the advantages of our study is that we were able to evaluate VE after adjusting for these factors.
Other advantages of this study were as follows. First, the definitions of cases and controls were based on PCR test results, resulting in few misclassifications. Second, vaccination history was confirmed by vaccination certificates, thereby minimizing recall bias. In comparison with previous studies in Japan, our study had two more advantages. We recruited the participants from among subjects who underwent PCR testing after coming into close contact with COVID-19 patients, independent of symptoms; thus, the selection was not biased by medical treatment-seeking behavior or test-seeking behavior of the participants. Owing to this recruiting method, we could estimate VE against infection in real-world situations. Finally, we were able to confirm that a high VE was maintained in cases that required hospitalization in Japan.
Our study also had several limitations. First, we did not collect information regarding the SARS-CoV-2 strain in each case. We collected information regarding the epidemic strain in the study area, and we estimated VE by period according to the proportion of delta variants detected in the area. Second, we could not evaluate VE for longer periods after vaccination because the longest duration was 3 months. Third, we did not have clinical information regarding the severity of each case; instead, we used the settings of care or stay (i.e., hospital, hotel, or home) as surrogates for indicators of severity. Not all hospitalized cases were severe; thus, not all cases needed ventilators or extracorporeal membrane oxygenation in Japan. Fourth, cases involving severe disease or death were not included in the study. This selection bias may have led to an underestimation of VE against severe diseases. Fifth, we could not examine differences in VE according to age, presence of high-risk comorbid conditions, or vaccine manufacturer due to the limited sample size. Finally, protective health behaviors were self-reported. In this study, we found that handwashing was negatively associated with COVID-19; however, reverse causation might have occurred due to the retrospective design.

5. Conclusions

This case–control study examined the real-world effectiveness of mRNA COVID-19 vaccines among the Japanese population. After adjustment for confounding factors, including protective health behaviors and environmental factors, the VE against COVID-19 infection were 65% (95% CI: 39–80%) for a single dose and 81% (95% CI: 65–89%) for two doses. Although the VE of two doses against infection was slightly lower during the period in which the delta variant was dominant, the VE against hospitalization remained above 90%. Further studies are needed to monitor VE against new variants and the effectiveness of booster doses over time.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/vaccines10050779/s1, Figure S1: Age distribution by diagnosed month among cases; Table S1: Adjusted odds ratio (aOR) against COVID-19 according to diagnosis period, age group, and vaccine manufacture by place of care or stay.

Author Contributions

Conceptualization, M.H.; methodology, investigation, M.H., T.F., M.F., E.M., Y.A., Y.T., H.N., S.I. and Y.H.; formal analysis, investigation, M.H.; writing—original draft preparation, M.H.; writing—review and editing, visualization, supervision, M.H., K.I. and Y.H.; project administration, M.H., K.I., T.M., Y.S., N.M., Y.K., M.S., N.S. and M.T.; funding acquisition, Y.H. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by a research grant for Research on Emerging and Re-emerging Infectious Diseases, Health and Labour Science Research Grants from the Ministry of Health, Labour and Welfare, Japan (R2-SHINKOGYOSEI-SHITEI-003 and 20HA2001). The funding body had no role in the design of the study, collection, analysis, and interpretation of data, or in writing the manuscript.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Saga University (approval no.: R2-39, date of approval: 24 February 2021; R3-28, date of approval: 22 September 2021).

Informed Consent Statement

Written informed consent has been obtained from all participants in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author (M.H.). The data are not publicly available due to privacy concerns.

Acknowledgments

M.H. would like to thank Miyuki Fuchigami, Mikako Horita, Nobuko Sato, and Miwako Koga for their administrative and technical support. M.H. acknowledge the editing service provided by FORTE Science Communications.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Polack, F.P.; Thomas, S.J.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Perez Marc, G.; Moreira, E.D.; Zerbini, C.; et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N. Engl. J. Med. 2020, 383, 2603–2615. [Google Scholar] [CrossRef] [PubMed]
  2. Baden, L.R.; El Sahly, H.M.; Essink, B.; Kotloff, K.; Frey, S.; Novak, R.; Diemert, D.; Spector, S.A.; Rouphael, N.; Creech, C.B.; et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N. Engl. J. Med. 2021, 384, 403–416. [Google Scholar] [CrossRef] [PubMed]
  3. Haas, E.J.; Angulo, F.J.; McLaughlin, J.M.; Anis, E.; Singer, S.R.; Khan, F.; Brooks, N.; Smaja, M.; Mircus, G.; Pan, K.; et al. Impact and effectiveness of mRNA BNT162b2 vaccine against SARS-CoV-2 infections and COVID-19 cases, hospitalisations, and deaths following a nationwide vaccination campaign in Israel: An observational study using national surveillance data. Lancet 2021, 397, 1819–1829. [Google Scholar] [CrossRef]
  4. Thompson, M.G.; Stenehjem, E.; Grannis, S.; Ball, S.W.; Naleway, A.L.; Ong, T.C.; DeSilva, M.B.; Natarajan, K.; Bozio, C.H.; Lewis, N.; et al. Effectiveness of Covid-19 Vaccines in Ambulatory and Inpatient Care Settings. N. Engl. J. Med. 2021, 385, 1355–1371. [Google Scholar] [CrossRef]
  5. Zheng, C.; Shao, W.; Chen, X.; Zhang, B.; Wang, G.; Zhang, W. Real-world effectiveness of COVID-19 vaccines: A literature review and meta-analysis. Int. J. Infect. Dis. 2022, 114, 252–260. [Google Scholar] [CrossRef]
  6. Goldberg, Y.; Mandel, M.; Bar-On, Y.M.; Bodenheimer, O.; Freedman, L.; Haas, E.J.; Milo, R.; Alroy-Preis, S.; Ash, N.; Huppert, A. Waning Immunity after the BNT162b2 Vaccine in Israel. N. Engl. J. Med. 2021, 385, e85. [Google Scholar] [CrossRef]
  7. Vitek, M.G.; Klavs, I.; Učakar, V.; Serdt, M.; Mrzel, M.; Vrh, M.; Fafangel, M. Vaccine effectiveness against severe acute respiratory infections (SARI) COVID-19 hospitalisations estimated from real-world surveillance data, Slovenia, October 2021. Eurosurveillance 2022, 27, 2101110. [Google Scholar] [CrossRef]
  8. Cameroni, E.; Bowen, J.E.; Rosen, L.E.; Saliba, C.; Zepeda, S.K.; Culap, K.; Pinto, D.; VanBlargan, L.A.; De Marco, A.; di Iulio, J.; et al. Broadly neutralizing antibodies overcome SARS-CoV-2 Omicron antigenic shift. Nature 2022, 602, 664–670. [Google Scholar] [CrossRef]
  9. Thomas, S.J.; Moreira, E.D., Jr.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Perez Marc, G.; Polack, F.P.; Zerbini, C.; et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine through 6 Months. N. Engl. J. Med. 2021, 385, 1761–1773. [Google Scholar] [CrossRef]
  10. Harder, T.; Külper-Schiek, W.; Reda, S.; Treskova-Schwarzbach, M.; Koch, J.; Vygen-Bonnet, S.; Wichmann, O. Effectiveness of COVID-19 vaccines against SARS-CoV-2 infection with the Delta (B.1.617.2) variant: Second interim results of a living systematic review and meta-analysis, 1 January to 25 August 2021. Eurosurveillance 2021, 26, 2100920. [Google Scholar] [CrossRef]
  11. Chemaitelly, H.; Tang, P.; Hasan, M.R.; AlMukdad, S.; Yassine, H.M.; Benslimane, F.M.; Al Khatib, H.A.; Coyle, P.; Ayoub, H.H.; Al Kanaani, Z.; et al. Waning of BNT162b2 Vaccine Protection against SARS-CoV-2 Infection in Qatar. N. Engl. J. Med. 2021, 385, e83. [Google Scholar] [CrossRef] [PubMed]
  12. Andrews, N.; Tessier, E.; Stowe, J.; Gower, C.; Kirsebom, F.; Simmons, R.; Gallagher, E.; Thelwall, S.; Groves, N.; Dabrera, G.; et al. Duration of Protection against Mild and Severe Disease by Covid-19 Vaccines. N. Engl. J. Med. 2022, 386, 340–350. [Google Scholar] [CrossRef] [PubMed]
  13. Liu, Q.; Qin, C.; Liu, M.; Liu, J. Effectiveness and safety of SARS-CoV-2 vaccine in real-world studies: A systematic review and meta-analysis. Infect. Dis. Poverty 2021, 10, 132. [Google Scholar] [CrossRef] [PubMed]
  14. Feikin, D.R.; Higdon, M.M.; Abu-Raddad, L.J.; Andrews, N.; Araos, R.; Goldberg, Y.; Groome, M.J.; Huppert, A.; O’Brien, K.L.; Smith, P.G.; et al. Duration of effectiveness of vaccines against SARS-CoV-2 infection and COVID-19 disease: Results of a systematic review and meta-regression. Lancet 2022, 399, 924–944. [Google Scholar] [CrossRef]
  15. Teerawattananon, Y.; Anothaisintawee, T.; Pheerapanyawaranun, C.; Botwright, S.; Akksilp, K.; Sirichumroonwit, N.; Budtarad, N.; Isaranuwatchai, W. A systematic review of methodological approaches for evaluating real-world effectiveness of COVID-19 vaccines: Advising resource-constrained settings. PLoS ONE 2022, 17, e0261930. [Google Scholar] [CrossRef]
  16. Lio, C.F.; Cheong, H.H.; Lei, C.I.; Lo, I.L.; Yao, L.; Lam, C.; Leong, I.H. Effectiveness of personal protective health behaviour against COVID-19. BMC Public Health 2021, 21, 827. [Google Scholar] [CrossRef]
  17. Talic, S.; Shah, S.; Wild, H.; Gasevic, D.; Maharaj, A.; Ademi, Z.; Li, X.; Xu, W.; Mesa-Eguiagaray, I.; Rostron, J.; et al. Effectiveness of public health measures in reducing the incidence of covid-19, SARS-CoV-2 transmission, and covid-19 mortality: Systematic review and meta-analysis. BMJ 2021, 375, e068302. [Google Scholar] [CrossRef]
  18. Iezadi, S.; Gholipour, K.; Azami-Aghdash, S.; Ghiasi, A.; Rezapour, A.; Pourasghari, H.; Pashazadeh, F. Effectiveness of non-pharmaceutical public health interventions against COVID-19: A systematic review and meta-analysis. PLoS ONE 2021, 16, e0260371. [Google Scholar] [CrossRef]
  19. Hirt, J.; Janiaud, P.; Hemkens, L.G. Randomized trials on non-pharmaceutical interventions for COVID-19: A scoping review. BMJ Evid. Based Med. 2022. [Google Scholar] [CrossRef]
  20. Ritchie, H.; Mathieu, E.; Rodés-Guirao, L.; Appel, C.; Giattino, C.; Ortiz-Ospina, E.; Hasell, J.; Macdonald, B.; Beltekian, D.; Roser, M. Coronavirus Pandemic (COVID-19). Our World Data. 2020. Available online: https://ourworldindata.org/coronavirus (accessed on 27 March 2022).
  21. Arashiro, Y.; Arima, Y.; Miyahara, R.; Suzuki, M.; Muraoka, H.; Ohba, K.; Uehara, Y.; Arioka, H.; Katou, H.; Oka, H.; et al. Provisional Report of a Case-Control Study on the COVID-19 Vaccine Effectiveness (First Report). Available online: https://www.niid.go.jp/niid/ja/2019-ncov/2484-idsc/10614-covid19-55.html (accessed on 16 February 2022).
  22. Arashiro, Y.; Arima, Y.; Suzuki, M.; Muraoka, H.; Ohba, K.; Uehara, Y.; Arioka, H.; Nouchi, H.; Katou, H.; Nagura, Y.; et al. Provisional Report of a Case-Control Study on the COVID-19 Vaccine Effectiveness (Second Report): Effectiveness During a Delta Strain Epidemic. Available online: https://www.niid.go.jp/niid/ja/2019-ncov/2484-idsc/10757-covid19-61.html (accessed on 16 February 2022).
  23. Maeda, H.; Morimoto, K. Vaccine Effectiveness Real-Time Surveillance for SARS-CoV-2 (VERSUS) Study: First report. 2021. Available online: https://covid-19-japan-epi.github.io/output/ (accessed on 16 February 2022).
  24. Maeda, H.; Morimoto, K. Vaccine Effectiveness Real-Time Surveillance for SARS-CoV-2 (VERSUS) Study: Second Report. Available online: https://covid-19-japan-epi.github.io/output/ve_nagasaki_v2.html (accessed on 16 February 2022).
  25. Franceschi, V.B.; Santos, A.S.; Glaeser, A.B.; Paiz, J.C.; Caldana, G.D.; Machado Lessa, C.L.; de Menezes Mayer, A.; Kuchle, J.G.; Gazzola Zen, P.R.; Vigo, A.; et al. Population-based prevalence surveys during the Covid-19 pandemic: A systematic review. Rev. Med. Virol. 2021, 31, e2200. [Google Scholar] [CrossRef]
  26. Ergonul, O.; Akyol, M.; Tanriover, C.; Tiemeier, H.; Petersen, E.; Petrosillo, N.; Gonen, M. National case fatality rates of the COVID-19 pandemic. Clin. Microbiol. Infect. 2021, 27, 118–124. [Google Scholar] [CrossRef] [PubMed]
  27. Hadfield, J.; Megill, C.; Bell, S.M.; Huddleston, J.; Potter, B.; Callender, C.; Sagulenko, P.; Bedford, T.; Neher, R.A. Nextstrain: Real-time tracking of pathogen evolution. Bioinformatics 2018, 34, 4121–4123. [Google Scholar] [CrossRef] [PubMed]
  28. WHO. WHO Target Product Profiles for COVID-19 Vaccines. Available online: https://www.who.int/publications/m/item/who-target-product-profiles-for-covid-19-vaccines (accessed on 16 February 2022).
  29. Pormohammad, A.; Zarei, M.; Ghorbani, S.; Mohammadi, M.; Neshin, S.A.S.; Khatami, A.; Turner, D.L.; Djalalinia, S.; Mousavi, S.A.; Mardani-Fard, H.A.; et al. Effectiveness of COVID-19 Vaccines against Delta (B.1.617.2) Variant: A Systematic Review and Meta-Analysis of Clinical Studies. Vaccines 2021, 10, 23. [Google Scholar] [CrossRef]
  30. Collie, S.; Champion, J.; Moultrie, H.; Bekker, L.G.; Gray, G. Effectiveness of BNT162b2 Vaccine against Omicron Variant in South Africa. N. Engl. J. Med. 2022, 386, 494–496. [Google Scholar] [CrossRef] [PubMed]
  31. Accorsi, E.K.; Britton, A.; Fleming-Dutra, K.E.; Smith, Z.R.; Shang, N.; Derado, G.; Miller, J.; Schrag, S.J.; Verani, J.R. Association Between 3 Doses of mRNA COVID-19 Vaccine and Symptomatic Infection Caused by the SARS-CoV-2 Omicron and Delta Variants. JAMA 2022, 327, 639–651. [Google Scholar] [CrossRef] [PubMed]
  32. Cao, Y.; Wang, J.; Jian, F.; Xiao, T.; Song, W.; Yisimayi, A.; Huang, W.; Li, Q.; Wang, P.; An, R.; et al. Omicron escapes the majority of existing SARS-CoV-2 neutralizing antibodies. Nature 2021, 602, 657–663. [Google Scholar] [CrossRef] [PubMed]
  33. Cele, S.; Jackson, L.; Khoury, D.S.; Khan, K.; Moyo-Gwete, T.; Tegally, H.; San, J.E.; Cromer, D.; Scheepers, C.; Amoako, D.G.; et al. Omicron extensively but incompletely escapes Pfizer BNT162b2 neutralization. Nature 2021, 602, 654–656. [Google Scholar] [CrossRef]
  34. Liu, L.; Iketani, S.; Guo, Y.; Chan, J.F.-W.; Wang, M.; Liu, L.; Luo, Y.; Chu, H.; Huang, Y.; Nair, M.S.; et al. Striking antibody evasion manifested by the Omicron variant of SARS-CoV-2. Nature 2021, 602, 676–681. [Google Scholar] [CrossRef]
  35. Lauring, A.S.; Tenforde, M.W.; Chappell, J.D.; Gaglani, M.; Ginde, A.A.; McNeal, T.; Ghamande, S.; Douin, D.J.; Talbot, H.K.; Casey, J.D.; et al. Clinical Severity and mRNA Vaccine Effectiveness for Omicron, Delta, and Alpha SARS-CoV-2 Variants in the United States: A Prospective Observational Study. medRxiv 2022. preprint. [Google Scholar] [CrossRef]
  36. Nikolaidis, M.; Markoulatos, P.; Van de Peer, Y.; Oliver, S.G.; Amoutzias, G.D. The Neighborhood of the Spike Gene Is a Hotspot for Modular Intertypic Homologous and Nonhomologous Recombination in Coronavirus Genomes. Mol. Biol. Evol. 2022, 39, msab292. [Google Scholar] [CrossRef]
  37. Nikolaidis, M.; Papakyriakou, A.; Chlichlia, K.; Markoulatos, P.; Oliver, S.G.; Amoutzias, G.D. Comparative Analysis of SARS-CoV-2 Variants of Concern, Including Omicron, Highlights Their Common and Distinctive Amino Acid Substitution Patterns, Especially at the Spike ORF. Viruses 2022, 14, 707. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Vaccine effectiveness against any COVID−19 infection (●) and COVID−19related hospitalization (■).
Figure 1. Vaccine effectiveness against any COVID−19 infection (●) and COVID−19related hospitalization (■).
Vaccines 10 00779 g001
Table 1. Characteristics of the study participants.
Table 1. Characteristics of the study participants.
Cases (n = 398)Controls (n = 179)
n%n%p-Value *
SexFemale19047.711061.50.003
AreaFukuoka city38195.715888.3<0.001
Age group16–19225.52514.0<0.001
(years)20–296817.11810.1
30–398822.11810.1
40–499323.43821.2
50–597919.83318.4
60–69307.52111.7
≥70184.52614.5
PCR testJune30.842.20.47
July6115.33016.8
August31879.913877.1
September164.073.9
Any comorbidity9624.14625.70.68
Protective health behavior
Wear a mask during contact with anyone38095.517597.80.184
Wash hands for ≥20 s each time24260.812972.10.009
Use a hand sanitizer35889.916089.40.836
Keep >1.5 m distance during contact with anyone32581.715586.60.143
Regular ventilation and disinfection32681.914581.00.795
Dining with 5 or more people225.595.00.806
Obtain information on COVID-19 regularly32782.214882.70.879
LifestyleCurrent smoking10225.64122.90.297
Current alcohol drinking21955.07843.60.034
Live in a single-family home13734.47843.60.037
Commute to work or school31579.113575.40.318
Family members commute to work or school285.071.6158.088.3<0.001
* The Chi-square test was used to analyze the differences between cases and controls.
Table 2. Vaccination status.
Table 2. Vaccination status.
Cases (n = 398)Controls (n = 179)
n%n%p-Value *
Vaccination dose028671.97541.9<0.0001
16616.64122.9
24611.66335.2
Vaccine typeBNT162b29685.79086.50.382
mRNA-12731614.31413.5
Days after the second dose; the mean (SD)42.9(39.4)27.4(21.5)0.02
Unvaccinated 28671.97541.9<0.0001
Less than 13 days from 1st dose to PCR test399.8147.8
More than 14 days from 1st dose to PCR test276.82715.1
Less than 13 days from 2nd dose to PCR test164.02312.8
14 to 29 days from 2nd dose to PCR test51.31910.6
30 to 59 days from 2nd dose to PCR test123.0137.3
More than 60 days from 2nd dose to PCR test133.384.5
SD: standard deviation. * The Chi-square test and t-test were used to analyze the differences between cases and controls.
Table 3. Factors associated with COVID-19 infection in Japan, 4 June–26 September.
Table 3. Factors associated with COVID-19 infection in Japan, 4 June–26 September.
CasesControlsCrude OR95% CI
Vaccination dose0286751(Reference)
166410.42(0.27–0.67)
246630.19(0.12–0.30)
SexMale208691(Reference)
Female1901100.58(0.40–0.83)
AreaFukuoka city3811581(Reference)
Saga city17210.34(0.17–0.65)
Age group (years)16–1922251(Reference)
20–2968184.29(1.98–9.30)
30–3988185.56(2.59–11.9)
40–4993382.78(1.40–5.52)
50–5979332.72(1.35–5.49)
60–6930211.62(0.73–3.61)
≥7018260.79(0.34–1.81)
PCR testJune431(Reference)
July30612.71(0.57–12.9)
August1383183.07(0.68–13.9)
September7163.05(0.54–17.4)
Any comorbidity96460.92(0.61–1.38)
Protective health behavior
Wear a mask during contact with anyone3801750.48(0.16–1.45)
Wash hands for over 20 s each time2421290.60(0.41–0.88)
Use a hand sanitizer3581601.06(0.60–1.89)
Keep >1.5 m distance during contact with anyone3251550.69(0.42–1.14)
Regular ventilation and disinfection3261451.06(0.38–1.67)
Dining with 5 or more people2291.11(0.50–2.45)
Obtain information on COVID-19 regularly3271480.97(0.61–1.54)
LifestyleCurrent smoking102411.16(0.77–1.76)
Current alcohol drinking219781.58(1.11–2.25)
Live in a single-family home137780.68(0.48–0.98)
Commute to work or school3151351.24(0.82–1.88)
Family members commute to work or school2851580.34(0.21–0.57)
Table 4. Adjusted odds ratio (aOR) against COVID-19 according to diagnosis period and place of care or stay.
Table 4. Adjusted odds ratio (aOR) against COVID-19 according to diagnosis period and place of care or stay.
TotalDiagnosis PeriodPlace
June and JulyAugust and SeptemberHospitalHotelHome
aOR *
(95%CI)
aOR *
(95%CI)
aOR *
(95%CI)
aOR *
(95%CI)
aOR *
(95%CI)
aOR *
(95%CI)
Vaccination dose0111111
(Reference)(Reference)(Reference)(Reference)(Reference)(Reference)
10.350.380.320.150.290.36
(0.20–0.61)(0.07–2.10)(0.17–0.60)(0.05–0.41)(0.12–0.68)(0.19–0.71)
20.190.080.210.030.230.22
(0.11–0.35)(0.01–0.65)(0.11–0.40)(0.01–0.13)(0.08–0.60)(0.11–0.45)
Unvaccinated 111111
(Reference) (Reference)(Reference)(Reference)(Reference)
Less than 13 days from 1st dose to PCR test0.691.210.680.220.760.79
(0.32–1.48)(0.13–11.2)(0.27–1.69)(0.06–0.79)(0.24–2.22)(0.31–2.05)
More than 14 days from 1st dose to PCR test0.200.090.180.100.110.21
(0.10–0.39)(0.01–0.94)(0.08–0.39)(0.03–0.36)(0.03–0.38)(0.09–0.48)
Less than 13 days from 2nd dose to PCR test0.160.690.120.050.140.16
(0.07–0.36)(0.03–17.7)(0.05–0.29)(0.01–0.25)(0.04–0.58)(0.06–0.46)
More than 14 days from 2nd dose to PCR test0.210.010.300.010.310.25
(0.10–0.42)(<0.001–0.15)(0.14–0.65)(<0.001–0.09)(0.10–1.02)(0.11–0.57)
* Sex, age (10-year intervals), area of residence, underlying medical conditions, PCR test date, handwashing for 20 s, current alcohol drinking, living in a single-family home, and family members’ commute to work or school.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hara, M.; Furue, T.; Fukuoka, M.; Iwanaga, K.; Matsuishi, E.; Miike, T.; Sakamoto, Y.; Mukai, N.; Kinugasa, Y.; Shigyo, M.; et al. Real-World Effectiveness of the mRNA COVID-19 Vaccines in Japan: A Case–Control Study. Vaccines 2022, 10, 779. https://doi.org/10.3390/vaccines10050779

AMA Style

Hara M, Furue T, Fukuoka M, Iwanaga K, Matsuishi E, Miike T, Sakamoto Y, Mukai N, Kinugasa Y, Shigyo M, et al. Real-World Effectiveness of the mRNA COVID-19 Vaccines in Japan: A Case–Control Study. Vaccines. 2022; 10(5):779. https://doi.org/10.3390/vaccines10050779

Chicago/Turabian Style

Hara, Megumi, Takeki Furue, Mami Fukuoka, Kentaro Iwanaga, Eijo Matsuishi, Toru Miike, Yuichiro Sakamoto, Naoko Mukai, Yuki Kinugasa, Mutsumi Shigyo, and et al. 2022. "Real-World Effectiveness of the mRNA COVID-19 Vaccines in Japan: A Case–Control Study" Vaccines 10, no. 5: 779. https://doi.org/10.3390/vaccines10050779

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop