Next Article in Journal
Prevention and Control of Swine Enteric Coronaviruses in China: A Review of Vaccine Development and Application
Previous Article in Journal
Anti-Idiotypic mRNA Vaccine to Treat Autoimmune Disorders
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Alternative Serological Measure for Assessing Foot-and-Mouth Disease Vaccine Efficacy against Homologous and Heterologous Viral Challenges in Pigs

1
Animal and Plant Quarantine Agency, 177 Hyeoksin 8-ro, Gimcheon City 39660, Gyeongsangbuk-do, Republic of Korea
2
College of Veterinary Medicine & Animal Disease Intervention Center, Kyungpook National University, Daegu 41566, Republic of Korea
*
Authors to whom correspondence should be addressed.
Vaccines 2024, 12(1), 10; https://doi.org/10.3390/vaccines12010010
Submission received: 11 November 2023 / Revised: 16 December 2023 / Accepted: 19 December 2023 / Published: 21 December 2023
(This article belongs to the Section Veterinary Vaccines)

Abstract

:
To analyze the relationship between homologous and heterologous serological titers of immunized pigs and their protection statuses against FMD virus challenges, in the present study, the correlation between the virus neutralization titers at 21 and 28 dpv and the protection statuses at 28 dpv against challenge with FMD virus was analyzed using data sets comprising five different combinations of homologous or heterologous challenge experiments in pigs vaccinated with type O (n = 96), A (n = 69), and Asia 1 (n = 74). As a result, the experiments were divided into three groups (21D-1, 21D-2, and 21D-3) in the 21-dpv model and two groups (28D-1 and 28D-2) in the 28-dpv model. Each response curve of groups 21D-1 and 21D-2 in the 21-dpv model was very similar to each curve of groups 28D-1 and 28D-2 in the 28-dpv model, respectively, even though there was an exceptional extra group (21D-3) in the 21-dpv model. The average titers estimating 0.75 probability of protection ranged from 1.06 to 1.62 log10 in the 21-dpv model and from 1.26 to 1.64 log10 in the 28-dpv model. In summary, we demonstrated that the serological method is useful for predicting the homologous and heterologous protection statuses of vaccinated pigs.

1. Introduction

Foot-and-mouth disease (FMD) is an economically important vesicular disease found in cloven-hoofed animal species, including cattle, pigs, sheep, and goats [1]. The causative agent, foot-and-mouth disease virus (FMDV), belongs to the genus Aphthovirus, family Picornaviridae. There are seven immunologically distinct serotypes of FMDV: O, A, C, Asia 1, SAT 1, SAT 2, and SAT 3 [2]. Given the fast transmission among hosts and the economic consequences of FMD, vaccination is widely used to contain and/or eradicate the disease in regions of the world where FMD is endemic. However, due to the narrow spectrum of cross-immunity between strains even of the same serotype, the selection of the proper vaccine strain is considered a critical point to control invasive FMD outbreaks [3]. Among the methods for the selection of FMD vaccine strains, in vitro vaccine matching tests can be considered to measure the serological relatedness between field isolates and a vaccine strain with a bovine vaccinated serum (r1 value). If the r1 value that is derived by dividing the heterologous serological titer by the homologous serological titer is greater than 0.3 in the case of neutralization, the relatedness between the field isolate and vaccine strain is considered sufficiently acceptable such that the vaccine containing the vaccine strain might be adequate to confer protective immunity against challenges with the field virus [4,5]. Nevertheless, recent studies have demonstrated that a higher potency vaccine could induce a wider spectrum of cross-immunity and earlier protection [6,7,8,9].
The efficacy of the FMD vaccine has been assessed via vaccination challenge tests in cattle using standardized in vivo FMD vaccine potency estimations, such as the PD50 (50% protective dose) and the PGP (protection against generalized foot infection) test [4]. However, in vivo challenge tests have practical and logistical problems [10,11], and several disadvantages from the perspective of animal welfare and biosafety. In these regards, alternative methods for assessing FMD vaccine efficacy are allowed if statistical correlations between the alternatives and the in vivo challenge test in the target animal species are established [4]. Therefore, many studies have developed or demonstrated statistically validated alternative tests using serological measures for estimating the potency of vaccines, predicting cross-protection and reducing animal experiments in cattle [12,13,14,15,16,17,18,19,20], as cattle are the main animals susceptible to vaccination with FMD vaccines in most countries. However, these approaches based on efficacy studies in pigs have seldom been reported in recent years, although several studies were conducted a few decades ago [21]. In addition, as FMD outbreaks intermittently occurred in Korea despite massive FMD vaccination campaigns, questions were eventually raised about the potential protection by vaccine-induced antibody titers against the outbreak virus due to a perception that pigs were not well protected by the FMD vaccine. Therefore, it has been speculated that statistical correlations between potential alternative serological measurements and the protection against FMD challenges in pigs need to be studied using currently adopted serological systems because pigs are the major susceptible animals to FMDV in Korea.
Among these indirect serological assessments is the expected percentage of protection (EPP), a potency test that South American researchers devised based on the correlative comparison of an enzyme-linked immunosorbent assay (ELISA) of sera collected at 60 days post vaccination (dpv) with the corresponding protection status as a result of a challenge with virulent FMDV at 90 dpv in PGP experiments [14,18]. In addition, pass-level studies on the PD50 have often been conducted with sets of data comprising the results of virus neutralization test (VNT) titers of sera collected at 21 dpv with the corresponding protection status resulting from a challenge with virulent FMDV at 21 dpv [11,16,19,20]. However, the World Organisation for Animal Health (WOAH) terrestrial manual indicates that the PD50 of oil-adjuvanted FMD vaccines are measured by challenge with the virulent FMDV at up to 28 dpv [4], and many efficacy tests in pigs have tended to be evaluated by challenge with FMDV at 28 dpv [22,23,24]. This discrepancy needs to be investigated regarding the pass-levels of the efficacy test for the Korean national standard, which are serological titers at 21 days after a full-dose immunization.
In this study, we established an indirect assessment model for the protection probability of FMD vaccines against serotypes O, A, and Asia 1, based on a statistical correlation between the protection conferred against virus challenges and the serological response in vaccinated pigs. We studied how two different sets of VNT titer results at 21 and 28 dpv could influence the development of the model of protection probability for FMD vaccines.

2. Materials and Methods

2.1. Cells and Viruses

Baby hamster kidney (BHK-21) and porcine kidney (LFBK) cells were used to culture FMDV in Dulbecco’s modified Eagle’s medium. The LFBK cells were kindly provided by the Plum Island Animal Disease Center (New York, NY, USA). The BHK-21 suspension cells were cultured in ProVERO-1 serum-free medium (Lonza Bioscience, Basel, Switzerland). Because we were interested in protective efficacies of vaccine strain candidates against the FMDV isolates causing outbreaks in Korea, the FMDV O/SKR/Jincheon/2014 (O/Jincheon, O/SEA/Mya-98 lineage), A/SKR/Pocheon/2010 (A/Pocheon, A/ASIA/Sea-97 G1 lineage), and A/SKR/Yeoncheon/2017 (A/Yeoncheon, A/ASIA/Sea-97 G2 lineage) were prepared for vaccine strains, challenges, and VNTs. And Asia-1/Shamir/ISR/89 (Asia-1/Shamir) strains were also prepared for vaccine strains, challenges, and VNTs, because outbreaks of type Asia-1 viruses were often reported in Pool 1 area [25].

2.2. Preparation of Vaccines

Four experimental monovalent vaccines (the O/Jincheon, A/Pocheon, A/Yeoncheon, and Asia-1/Shamir vaccines) and one commercial monovalent vaccine (O/Primorsky, O/SEA/Mya-98 lineage) were administered to pigs for efficacy testing. The experimental vaccines were formulated with each of the vaccine antigens and Montanide ISA 206 adjuvant (Seppic, Paris, France) as a double oil-emulsion, water-in-oil-in-water (W/O/W) formulation [26]. Briefly, to prepare the four experimental vaccines, the inactivated 146S antigens of FMD viruses were diluted with Tris-NaCl buffer (pH 7.6) and then added to Montanide ISA 206, 10% aluminum hydroxide gel, and 0.5 mg/2 mL saponin. The mixture was stirred at 300 rpm for 10 min at 30 °C in a water incubator to formulate a W/O/W emulsion.

2.3. Vaccine Efficacy Study and Challenge Protocol

Animal experiments were performed in a biosafety level 3 (BSL3) containment facility at the Animal and Plant Quarantine Agency (APQA). All experiments were followed by protocols were approved by the Institutional Animal Care and Use Committee (IACUC) of the APQA of Korea (IACUC Nos. 2018-407, 2019-435, and 2020-376). All animals were acclimated for at least 1 week before being subjected to experimentation. All experimental animals were cared for according to the animal management guidelines of the APQA.
Two hundred and seventy-four FMD-free, crossbred pigs (8–10 weeks of age) were used in the experiment to evaluate the efficacy of the five FMD vaccines. Pigs with 0.9 or less preexisting VNT titers against the challenge viruses were selected for efficacy tests. Twenty-nine and sixty-seven pigs were vaccinated with the O/Jincheon and O/Primorsky vaccines, respectively. Fifteen and fifty-four pigs were vaccinated with the A/Yeoncheon and A/Pocheon vaccines, respectively. Seventy-four pigs were vaccinated with the Asia-1/Shamir vaccine. To measure the serological titers after vaccination, sera were collected at 0, 21, and 28 days after vaccination. One serum sample from O/Primorsky-vaccinated pigs and sixteen serum samples from Asia-1/Shamir-vaccinated pigs at 21 dpv were mistakenly not collected.
At 28 dpv, a FMDV challenge was performed with a homologous or heterologous virus strain to the vaccine strain by intradermal inoculation into two sites on the upper surface of the tongue. In brief, according to the applied vaccine antigen serotypes, the vaccinated and control pigs were challenged with the same serotype of challenge viruses by intradermal inoculation with 0.2 mL of challenge virus containing 105.7 TCID50/200 µL of O/Jincheon, 105.3 TCID50/200 µL of A/Yeoncheon, or 106.3 TCID50/200 µL of Asia-1/Shamir virus, which were determined to be 1000 × 50% porcine infectious dose (PID50) by pig challenge tests with pig-derived viruses. After the challenge, the titers of the viruses were confirmed by TCID50 in LFBK cells. The clinical scores of the infected pigs were collected daily and recorded using a scoring system described previously [27]. Through daily observation, the animals that showed clinical manifestations of typical FMD signs were immediately separated from other animals that did not show any clinical signs. After the FMDV challenge, sera were collected on all sequential days beginning at 0 days post challenge (dpc) to 7 dpc. Animals that developed typical FMD lesions, such as vesicle, at sites other than the tongue, such as the lips, gums, snout, and feet, were considered unprotected animals.

2.4. Serological Assays

The VNT titers against the FMDV strains in the serum samples were measured following the Manual of Diagnostic Tests and Vaccines for Terrestrial Animals of the WOAH [4]. Briefly, sera inactivated at 56 °C for 30 min were diluted serially and incubated with 100 TCID50 of the appropriate FMDVs at 37 °C for 1 h. O/Jincheon virus was added to sera from the efficacy test of the O/Jincheon and O/Primorsky vaccines; A/Yeoncheon virus was added to sera from the efficacy test of the A/Yeoncheon and Pocheon vaccines; and Asia-1/Shamir virus was added to sera from the Asia-1/Shamir vaccine efficacy test. LFBK cells were added to the microplate and incubated at 37 °C for 42–72 h to identify the cytopathic effect. The VNT titers were calculated as the log10 of the reciprocal serum dilution found to inhibit cytopathic effects.

2.5. Statistical Analysis

To find the correlation between the protection result and the serological titer, logistic regression was used as the statistical model, which was generated in the R program (version 4.3.0; http://www.r-project.org/, accessed on 1 April 2023) using the R2jags and coda packages. The binary protection variables (protected/not protected against challenge) were paired with the log-individual serological titers to construct the data set in the model. The expected probability of protection against the challenge (pi) for the log10 serum titer of an individual animal (ti) is given by log [pi/(1 − pi)] = a + blog10 ti. In the model, a and b are the intercept and slope parameters, respectively. Because various serotypes and strains could influence the level of protection at a given titer, the slope and intercept parameters were estimated in a Bayesian framework, considering various sets of combinations among serotypes or strains using a previously described procedure [20]. Briefly, several separate and combined sets of variation among strains and serotypes were considered for slope and intercept parameters. Grouping allocations were considered based on a post hoc comparison of estimated intercepts and slopes. The considered models are described in Table S1. For the estimation in a Bayesian framework, a Bernoulli likelihood was assumed for the binary protection status of the data. The deviance information criterion (DIC) was used to compare the fit of different models for serotype and strain variation in parameters [28].
Using a receiver operating characteristic (ROC) analysis [29], a cutoff VNT titer was calculated at the point of the highest prediction accuracy (ACC). Using this cutoff VNT titer as a criterion of protection against the challenge, the expected protection for the individual serum titer was predicted to analyze the diagnostic performance of the model in real values.

3. Results

3.1. In Vivo Efficacy Results

The results of the vaccination-challenge efficacy trials conducted in the APQA for three different serotypes are summarized in Table 1 and Data S1. In the efficacy trials, the VNT titers against the challenge strain varied widely due to the various amounts of purified FMD 146S antigen in the applied vaccines. The mean VNT titers at 28 dpv in the O/Jincheon and A/Yeoncheon groups were below the 1.0 log10 titer, showing 31.0 and 26.7% protection rates, respectively. In contrast, the mean VNT titers at 28 dpv in the O/Primorsky and Asia-1/Shamir groups were above the 1.30 log10 titer, showing 73.1 and 73.0% overall protection rates, respectively. The A/Pocheon-vaccinated groups had a 1.17 log10 mean VNT titer, and 64.8% of the vaccinated animals were protected. As the VNT titers increased sharply after the challenge, mean VNT titers against the challenge viruses of more than 2.15 log10 were found in all groups at 7 dpc.
The observed protection rates against the challenge viruses based on the levels of VNT titers are illustrated in Figure 1. According to the observed protection statuses at challenge time for each 21 and 28-dpv VNT titer, protection rates tended to be higher as VNT titers increased. Twenty-eight percent or less protection rates were observed in animals with less than 0.6 log10 VNT titer in each vaccine-challenge study. More than 84% protection rates were observed in animals with more than 1.65 log10 VNT titers.

3.2. Estimation of Protection Probability to VNT Titer

By analyzing the logistic regression models in a Bayesian framework, the preferred models for 21- and 28-dpv titers were determined (Table S1). Although the 28-dpv model, which contained five different groups of strains, was found to be the best based on comparisons of the respective DICs, the model in which the intercepts fell into two groups and shared a slope in common was preferred, because its DIC was very similar to the model comprising five independent groups and because it was simpler than most other models. Therefore, the models for 21- and 28-dpv in which the intercepts were different across groups and the slope was common were preferred (Figure 2). In the 21-dpv model, the correlative relationships of the probability of protection with VNT titers were defined as experiments and were divided into three groups: group 21D-1 comprising O/Jincheon-O/Jincheon; group 21D-2 comprising O/Primorsky-O/Jincheon, A/Yeoncheon-A/Yeoncheon, and Asia1/Shamir-Asia1/Shamir; and group 21D-3 comprising A/Pocheon-A/Yeoncheon trials. In the 28-dpv model, two separate groups of trials were identified as models for predicting the probability of protection with VNT titers: group 28D-1 comprising the O/Jincheon-O/Jincheon and A/Yeoncheon-A/Yeoncheon trials and group 28D-2 comprising the O/Primorsky-O/Jincheon, A/Pocheon-A/Yeoncheon, and Asia1/Shamir-Asia1/Shamir trials. The estimated parameters for both models are described in Table S2.
The response curves of the models of different groups in each model are shown in comparison with one another in Figure 3. Each response curve of group 21D-1 and group 21D-2 in the 21-dpv model is very similar to those of group 28D-1 and group 28D-2 in the 28-dpv model, respectively. The probability of protection tends to correlate to higher VNT titer in order of the first and second groups in each model. The curve of group 21D-3 in the 21-dpv model corresponds most effectively to the VNT titer. The estimated VNT titers for protection probabilities based on the constructed models are described in Table 2. The estimated average VNT titers corresponding to 75% protection were 1.62, 1.35, and 1.06 log10 VNT titers in groups 21D-1, 21D-2, and 21D-3 of the 21-dpv model, respectively. The estimated average VNT titers corresponding to 75% protection were 1.34 and 1.26 log10 VNT titers in groups 28D-1 and 28D-2 of the 28-dpv model, respectively.

3.3. The Characteristics of the Models

The results of the ROC analysis of each group in the 21- and 28-dpv models are illustrated in Figure 4. The mean values of the area under the curve (AUC) in all groups were more than 0.867 and 0.882 in the 21- and 28-dpv models, respectively. The cutoff VNT titers of protection were determined for each model using ROC analysis (Table 3). The cutoff VNT titers of protection of group 21D-1, group 21D-2, and group 21D-3 in the 21-dpv model were 1.27. 1.43, and 0.75 log10, respectively. The cutoff VNT titers of group 28D-1 and group 28D-2 in the 28-dpv model were 1.27 and 0.97 log10, respectively. The sensitivities of the groups in the 28-dpv models were 84.6% or greater, but those in the 21-dpv models ranged from 55.6% to 80.0%. The specificities in the 21-dpv models were greater than 89%, although the specificities in the 28-dpv models were greater than 73.7%. Although the ACCs of all groups in each model reached 80.6 or greater, the ACCs in the 28-dpv model were higher than those in the 21-dpv model.

4. Discussion

While highly effective for measuring protection, in vivo FMD vaccine efficacy tests are rarely performed due to the expense, time, and the need for high containment bio-security animal facilities to prevent the environment from subsequent infection. Therefore, sample size imbalances of in vivo FMD vaccine efficacy data are often observed in statistical approach studies [16,20]. In this study, the Bayesian framework was used to draw the reliable statistical inference from a limited number of samples in groups due to limited resources and time, like the study by Gubbins et al. [20]. In the present study, the correlation between the VNT titer and protection status against the challenge with FMDV was analyzed using data sets comprising five different combinations of homologous or heterologous vaccination challenge experiments in pigs. According to the results of the 21-dpv and 28-dpv models, we speculate that universal models with common parameters cannot be established to predict homologous and heterologous efficacy tests, as was seen in a study by Gubbins et al. [20]. In summary, the experiments are divided into three groups in the 21-dpv model and two groups in the 28-dpv model (Figure 2). Each response curve of groups 21D-1 and 21D-2 in the 21-dpv model was very similar to each curve of groups 28D-1 and 28D-2 in the 28-dpv model, respectively, even though there was an exceptional extra group in the 21-dpv model (Figure 3). Interestingly, a significant difference in the parameters between both models was shown in only the type A experiment. The type A homologous efficacy experiment (A/Yeoncheon-A/Yeoncheon), belonging to group 21D-2 in the 21-dpv model, correlated with group 28D-1 in the 28-dpv model, and the type A heterologous efficacy experiment (A/Pocheon-A/Yeoncheon), belonging to group 21D-3 in 21-dpv, correlated with group 28D-2 in the 28-dpv model. One finding related to this change was that the VNT titers induced by the A/Pocheon vaccine between 21 and 28 dpv changed the most significantly among the vaccine-induced VNT titers in this study. Because fluctuations in serological titers are often observed within approximately one month after FMD vaccination, the model should be carefully applied to predict the potency of the vaccine based on its original performance, even if the diagnostic test is guaranteed for its reproducibility as an indirect alternative.
According to Table 1, the mean VNT titers and protection rates against the homologous challenge seems to be lower than the result against the heterologous one in the efficacy groups. However, we had to prepare FMD vaccines formulated with various amounts of the purified FMD 146S antigen to induce a wide range of VN titers in immunized pigs. Reflecting on the antigen payloads in vaccines, it could be speculated that a greater amount of antigen in the vaccines may cause a significant effect in inducing a higher level of VNT and more protection, in the situation where homologous and heterologous strains may share common neutralization antigenic sites because both strains belong to the same lineage. But we have no direct evidence for this, because we did not prepare homologous and heterologous vaccines with a comparable payload of the 146S antigen.
Alternative serological methods based on the statistical correlation between serological titers and protection status against challenges with homologous viruses have often been devised to estimate the efficacy of FMD vaccines against homologous vaccine viruses in cattle. The statistical correlation between serological titers and protection status in porcine efficacy tests has also indicated that a mean VNT titer of 1.74 or higher equated to 62.5% protection in 92% cases of porcine efficacy tests challenged with the O1 BFS 1860 virus after vaccination with oil-emulsion FMD vaccines [21]. However, the current WOAH minimum potency level for FMD vaccines is three PD50. In South America, the liquid phase blocking ELISA titer for each FMD vaccine strain was predetermined for the assessment of the approval of the vaccine release test using cattle with a criterion of 75% EPP, which correlated with a PD50 value of 3 [13,18]. Conversely, the probabilities of protection for 3 and 6 PD50 of oil-emulsion FMD vaccines were estimated to be 0.71 and 0.81 in the bovine efficacy test, respectively [30]. Another study reported that the VNT titer corresponding to a 0.75 probability of protection in cattle ranged from 1.17 to 2.46 log10 [19]. In the present study, the VNT titers related to a 0.625 probability of protection in pigs ranged from 0.91 to 1.46 log10 in the 21-dpv model and from 1.10 to 1.49 log10 in the 28-dpv model. The VNT titers estimating 0.75 probability of protection ranged from 1.06 to 1.62 log10 in the 21-dpv model and from 1.26 to 1.64 log10 in the 28-dpv model. It seems that the results of each study are somewhat different from one other, probably because there were several differences in hosts, FMD vaccine formulations and challenge viruses, routes of challenge, and the amounts of challenge virus administered among these studies. Additionally, VNT is well known to have poor reproducibility depending on the laboratory. However, as indirect alternatives, serological approaches have been well established to predict the efficacy of FMD vaccines. Among serological tests, VNT is more easily applicable than ELISA for quantifying antibody titers induced by a variety of FMD strains.
In the diagnostic performance of the present study, the overall accuracies were over 80% in both models. The accuracy (86.7–90.9%) of the 28-dpv model was better than that (80.6–86.2%) of the 21-dpv model according to the cutoff VNT titer to predict protection status. In the 21-dpv model, the cutoff VNT titer to predict the protection status of group 21D-3 is 0.75 log10, which is below 0.9 log10, the minimum titer found in this study. The cutoff VNT titer of group 28D-2 in the 28-dpv model was 0.97 log10, which is very similar to the minimum titer found in this study. These low cutoff titers mean that most animals in these groups tended to be protected even if the serological titers were barely detected. Approximately 25% of animals that had less than 0.9 log10 VNT titer at 21 or 28 dpv were protected in these groups. This tendency toward a low cutoff is probably related to the resistance of the host against a certain FMD strain. It could also be inferred that there is another immune response, such as cell-mediated immunity, related to protection in pigs. However, to clarify these results, further study with a larger scale of experiments is necessary.
Although the results from both models are different from one other, both models showed significant correlations between serological titers and protection status. However, it seems that the 28-dpv model has a more significant correlation than the 21-dpv model, because the 28-dpv model has a lower DIC value than the 21-dpv model and because the AUCs of the 28-dpv model ranged from 0.882 to 0.960, while those of the 21-dpv model ranged from 0.867 to 0.892 using ROC analysis.
Pigs play an important role as amplifiers of FMDV, releasing 3000× more aerosol virus than cattle within 24 h, especially in intensive farming areas [31]. Therefore, porcine efficacy tests sometimes fail to show the relationship between the serological titer and protection status because of immense superinfection by amplifying aerosol virus after inappropriate challenges [21]. Therefore, several pig challenge methods were carefully considered for this study, although various challenge methods have already been used in pig efficacy tests, including heel bulb intradermal inoculation [22,32,33,34,35], intramuscular inoculation [24], intra-oropharyngeal inoculation [36], and contact challenge by introduction with infected donor [37,38]. Although heel bulb intradermal inoculation is considered the major challenge method due to its superior sensitivity in pigs [39], its application in pigs is labor-intensive and time-consuming [24]. Additionally, because oropharyngeal tonsil epithelium is considered the natural primary infection site of FMDV in the host [40], contact challenge or intra-oropharyngeal inoculation is preferred to investigate the infection dynamics, transmission between hosts, and the pathogenesis of FMD in pigs [41,42,43]. In this study, pig challenge methods were adapted from those of cattle in the WOAH manual based on a pilot study with O/Jincheon virus. The experiments were conducted to determine the PID50 in pigs with O/Jincheon, A/Yeoncheon, and Asia1/Shamir. The 1000 PID50 for the challenge was determined by referring to porcine challenge studies [24,44,45]. In each porcine efficacy experiment, all unvaccinated control animals developed clinical signs of FMD within four days after the challenge.
We conclusively demonstrated that the correlation between titers and the probability of protection against the challenge virus was significant in FMD-vaccinated pigs. The possibility of VNT titers being specific to the FMD strain in regard to the corresponding probability of protection was also demonstrated. Additionally, vaccination challenge experiments were categorized to build prediction models with common parameters. According to the present study, the serological titer at the time of challenge could more correctly predict a probability of protection. However, it could be concluded that the serological titers at an earlier time of challenge, such as 21 days, could be used to estimate the protection if the model is statistically demonstrated. This study has limitations in the diversity of vaccination challenge experiments using more various vaccines and challenge strains, and it does not have data related to PD50 in pigs. Therefore, further research based on more porcine vaccination challenge experiments under various conditions should be conducted to develop better models to predict cross-protection against various FMD virus strains.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/vaccines12010010/s1, Data S1: The serology results and protection outcomes for each animal; Table S1: Deviance information criterion (DIC) determined in each model for the probability of protection; Table S2: Estimates for the intercepts and slopes in the models for the probability of protection after challenge with FMDV.

Author Contributions

Conceptualization, J.K., J.-H.P. and C.-K.P.; validation, S.H.L.; formal analysis, J.K.; investigation, S.H.L., H.-H.K., S.-H.S. and S.-H.P.; data curation, S.H.L. and H.-H.K.; visualization, S.H.L. and J.K.; writing—original draft preparation, J.K.; writing—review and editing, S.-H.S., S.-H.P., J.-H.P. and C.-K.P.; supervision, J.-H.P. and C.-K.P.; project administration, J.K. and J.-H.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by a grant (project code No. B-1543386-2021-22-01) from the National Animal Disease Research Project of the Animal and Plant Quarantine Agency (APQA).

Institutional Review Board Statement

The animal study protocol was approved by the Institutional Animal Care and Use Committee (IACUC) of the APQA of Korea (IACUC Nos. 2018-407, 2019-435, and 2020-376).

Informed Consent Statement

Not applicable.

Data Availability Statement

All data generated and/or analyzed during this study are included in this manuscript. The raw data are available from the corresponding author on reasonable request, or by referring to Supplementary Materials.

Acknowledgments

This study was conducted independently by the APQA. We thank the staff and researchers of the Center for FMD Vaccine Research, APQA, for helping us with this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bachrach, H.L. Foot-and-mouth disease. Annu. Rev. Microbiol. 1968, 22, 201–244. [Google Scholar] [CrossRef] [PubMed]
  2. Pereira, H. Foot-and-mouth disease. In Virus Diseases of Food Animals; Gibbs, E.P.G., Ed.; Academic Press Inc.: New York, NY, USA, 1981; Volume 2, pp. 333–363. [Google Scholar]
  3. Paton, D.J.; Reeve, R.; Capozzo, A.V.; Ludi, A. Estimating the protection afforded by foot-and-mouth disease vaccines in the laboratory. Vaccine 2019, 37, 5515–5524. [Google Scholar] [CrossRef] [PubMed]
  4. WOAH. WOAH Terrestrial Manual 2022. In Foot and Mouth Disease (Infection with Foot and Mouth Disease Virus); WOAH: Paris, France, 2022. [Google Scholar]
  5. Waters, R.; Ludi, A.B.; Fowler, V.L.; Wilsden, G.; Browning, C.; Gubbins, S.; Statham, B.; Bin-Tarif, A.; Mioulet, V.; King, D.J.; et al. Efficacy of a high-potency multivalent foot-and-mouth disease virus vaccine in cattle against heterologous challenge with a field virus from the emerging A/ASIA/G-VII lineage. Vaccine 2018, 36, 1901–1907. [Google Scholar] [CrossRef] [PubMed]
  6. Brehm, K.E.; Kumar, N.; Thulke, H.H.; Haas, B. High potency vaccines induce protection against heterologous challenge with foot-and-mouth disease virus. Vaccine 2008, 26, 1681–1687. [Google Scholar] [CrossRef] [PubMed]
  7. Nagendrakumar, S.B.; Srinivasan, V.A.; Madhanmohan, M.; Yuvaraj, S.; Parida, S.; Di Nardo, A.; Horsington, J.; Paton, D.J. Evaluation of cross-protection between O1 Manisa and O1 Campos in cattle vaccinated with foot-and-mouth disease virus vaccine incorporating different payloads of inactivated O1 Manisa antigen. Vaccine 2011, 29, 1906–1912. [Google Scholar] [CrossRef] [PubMed]
  8. Fishbourne, E.; Ludi, A.B.; Wilsden, G.; Hamblin, P.; Statham, B.; Bin-Tarif, A.; Brocchi, E.; Grazioli, S.; Dekker, A.; Eble, P.; et al. Efficacy of a high potency O1 Manisa foot-and-mouth disease vaccine in cattle against heterologous challenge with a field virus from the O/ME-SA/Ind-2001 lineage collected in North Africa. Vaccine 2017, 35, 2761–2765. [Google Scholar] [CrossRef] [PubMed]
  9. Horsington, J.; Perez, C.B.; Maradei, E.; Novo, S.G.; Gonzales, J.L.; Singanallur, N.B.; Bonastre, P.; Vosloo, W. Protective effects of high-potency FMDV O1 Manisa monovalent vaccine in cattle challenged with FMDV O/SKR/2010 at 7 or 4 days post vaccination. Vaccine 2017, 35, 5179–5185. [Google Scholar] [CrossRef]
  10. Goris, N.; Merkelbach-Peters, P.; Diev, V.I.; Verloo, D.; Zakharov, V.M.; Kraft, H.P.; De Clercq, K. European Pharmacopoeia foot-and-mouth disease vaccine potency testing in cattle: Between test variability and its consequences. Vaccine 2007, 25, 3373–3379. [Google Scholar] [CrossRef]
  11. Goris, N.; Maradei, E.; D’Aloia, R.; Fondevila, N.; Mattion, N.; Perez, A.; Smitsaart, E.; Nauwynck, H.J.; La Torre, J.; Palma, E.; et al. Foot-and-mouth disease vaccine potency testing in cattle using homologous and heterologous challenge strains: Precision of the “Protection against Podal Generalisation” test. Vaccine 2008, 26, 3432–3437. [Google Scholar] [CrossRef]
  12. Hingley, P.J.; Pay, T.W. Sources of variability in foot and mouth disease vaccine potency estimates based on serum neutralizing antibody assay. J. Biol. Stand. 1987, 15, 127–142. [Google Scholar] [CrossRef]
  13. Vianna Filho, Y.L.; Astudillo, V.; Gomes, I.; Fernandez, G.; Rozas, C.E.; Ravison, J.A.; Alonso, A. Potency control of foot-and-mouth disease vaccine in cattle. Comparison of the 50% protective dose and the protection against generalization. Vaccine 1993, 11, 1424–1428. [Google Scholar] [CrossRef] [PubMed]
  14. Periolo, O.H.; Seki, C.; Grigera, P.R.; Robiolo, B.; Fernandez, G.; Maradei, E.; D’Aloia, R.; La Torre, J.L. Large-scale use of liquid-phase blocking sandwich ELISA for the evaluation of protective immunity against aphthovirus in cattle vaccinated with oil-adjuvanted vaccines in Argentina. Vaccine 1993, 11, 754–760. [Google Scholar] [CrossRef] [PubMed]
  15. Robiolo, B.; Grigera, P.R.; Periolo, O.H.; Seki, C.; Bianchi, T.; Maradei, E.; La Torre, J.L. Assessment of foot and mouth disease vaccine potency by liquid-phase blocking ELISA: A proposal for an alternative to the challenge procedure in Argentina. Vaccine 1995, 13, 1346–1352. [Google Scholar] [CrossRef] [PubMed]
  16. Barnett, P.V.; Statham, R.J.; Vosloo, W.; Haydon, D.T. Foot-and-mouth disease vaccine potency testing: Determination and statistical validation of a model using a serological approach. Vaccine 2003, 21, 3240–3248. [Google Scholar] [CrossRef] [PubMed]
  17. Goris, N.; Willems, T.; Diev, V.I.; Merkelbach-Peters, P.; Vanbinst, T.; Van der Stede, Y.; Kraft, H.P.; Zakharov, V.M.; Borisov, V.V.; Nauwynck, H.J.; et al. Indirect foot-and-mouth disease vaccine potency testing based on a serological alternative. Vaccine 2008, 26, 3870–3879. [Google Scholar] [CrossRef] [PubMed]
  18. Maradei, E.; La Torre, J.; Robiolo, B.; Esteves, J.; Seki, C.; Pedemonte, A.; Iglesias, M.; D’Aloia, R.; Mattion, N. Updating of the correlation between lpELISA titers and protection from virus challenge for the assessment of the potency of polyvalent aphtovirus vaccines in Argentina. Vaccine 2008, 26, 6577–6586. [Google Scholar] [CrossRef]
  19. Willems, T.; Lefebvre, D.J.; Goris, N.; Diev, V.I.; Kremenchugskaya, S.R.; Paul, G.; Haas, B.; De Clercq, K. Characteristics of serology-based vaccine potency models for foot-and-mouth disease virus. Vaccine 2012, 30, 5849–5855. [Google Scholar] [CrossRef] [PubMed]
  20. Gubbins, S.; Paton, D.J.; Dekker, A.; Ludi, A.B.; Wilsden, G.; Browning, C.F.J.; Eschbaumer, M.; Barnabei, J.; Duque, H.; Pauszek, L.L.; et al. Predicting cross-protection against foot-and-mouth disease virus strains by serology after vaccination. Front. Vet. Sci. 2022, 9, 1027006. [Google Scholar] [CrossRef]
  21. Black, L.; Francis, M.J.; Rweyemamu, M.M.; Umebara, O.; Boge, A. The relationship between serum antibody titres and protection from foot and mouth disease in pigs after oil emulsion vaccination. J. Biol. Stand. 1984, 12, 379–389. [Google Scholar] [CrossRef]
  22. Galdo Novo, S.; Malirat, V.; Maradei, E.D.; Pedemonte, A.R.; Espinoza, A.M.; Smitsaart, E.; Lee, K.N.; Park, J.H.; Bergmann, I.E. Efficacy of a high quality O1/Campos foot-and-mouth disease vaccine upon challenge with a heterologous Korean O Mya98 lineage virus in pigs. Vaccine 2018, 36, 1570–1576. [Google Scholar] [CrossRef]
  23. Lee, S.Y.; Lee, Y.J.; Kim, R.H.; Park, J.N.; Park, M.E.; Ko, M.K.; Choi, J.H.; Chu, J.Q.; Lee, K.N.; Kim, S.M.; et al. Rapid Engineering of Foot-and-Mouth Disease Vaccine and Challenge Viruses. J. Virol. 2017, 91, e00155-17. [Google Scholar] [CrossRef] [PubMed]
  24. Li, D.; Lu, Z.J.; Xie, B.X.; Sun, P.; Chen, Y.L.; Fu, Y.F.; Liu, Z.X. Alternative way to test the efficacy of swine FMD vaccines: Measurement of pigs median infected dose (PID50) and regulation of live virus challenge dose. Virol. J. 2010, 7, 215. [Google Scholar] [CrossRef] [PubMed]
  25. Jamal, S.M.; Belsham, G.J. Molecular epidemiology, evolution and phylogeny of foot-and-mouth disease virus. Infect. Genet. Evol. 2018, 59, 84–98. [Google Scholar] [CrossRef] [PubMed]
  26. Ko, M.K.; Jo, H.E.; Choi, J.H.; You, S.H.; Shin, S.H.; Jo, H.; Lee, M.J.; Kim, S.M.; Kim, B.; Park, J.H. Chimeric vaccine strain of type O foot-and-mouth disease elicits a strong immune response in pigs against ME-SA and SEA topotypes. Vet. Microbiol. 2019, 229, 124–129. [Google Scholar] [CrossRef]
  27. Alves, M.P.; Guzylack-Piriou, L.; Juillard, V.; Audonnet, J.C.; Doel, T.; Dawson, H.; Golde, W.T.; Gerber, H.; Peduto, N.; McCullough, K.C.; et al. Innate immune defenses induced by CpG do not promote vaccine-induced protection against foot-and-mouth disease virus in pigs. Clin. Vaccine Immunol. 2009, 16, 1151–1157. [Google Scholar] [CrossRef] [PubMed]
  28. Spiegelhalter, D.J.; Best, N.G.; Carlin, B.P.; Van Der Linde, A. Bayesian measures of model complexity and fit. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 2002, 64, 583–639. [Google Scholar] [CrossRef]
  29. Zweig, M.H.; Campbell, G. Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clin. Chem. 1993, 39, 561–577. [Google Scholar] [CrossRef]
  30. Jamal, S.M.; Bouma, A.; van den Broek, J.; Stegeman, A.; Chenard, G.; Dekker, A. Foot-and-mouth disease vaccine potency testing: The influence of serotype, type of adjuvant, valency, fractionation method, and virus culture on the dose-response curve in cattle. Vaccine 2008, 26, 6317–6321. [Google Scholar] [CrossRef]
  31. Salt, J.S.; Barnett, P.V.; Dani, P.; Williams, L. Emergency vaccination of pigs against foot-and-mouth disease: Protection against disease and reduction in contact transmission. Vaccine 1998, 16, 746–754. [Google Scholar] [CrossRef]
  32. Francis, M.J.; Black, L. Antibody response in pig nasal fluid and serum following foot-and-mouth disease infection or vaccination. J. Hyg. 1983, 91, 329–334. [Google Scholar] [CrossRef]
  33. Park, J.N.; Lee, S.Y.; Chu, J.Q.; Lee, Y.J.; Kim, R.H.; Lee, K.N.; Kim, S.M.; Tark, D.S.; Kim, B.; Park, J.H. Protection to homologous and heterologous challenge in pigs immunized with vaccine against foot-and-mouth disease type O caused an epidemic in East Asia during 2010/2011. Vaccine 2014, 32, 1882–1889. [Google Scholar] [CrossRef]
  34. Eble, P.L.; Bouma, A.; de Bruin, M.G.; van Hemert-Kluitenberg, F.; van Oirschot, J.T.; Dekker, A. Vaccination of pigs two weeks before infection significantly reduces transmission of foot-and-mouth disease virus. Vaccine 2004, 22, 1372–1378. [Google Scholar] [CrossRef]
  35. Li, Y.; Stirling, C.M.; Denyer, M.S.; Hamblin, P.; Hutchings, G.; Takamatsu, H.H.; Barnett, P.V. Dramatic improvement in FMD DNA vaccine efficacy and cross-serotype antibody induction in pigs following a protein boost. Vaccine 2008, 26, 2647–2656. [Google Scholar] [CrossRef]
  36. Stenfeldt, C.; Pacheco, J.M.; Rodriguez, L.L.; Arzt, J. Infection dynamics of foot-and-mouth disease virus in pigs using two novel simulated-natural inoculation methods. Res. Vet. Sci. 2014, 96, 396–405. [Google Scholar] [CrossRef]
  37. Kim, T.; Hong, J.K.; Oem, J.K.; Lee, K.N.; Lee, H.S.; Kim, Y.J.; Ryoo, S.; Ko, Y.J.; Park, J.H.; Choi, J.; et al. Cross-protective efficacy of the O1 Manisa+O 3039 bivalent vaccine and the O 3039 monovalent vaccine against heterologous challenge with FMDV O/Jincheon/SKR/2014 in pig. Vaccine 2019, 37, 1702–1709. [Google Scholar] [CrossRef]
  38. Choi, J.; Jo, H.J.; Jung, S.S.; Choi, J.; Lee, S.H.; Kim, H.H.; Kim, Y.J.; Kim, B.; Park, J.H.; Kim, J. Evaluation of swine protection with foot-and-mouth disease O(1)/Campos and O/Primorsky/2014 vaccines against the O Mya-98 lineage virus from East Asia. Vaccine 2021, 39, 1701–1707. [Google Scholar] [CrossRef]
  39. Burrows, R. The infectivity assay of foot-and-mouth disease virus in pigs. J. Hyg. 1966, 64, 419–429. [Google Scholar] [CrossRef]
  40. Stenfeldt, C.; Diaz-San Segundo, F.; de Los Santos, T.; Rodriguez, L.L.; Arzt, J. The Pathogenesis of Foot-and-Mouth Disease in Pigs. Front. Vet. Sci. 2016, 3, 41. [Google Scholar] [CrossRef]
  41. Pacheco, J.M.; Tucker, M.; Hartwig, E.; Bishop, E.; Arzt, J.; Rodriguez, L.L. Direct contact transmission of three different foot-and-mouth disease virus strains in swine demonstrates important strain-specific differences. Vet. J. 2012, 193, 456–463. [Google Scholar] [CrossRef]
  42. Stenfeldt, C.; Pacheco, J.M.; Rodriguez, L.L.; Arzt, J. Early events in the pathogenesis of foot-and-mouth disease in pigs; identification of oropharyngeal tonsils as sites of primary and sustained viral replication. PLoS ONE 2014, 9, e106859. [Google Scholar] [CrossRef]
  43. Nishi, T.; Morioka, K.; Kawaguchi, R.; Yamada, M.; Ikezawa, M.; Fukai, K. Quantitative analysis of infection dynamics of foot-and-mouth disease virus strain O/CATHAY in pigs and cattle. PLoS ONE 2021, 16, e0245781. [Google Scholar] [CrossRef] [PubMed]
  44. Pacheco, J.M.; Mason, P.W. Evaluation of infectivity and transmission of different Asian foot-and-mouth disease viruses in swine. J. Vet. Sci. 2010, 11, 133–142. [Google Scholar] [CrossRef] [PubMed]
  45. Zheng, H.; Lian, K.; Yang, F.; Jin, Y.; Zhu, Z.; Guo, J.; Cao, W.; Liu, H.; He, J.; Zhang, K.; et al. Cross-protective efficacy of engineering serotype A foot-and-mouth disease virus vaccine against the two pandemic strains in swine. Vaccine 2015, 33, 5772–5778. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Observed protection rates based on levels of log10 virus neutralized test (VNT) titers following the challenge in the vaccine-challenge studies. (A) The protection rate is depicted by a relationship with the VNT titer at 21 dpv, and (B) the protection rate is described according to each VNT titer at 28 dpv. The vaccine and challenge strains in each study are indicated as hyphenated words at the top of each plot. Each bar represents a group of animals sharing the indicated titer ±0.15 (reciprocal log10). The numbers of animals with each titer level are indicated at the top of each bar. Gray part of bars, protected; black part of bars, not protected.
Figure 1. Observed protection rates based on levels of log10 virus neutralized test (VNT) titers following the challenge in the vaccine-challenge studies. (A) The protection rate is depicted by a relationship with the VNT titer at 21 dpv, and (B) the protection rate is described according to each VNT titer at 28 dpv. The vaccine and challenge strains in each study are indicated as hyphenated words at the top of each plot. Each bar represents a group of animals sharing the indicated titer ±0.15 (reciprocal log10). The numbers of animals with each titer level are indicated at the top of each bar. Gray part of bars, protected; black part of bars, not protected.
Vaccines 12 00010 g001
Figure 2. Estimated probability of protection for virus neutralization tests (VNT) against the challenge strains. (A) The plots of the probability of protection are depicted according to each VNT titer at 21 dpv, and (B) the plots of probability of protection are depicted according to each VNT titer at 28 dpv. Color indicates individual groups: three groups in 21-dpv models, group 21D-1 (blue), group 21D-2 (green), and group 21D-3 (gray); two groups in 28-dpv models, group 28D-1 (red), and group 28D-2 (purple).
Figure 2. Estimated probability of protection for virus neutralization tests (VNT) against the challenge strains. (A) The plots of the probability of protection are depicted according to each VNT titer at 21 dpv, and (B) the plots of probability of protection are depicted according to each VNT titer at 28 dpv. Color indicates individual groups: three groups in 21-dpv models, group 21D-1 (blue), group 21D-2 (green), and group 21D-3 (gray); two groups in 28-dpv models, group 28D-1 (red), and group 28D-2 (purple).
Vaccines 12 00010 g002
Figure 3. Logistic models of the probability of protection following the challenge for the log10 VNT titer. The plot shows the posterior median for the probability of protection for group 21D-1, group 21D-2, and group 21D-3 in the 21-dpv model, and group 28D-1 and 28D-2 in the 28-dpv model.
Figure 3. Logistic models of the probability of protection following the challenge for the log10 VNT titer. The plot shows the posterior median for the probability of protection for group 21D-1, group 21D-2, and group 21D-3 in the 21-dpv model, and group 28D-1 and 28D-2 in the 28-dpv model.
Vaccines 12 00010 g003
Figure 4. The ROC curves for the diagnostic performance of the indirect FMD vaccine potency test based on the VNT logistic regression models. (A) The plots of the ROC curves are depicted for different groups in the 21 dpv model, and (B) the plots of the ROC curves are depicted for different groups in the 28 dpv model. The AUC (area under the curve) of each model is indicated with a 95% confidence interval over the x-axis of each plot.
Figure 4. The ROC curves for the diagnostic performance of the indirect FMD vaccine potency test based on the VNT logistic regression models. (A) The plots of the ROC curves are depicted for different groups in the 21 dpv model, and (B) the plots of the ROC curves are depicted for different groups in the 28 dpv model. The AUC (area under the curve) of each model is indicated with a 95% confidence interval over the x-axis of each plot.
Vaccines 12 00010 g004
Table 1. Summary of the serological mean VNT titers against the challenge strains in animals and the protection status used in the vaccination and challenge tests.
Table 1. Summary of the serological mean VNT titers against the challenge strains in animals and the protection status used in the vaccination and challenge tests.
SerotypeVaccine StrainChallenge StrainNo. of Challenged AnimalsNo. of Protected AnimalsVNT Titer ± SD 1 (log 10)
21 dpv 228 dpv4 dpc 37 dpc
OO/JincheonO/Jincheon2990.96 ± 0.48 10.78 ± 0.741.59 ± 0.392.44 ± 0.22
O/PrimorskyO/Jincheon67491.42 ± 0.621.30 ± 0.501.53 ± 0.402.15 ± 0.42
AA/YeoncheonA/Yeoncheon1540.33 ± 0.690.48 ± 0.860.74 ± 0.952.63 ± 0.57
A/PocheonA/Yeoncheon54350.88 ± 0.901.17 ± 1.021.78 ± 0.782.24 ± 0.48
Asia-1Asia-1/ShamirAsia-1/Shamir74541.26 ± 0.811.39 ± 0.861.72 ± 0.592.16 ± 0.27
1 Mean VNT titer ± standard deviation; 2 days post vaccination; 3 days post challenge.
Table 2. Estimated VNT titers (log10) according to the probability of protection at which vaccinated pigs are protected against the challenge with FMDV.
Table 2. Estimated VNT titers (log10) according to the probability of protection at which vaccinated pigs are protected against the challenge with FMDV.
ModelGroupProbability of Protection
0.500.6250.750.850.95
21-dpv21D-11.33
(1.09–1.56) 1
1.46
(1.23–1.72)
1.62
(1.38–1.92)
1.78
(1.54–2.14)
2.10
(1.82–2.60)
21D-21.06
(0.93–1.20)
1.19
(1.06–1.33)
1.35
(1.22–1.51)
1.52
(1.37–1.69)
1.83
(1.66–2.13)
21D-30.78
(0.59–0.97)
0.91
(0.73–1.12)
1.06
(0.88–1.29)
1.23
(1.04–1.53)
1.55
(1.32–1.94)
28-dpv28D-11.36
(1.12–1.59)
1.49
(1.26–1.75)
1.64
(1.41–1.94)
1.81
(1.57–2.17)
2.12
(1.85–2.60)
28D-20.97
(0.87–1.09)
1.10
(0.99–1.22)
1.26
(1.15–1.39)
1.42
(1.30–1.58)
1.74
(1.57–2.00)
1 Estimated log10 VNT titer (95% CI).
Table 3. The predicted cutoff of VNT titer (log10) determined using ROC analysis and following overall performance in each logistic model.
Table 3. The predicted cutoff of VNT titer (log10) determined using ROC analysis and following overall performance in each logistic model.
ModelGroupVNT Titer CutoffProbability of Protection
(95% CI 1)
Sens. (%)Spec. (%)ACC (%)
21-dpv21D-11.270.45 (0.24–0.65)55.6100.086.2
21D-21.430.80 (0.71–0.88)76.389.180.6
21D-30.750.48 (0.30–0.65)80.094.785.2
28-dpv28D-11.270.42 (0.22–0.63)84.693.590.9
28D-20.970.50 (0.39–0.61)92.073.786.7
1 95% confidence interval; Sens.: sensitivity = true positive rate; Spec.: specificity = 1 − false negative rate; ACC: accuracy of predictions.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, J.; Lee, S.H.; Kim, H.-H.; Shin, S.-H.; Park, S.-H.; Park, J.-H.; Park, C.-K. An Alternative Serological Measure for Assessing Foot-and-Mouth Disease Vaccine Efficacy against Homologous and Heterologous Viral Challenges in Pigs. Vaccines 2024, 12, 10. https://doi.org/10.3390/vaccines12010010

AMA Style

Kim J, Lee SH, Kim H-H, Shin S-H, Park S-H, Park J-H, Park C-K. An Alternative Serological Measure for Assessing Foot-and-Mouth Disease Vaccine Efficacy against Homologous and Heterologous Viral Challenges in Pigs. Vaccines. 2024; 12(1):10. https://doi.org/10.3390/vaccines12010010

Chicago/Turabian Style

Kim, Jaejo, Seung Heon Lee, Ha-Hyun Kim, Sung-Ho Shin, Sang-Hyun Park, Jong-Hyeon Park, and Choi-Kyu Park. 2024. "An Alternative Serological Measure for Assessing Foot-and-Mouth Disease Vaccine Efficacy against Homologous and Heterologous Viral Challenges in Pigs" Vaccines 12, no. 1: 10. https://doi.org/10.3390/vaccines12010010

APA Style

Kim, J., Lee, S. H., Kim, H. -H., Shin, S. -H., Park, S. -H., Park, J. -H., & Park, C. -K. (2024). An Alternative Serological Measure for Assessing Foot-and-Mouth Disease Vaccine Efficacy against Homologous and Heterologous Viral Challenges in Pigs. Vaccines, 12(1), 10. https://doi.org/10.3390/vaccines12010010

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop