Next Article in Journal
Active Human and Porcine Serum Induce Competence for Genetic Transformation in the Emerging Zoonotic Pathogen Streptococcus suis
Previous Article in Journal
In Vitro and In Planta Studies on Temperature Adaptation of Exserohilum turcicum Isolates from Maize in Europe and South America
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Air Passenger Travel and International Surveillance Data Predict Spatiotemporal Variation in Measles Importations to the United States

1
Department of Biological Sciences and Eck Institute for Global Health, University of Notre Dame, Notre Dame, IN 46556, USA
2
Department of Zoology, University of Oxford, Oxford OX1 3SY, UK
3
Li Ka Shing Knowledge Institute, St. Michael’s Hospital, Toronto, ON M5B 1T8, Canada
4
BlueDot, Toronto, ON M5J 1A7, Canada
5
Department of Medicine, University of Toronto, Toronto, ON M5S 3H2, Canada
*
Authors to whom correspondence should be addressed.
Pathogens 2021, 10(2), 155; https://doi.org/10.3390/pathogens10020155
Submission received: 31 December 2020 / Revised: 30 January 2021 / Accepted: 30 January 2021 / Published: 3 February 2021
(This article belongs to the Section Viral Pathogens)

Abstract

:
Measles incidence in the United States has grown dramatically, as vaccination rates are declining and transmission internationally is on the rise. Because imported cases are necessary drivers of outbreaks in non-endemic settings, predicting measles outbreaks in the US depends on predicting imported cases. To assess the predictability of imported measles cases, we performed a regression of imported measles cases in the US against an inflow variable that combines air travel data with international measles surveillance data. To understand the contribution of each data type to these predictions, we repeated the regression analysis with alternative versions of the inflow variable that replaced each data type with averaged values and with versions of the inflow variable that used modeled inputs. We assessed the performance of these regression models using correlation, coverage probability, and area under the curve statistics, including with resampling and cross-validation. Our regression model had good predictive ability with respect to the presence or absence of imported cases in a given state in a given year (area under the curve of the receiver operating characteristic curve (AUC) = 0.78) and the magnitude of imported cases (Pearson correlation = 0.84). By comparing alternative versions of the inflow variable averaging over different inputs, we found that both air travel data and international surveillance data contribute to the model’s ability to predict numbers of imported cases and individually contribute to its ability to predict the presence or absence of imported cases. Predicted sources of imported measles cases varied considerably across years and US states, depending on which countries had high measles activity in a given year. Our results emphasize the importance of the relationship between global connectedness and the spread of measles. This study provides a framework for predicting and understanding imported case dynamics that could inform future studies and outbreak prevention efforts.

1. Introduction

Despite the elimination of endemic measles in the United States in the 1990s, the number of measles cases and outbreaks has begun to rise in recent years, as measles–mumps–rubella (MMR) vaccination rates in the US are declining and transmission internationally is on the rise [1]. Measles virus is highly infectious and can cause serious symptoms and even death, and cases imported to the US can result in outbreaks that harm vulnerable populations, particularly now as herd immunity wanes under the influence of anti-vaccine sentiment [2]. Recent outbreaks have required significant public health responses and have led to stricter vaccination policies in some states [3].
Measles outbreaks often occur when infectious individuals enter into largely unvaccinated populations. This was the case in the 2019 New York outbreak, where several infected travelers carried measles into orthodox Jewish neighborhoods with low school immunization rates, resulting in hundreds of epidemiologically linked cases [4]. Even a single infected traveler can spark a significant outbreak—a recent 71-case outbreak near Portland, Oregon was the result of a single international importation into an area with vaccination rates significantly lower than those required to maintain herd immunity [3,5]. Travelers such as these, carrying the measles virus internationally, pose a risk to susceptible individuals both while in transit and at their final destination and are often the primary drivers of measles dynamics in non-endemic countries [6].
Many studies have acknowledged the importance of importation in both pre- and post-elimination era US measles outbreaks [7,8]. Imported cases are the result of measles transmission outside of the US, regardless of an infected individual’s nationality, and are inevitable while endemic measles remains present in many parts of the world [9]. Ultimately, these importations are driven by a combination of incidence in source countries and international travel patterns, suggesting that importation into the US will continue until elimination is achieved globally [10].
Patterns of imported cases have been modeled for many other diseases, including MERS, chikungunya, dengue, Zika, Ebola, Lassa fever, and COVID-19, and have focused on the relationship between air travel and importation risk [11,12,13,14,15,16,17,18]. A previous implementation of travel-driven measles importation into New Zealand used travel data and global measles incidence data to determine age-specific importation risk with a generalized linear model [19]. While existing studies have explored the relationship between international measles incidence, travel, and indices of importation risk, an understanding of how this relationship translates into actual imported case count predictions remains an outstanding question.
In this study, we leveraged publicly available data from the World Health Organization (WHO) and the US Centers for Disease Control and Transmission (CDC) as well as proprietary flight data to fit a single-parameter regression model across the years 2011–2016. We used this model to make geographically specific predictions about the volume and likely origins of imported measles cases into the US and incorporated reported imported cases that made validation of our predictions possible.
Analysis of averaged values as modeled inputs allowed us to isolate the influence of passenger volume and international measles incidence on predictive performance; we additionally considered a null scenario in which state populations were substituted as input to the model. The inclusion of a variety of data types in this framework allowed us to model and explain spatial and temporal variation in measles importation patterns in the US. Further exploration of potential origins of imported measles cases made it possible to consider the utility of predictive modeling techniques to targeted disease surveillance and mitigation efforts.

2. Results

2.1. Inflow Variable Informed by Air Travel and International Surveillance Data

We found that the inflow variable with full detail about air travel data and international surveillance data was associated with a high correlation between predicted and observed imported cases (0.84), which increased slightly when state-year combinations with zero imported cases were omitted (0.85) (Table 1). Likewise, we found that the 95% prediction interval of this inflow variable had a coverage probability of 95%, with data falling outside the prediction interval limited to state-year combinations with six or fewer imported cases (Figure 1A). With respect to predicting the presence of imported cases in a given state and year, the inflow variable with full detail had an area under the curve of the receiver operating characteristic curve (AUC) of 0.78. A similar AUC of 0.78 ± 0.06 (SD) was obtained through repetitive resampling and cross-validation, suggesting that predictions of the presence of imported cases were significantly better than at random (Table 2, Supplementary Figure S1).
For reference, a model based on state population alone had a correlation of 0.66 and an AUC of 0.58 when fitted to the full data set (Table 1), and similar values in cross-validation (Table 2). Thus, while there was some predictive value associated with inflow based on state population alone, the addition of air travel and international surveillance data to the inflow variable resulted in a marked improvement in the ability to predict the presence and number of imported cases across states and years.

2.2. Comparison with Averaged Inflow Variables

For the inflow variables that averaged over either air travel or international surveillance data, correlation was the statistic for which there was the greatest difference with the inflow variable with full detail. For both of these averaged inflow variables, correlation dropped from 0.84 to 0.76 (Table 1). This tendency held in cross-validation as well, with correlation dropping from 0.78 in the case of the inflow variable with full detail to 0.71 ± 0.2 for the averaged inflow variables (Table 2). In contrast, values of AUC associated with all three of these inflow variables were very similar (Table 1), including in cross-validation (Table 2). In terms of coverage of the prediction interval, the inflow variable with full detail captured 7/7 state-year combinations with seven or more imported cases (Figure 1A), and inflow variables that averaged over one or the other data type both accounted for 6/7 (Figure 1B,C). Thus, in some respects, there was a decrease in predictive performance when one data type was averaged, but retaining either data type still enabled reasonably good prediction of imported cases based on inflow.

2.3. Comparison with Modeled Inflow Variables

Relative to the inflow variable with full detail, the inflow variable that used modeled international surveillance showed a drop in predictive performance. Its overall correlation was 0.77, its AUC was 0.79, and similar values were obtained in cross-validation (Table 1 and Table 2). Like the inflow variable with full detail, however, its prediction interval covered most observations (95%), including those in which the highest numbers of imported cases were observed (Figure 1). Overall, predictions of imported cases based on modeled values of international surveillance performed similar to predictions based on the inflow variable with averaged values of raw international surveillance data, suggesting that the steps taken in generating modeled values negatively impacted the predictive value of international surveillance for the purpose of predicting imported cases.
The inflow variable with modeled flight data performed worst among all the inflow variables that we evaluated. Its AUC was lower than all inflow variables except the null based on state population alone, and its overall correlation was lower than even that null inflow variable (Table 1 and Table 2). Moreover, a much larger proportion of observations (18%) fell outside its 95% prediction interval than under other inflow variables (Figure 1). Overall, predictions of imported cases based on modeled values of air travel were poor, and state population alone may offer an easier and more robust prediction of imported measles cases.

2.4. Predicting Measles Origin and Magnitude

Using the inflow variable with full detail, we explored patterns in the predicted magnitude and potential origins of each state’s imported cases from 2011 to 2016 (Figure 2). The expected number of imported cases was generally highest in the most populous states – notably, California, New York/New Jersey, Texas, Florida, and Illinois. In particular, California was predicted to have no fewer than 4.0 (95% prediction interval: 0–9) imported cases in a single year (2012) and as many as 17.0 (95% prediction interval: 8–29) (2014). Other than these six most populous states, most states were predicted to have fewer than two imported cases each year. This did vary by year, however, with one to three imported cases predicted for several states in 2011.
The estimated origins of imported cases also varied from year to year, and often correlated with trends in incidence in potential countries of origin (Figure 2). In 2011, imported cases were predicted to have been predominantly from France, which experienced a large outbreak that year [20]. In other years, other countries predominated—notably, the United Kingdom in 2012, the Philippines in 2014, and the Netherlands in 2016. In some cases, the predicted origins of imported measles cases varied among states. For example, in 2015 and 2016, a high proportion of the imported cases to Louisiana, Mississippi, and Texas were predicted to have originated in Equatorial Guinea, but much less so in other states. This resulted from a combination of high measles incidence in Equatorial Guinea in those years together with much higher levels of air travel between Equatorial Guinea and those states.

2.5. Association between Imported and Indigenous Measles Cases

Although our analysis focused on imported cases, we briefly explored the association between imported and indigenous cases to better understand the relevance of our analysis to measles outbreaks in the US. To do so, we calculated the Kendall rank correlation coefficient between imported and indigenous US measles cases combined across all years in 2011–2016 and found a moderately large correlation of 0.45 that was statistically significant (p < 2 × 10−16). While this suggests that local factors in the US, such as vaccination coverage, play an important role in determining the extent of indigenous measles cases in the US, so too do imported measles cases.

3. Discussion

Through regression of imported measles cases against multiple inflow variables, our analysis demonstrated the utility of air travel data and international surveillance data for predicting spatiotemporal variation in imported measles cases in the US. Cross-validation of these predictions verified their robustness, and comparison of predictions based on alternative inflow variables isolated the predictive value of alternative inputs for informing predictions of inflow. Inspection of our model’s predictions with respect to state, year, and likely country of origin showed that predictions of imported cases in a given state and year depended on the state’s population, the countries with which that state was linked via air travel, and contemporaneous measles activity in the countries with which it was most strongly linked.
A unique aspect of our analysis was the use of alternative inflow variables with different combinations of data inputs, which allowed us to isolate the effect of each data type on our predictions. Most of the inflow variables that we considered performed similarly well at predicting the presence or absence of imported measles cases. There was greater discrepancy, however, in how well the inflow variables predicted the numbers of imported measles cases across states and years. Because each regression that we performed involved estimation of only a single parameter, these differences can be directly attributed to the data inputs. Comparison of predictions based on the inflow variable with full detail and those based on inflow variables with averaged inputs showed that air travel data and international surveillance data contributed roughly equally to the success of the model’s predictions. In other words, each data type added some value on its own, but the two data types performed best when paired together.
Substituting either data input for a model-based alternative also reduced the quality of our predictions. In the case of modeled international surveillance, poorer performance could reflect that model-based revisions of measles burden work well for estimating burden within those countries [21] but less well for characterizing measles burden among the subset of the population likely to travel to the US [22,23]. In the case of modeled air travel, possible limitations include omission of airports below a certain size and the inability to pick up on idiosyncratic connections [24], such as the strong connection between Equatorial Guinea and states in the western Gulf Coast of the US—which could be related to the energy industry [25]—that emerged in our exploration of the possible country of origin of imported cases. In the era of COVID-19, air travel patterns are likely to continue to depart from historical trends [26,27], providing further impetus for working with non-modeled air travel data appropriate to the time frame of interest.
Previous studies have identified air travel as a major driver of the importation of measles and a variety of other infectious diseases and have found value in incorporating reported imported case data [12,13,19]. By isolating air travel and incidence in model inputs, we were able to additionally explore the influence of each on measles importation events, as well as leverage reported imported measles data to strengthen our approach via cross-validation. Reported imported case data also allowed us to make and validate predictions regarding specific case counts. As a result, we developed a more detailed picture of imported measles dynamics in the US than might be possible without reported case data and facilitated an understanding of its drivers that might help to inform mitigation strategies and interventions such as targeted travel screenings.
Although our analysis yielded predictions that appear to explain a moderate degree of variation in imported measles cases across states and years, there are limitations of our analysis that should be acknowledged. First, our travel data were limited to air passenger travel data only and did not include potential instances of importation by land or water. Measles outbreaks on cruise ships could be one overlooked source of importation [28,29]. This data constraint also affects which potential importers can be accounted for, as international air travel is expensive. To the extent that individuals with reduced access to vaccines are less likely to travel internationally, the usefulness of measles incidence data for predicting imported cases could be limited. Second, the quality of the international measles data used is limited by the strength of reporting countries’ surveillance programs. Countries with poorer vaccination programs and more measles cases tend to have weaker surveillance systems, leading to underreporting. Though these countries are not necessarily highly connected to the US via air travel, such underreporting could nonetheless be present in model inputs. Third, our analysis was limited to imported case data that the CDC has made publicly available. Lack of data with which to validate estimates of country of origin limited our ability to draw conclusions about a causal relationship between model inputs and predicted case origins. Another study [30] was able to make use of more detailed information about imported case origin and month of detection held internally by the US CDC, which enabled monthly predictions of imported case magnitude and origin that we were unable to produce. Although it would be ideal to perform our analysis and share results in real time, the data necessary to implement such an analysis are not readily available. Other recent studies have overcome this obstacle by leveraging historical surveillance data, along with air travel data and vaccination exemption rates, to generate predictions of measles outbreak risk in the US [31].
Although we observed a strong association between model predictions and imported cases, other factors might be influencing these patterns, leading to unexplained variation and/or mis-attributed explained variation. The performance of our population only inflow scenario suggests that population plays a role in imported case dynamics, and it is likely that air traffic routes also drive international measles incidence patterns in some way. International vaccination efforts, not considered in this study, are another potential confounding factor present in the data; supplemental measles immunization programs have produced drastic reductions in measles burden around the world [32]. Though we did not explicitly control for alternative potential drivers of international measles transmission dynamics, we have attempted to limit the influence of domestic confounding factors by restricting our analysis to imported cases in the US.
At a time when measles cases are on the rise, the capability to predict the origin and magnitude of imported cases is a worthwhile endeavor that could potentially inform surveillance and prevention strategies. Although our models cannot determine the exact provenance of measles cases, the framework developed here provides a mechanism for explaining broader variation in patterns of imported measles cases in the US that could be validated with alternative data, such as sequence analysis. Given that the US CDC’s measles case definition states that “any case that cannot be proven as imported should be classified as indigenous” [9], some imported cases may be misclassified as indigenous. The capability that we advance here to generate quantitative predictions of imported cases could be useful in analyses that seek to more carefully disentangle importation and local transmission. The relationship between importation and local transmission can be complicated [33], and much remains to be understood about the interplay between measles importation patterns and local drivers of local measles outbreaks. Predictive models of imported cases such as ours stand to play an important role in better understanding these dynamics.

4. Materials and Methods

4.1. Data

The CDC in the United States publishes annual reports of notifiable disease cases, including state-level case counts for both imported and indigenous measles [34,35]. The CDC defines an imported case as one with a source outside the state, while an indigenous case must be unrelated to an imported case or occur more than two generations after a linked imported case [9]. Though the former definition allows for both international and out-of-state origin cases to be designated as imported, there was insufficient detail present in the data to separate the two. Because the majority of recent reported measles outbreaks in the US have been specifically associated with international importation events, we made the simplifying assumption that all imported cases had an international origin [36,37]. As such, we included all reported imported and reported indigenous measles cases from 2011 to 2016 in this study.
The WHO provides open access to monthly surveillance reports for measles in member nations [38]. We aggregated these data on an annual basis and used them in conjunction with United Nations (UN) annual population estimates to calculate yearly per capita measles incidence for member nations [39]. We also considered an alternative set of assumptions about international surveillance data that seek to correct for differential underreporting by country based on modeling [40,41,42,43,44], though data are available only by region beginning in 2013.
We obtained air passenger data from the International Air Transport Association (IATA) detailing monthly total passenger loads for flights from foreign countries to US states for the years 2011–2016 [45]. We additionally considered an alternative set of assumptions about air passenger travel data based on open-access model predictions, to permit sharing of runnable code [24].

4.2. Model Description

For each year of the study, 2011–2016, we calculated an inflow variable representative of the movement of measles into a state, with New York and New Jersey combined due to their airports being shared extensively. We included all countries for which flight and incidence data were present, for a total of 189 countries and 49 states as well as Washington, D.C. Each state- and year-specific inflow was a summation of the per capita incidence in a country multiplied by the flux—i.e., the number of air passengers from that country to a given state—for all countries to that state in a given year, or
inflow j , y = i flux ij   ×   incidence i
for all countries i connected to state j in year y. We performed a Poisson regression of imported measles cases, I, against this inflow variable such that
I j , y   ~   Poisson ( λ   ×   inflow j , y ) ,
across all states j and years y. Across all states and years, this implied that the likelihood of λ was
likelihood ( λ ) = j , y λ I j , y e - λ I j , y ! ,
which we used to estimate the value of λ by maximum likelihood using the optimize function in R [46].

4.3. Analyses

To evaluate model performance, we used Pearson correlation, coverage probability of the 95% prediction interval, and area under the curve of the receiver operating characteristic curve (AUC). Correlation and coverage probability allowed us to assess the model’s ability to account for variation in case numbers, whereas AUC allowed us to measure the model’s performance as a classifier of whether states experienced imported cases in a given year. We used the pROC package to compare and analyze ROC curves [47]. To quantify uncertainty for correlation and AUC, we sampled random subsets of 80% of the data 5000 times, repeated the regression analysis, and recalculated these statistics based on the model’s predictions of the remaining 20% of the data. Resampling was conducted on the inflow variables for all state–year combinations considered in the study. This also served as a form of cross-validation, given that it quantified model performance on data withheld from model fitting.

4.4. Alternative Inflow Variables

To evaluate the contribution each data type made to predictive performance, we repeated the regression analysis using modified inflow variables that replaced each of the two data types with averaged values. The averaged values of international incidence were defined as average annual incidence weighted by total outgoing passenger counts, or
inflow j , y   =   i flux ij   ×   ( i incidence i   ×   j flux ij i j flux ij ) y ,
such that the inflow variable for state j and year y was a summation of the product of each country–state flux and a single average incidence value for year y. The averaged passenger flow values were defined as the product of the total number of passengers into state j and the proportion of passengers from country i to all US states, for year y,
inflow j , y   =   i ( i flux ij   ×   j flux ij i j flux ij   ×   incidence i ) .
We also considered a null inflow value in which inflow was replaced by state population, or
inflow j , y   =   population j , y
[48]. Each alternative inflow variable was applied to Equation (2). This resulted in a total of six inflow scenarios, each a unique combination of flux and incidence data inputs (Table 3).

Supplementary Materials

The following are available online at https://www.mdpi.com/2076-0817/10/2/155/s1, Figure S1: Histograms of partial fit model statistics.

Author Contributions

Conceptualization, T.A.P.; methodology, M.L.P., M.U.G.K. and T.A.P.; software, M.L.P.; validation, M.L.P.; formal analysis, M.L.P.; investigation, M.L.P.; resources, A.W. and K.K.; data curation, A.W. and M.L.P.; writing—original draft preparation, M.L.P. and T.A.P.; writing—review and editing, M.U.G.K., A.W. and K.K.; visualization, M.L.P.; supervision, T.A.P.; project administration, M.L.P.; funding acquisition, M.L.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The publicly available datasets used in this study are cited throughout.

Acknowledgments

M.L.P. was supported by a Summer Undergraduate Research Fellowship and a Richard and Peggy Notebaert Premier Fellowship from the University of Notre Dame. We thank Matthew Ferrari and Minal Patel for feedback on this work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gastañaduy, P.A.; Paul, P.; Fiebelkorn, A.P.; Redd, S.B.; Lopman, B.A.; Gambhir, M.; Wallace, G.S. Assessment of the Status of Measles Elimination in the United States, 2001–2014. Am. J. Epidemiol. 2017, 185, 562–569. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Papania, M.J.; Wallace, G.S.; Rota, P.A.; Icenogle, J.P.; Fiebelkorn, A.P.; Armstrong, G.L.; Reef, S.E.; Redd, S.B.; Abernathy, E.S.; Barskey, A.E.; et al. Elimination of Endemic Measles, Rubella, and Congenital Rubella Syndrome from the Western Hemisphere: The US Experience. JAMA Pediatr. 2014, 168, 148–155. [Google Scholar] [CrossRef] [PubMed]
  3. Otterman, S. Get Vaccinated or Leave School: 26,000 N.Y. Children Face a Choice; The New York Times Company: New York, NY, USA, 2019. [Google Scholar]
  4. McDonald, R.; Ruppert, P.S.; Souto, M. Notes from the Field: Measles Outbreaks from Imported Cases in Orthodox Jewish Communities—New York and New Jersey, 2018–2019. MMWR Morb. Mortal. Wkly. Rep. 2019, 68, 444. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Measles Investigation. Clark County Public Health, 2019. Available online: https://clark.wa.gov/public-health/measles-investigation (accessed on 10 December 2020).
  6. Grobusch, M.P.; Rodriguez-Morales, A.J.; Wilson, M.E. Measles on the Move. Travel Med. Infect. Dis. 2017, 1–2. [Google Scholar] [CrossRef] [PubMed]
  7. Lee, A.D.; Clemmons, N.S.; Patel, M.; Gastañaduy, P.A. International Importations of Measles Virus into the United States During the Postelimination Era, 2001–2016. J. Infect. Dis. 2019, 219, 1616–1623. [Google Scholar] [CrossRef] [PubMed]
  8. Oster, N.V.; Harpaz, R.; Redd, S.B.; Papania, M.J. International Importations of Measles Virus-United States, 1993–2001. J. Infect. Dis. 2004, 189, 48–53. [Google Scholar]
  9. Classification of Measles Cases and Categorization of Measles Elimination Programs. Morb. Mortal. Wkly. Rep. 1983, 31, 707–711.
  10. Fiebelkorn, A.P.; Redd, S.B.; Gallagher, K.; Rota, P.A.; Rota, J.; Bellini, W.; Seward, J. Measles in the United States during the Postelimination Era. J. Infect. Dis. 2010, 202, 1520–1528. [Google Scholar] [CrossRef]
  11. Nah, K.; Otsuki, S.; Chowell, G.; Nishiura, H. Predicting the International Spread of Middle East Respiratory Syndrome (MERS). BMC Infect. Dis. 2016, 16, 356. [Google Scholar] [CrossRef] [Green Version]
  12. Findlater, A.; Moineddin, R.; Kain, D.; Yang, J.; Wang, X.; Lai, S.; Khan, K.; Bogoch, I.I. The Use of Air Travel Data for Predicting Dengue Importation to China: A Modelling Study. Travel Med. Infect. Dis. 2019, 101446. [Google Scholar] [CrossRef]
  13. Khan, K.; Bogoch, I.; Brownstein, J.S.; Miniota, J.; Nicolucci, A.; Hu, W.; Nsoesie, E.O.; Cetron, M.; Creatore, M.I.; German, M.; et al. Assessing the Origin of and Potential for International Spread of Chikungunya Virus from the Caribbean. PLoS Curr. 2014. [Google Scholar] [CrossRef] [PubMed]
  14. Huang, X.; Hu, W.; Yakob, L.; Devine, G.J.; McGraw, E.A.; Jansen, C.C.; Faddy, H.M.; Frentiu, F.D. El Niño Southern Oscillation, Overseas Arrivals and Imported Chikungunya Cases in Australia: A Time Series Analysis. PLoS Negl. Trop. Dis. 2019, 13, e0007376. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Candido, D.D.S.; Watts, A.; Abade, L.; Kraemer, M.U.G.; Pybus, O.G.; Croda, J.; de Oliveira, W.; Khan, K.; Sabino, E.C.; Faria, N.R. Routes for COVID-19 Importation in Brazil. J. Travel Med. 2020, 27. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Massad, E.; Tan, S.-H.; Khan, K.; Wilder-Smith, A. Estimated Zika Virus Importations to Europe by Travellers from Brazil. Glob. Health Action 2016, 9, 31669. [Google Scholar] [CrossRef]
  17. Tuite, A.R.; Watts, A.G.; Khan, K.; Bogoch, I.I. Ebola Virus Outbreak in North Kivu and Ituri Provinces, Democratic Republic of Congo, and the Potential for Further Transmission through Commercial Air Travel. J. Travel Med. 2019, 26. [Google Scholar] [CrossRef]
  18. Tuite, A.R.; Watts, A.G.; Kraemer, M.U.G.; Khan, K.; Bogoch, I.I. Potential for Seasonal Lassa Fever Case Exportation from Nigeria. Am. J. Trop. Med. Hyg. 2019, 100, 647–651. [Google Scholar] [CrossRef] [Green Version]
  19. Hayman, D.T.S.; Marshall, J.C.; French, N.P.; Carpenter, T.E.; Roberts, M.G.; Kiedrzynski, T. Global Importation and Population Risk Factors for Measles in New Zealand: A Case Study for Highly Immunized Populations. Epidemiol. Infect. 2017, 145, 1875–1885. [Google Scholar] [CrossRef] [Green Version]
  20. Huoi, C.; Casalegno, J.S.; Bénet, T.; Neuraz, A.; Billaud, G.; Eibach, D.; Mekki, Y.; Rudigoz, R.; Massardier, J.; Huissoud, C.; et al. A Report on the Large Measles Outbreak in Lyon, France, 2010 to 2011. Eurosurveillance 2012, 17, 20264. [Google Scholar] [CrossRef]
  21. Chen, S.; Fricks, J.; Ferrari, M.J. Tracking Measles Infection through Non-Linear State Space Models. J. R. Stat. Soc. Ser. C (Appl. Stat.) 2012, 61, 117–134. [Google Scholar] [CrossRef]
  22. Muscat, M. Who Gets Measles in Europe? J. Infect. Dis. 2011, 204, S353–S365. [Google Scholar] [CrossRef] [Green Version]
  23. Bednarczyk, R.A.; Rebolledo, P.A.; Omer, S.B. Assessment of the Role of International Travel and Unauthorized Immigration on Measles Importation to the United States. J. Travel Med. 2016, 23. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Mao, L.; Wu, X.; Huang, Z.; Tatem, A.J. Modeling Monthly Flows of Global Air Travel Passengers: An Open-Access Data Resources. J. Transp. Geogr. 2015, 48, 52–60. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Equatorial Guinea Operations. Available online: https://www.marathonoil.com/operations/eg/ (accessed on 16 September 2020).
  26. Full Article: Pandemics, Tourism and Global Change: A Rapid Assessment of COVID-19. Available online: https://www.tandfonline.com/doi/full/10.1080/09669582.2020.1758708 (accessed on 16 September 2020).
  27. Tuite, A.R.; Bhatia, D.; Moineddin, R.; Bogoch, I.I.; Watts, A.G.; Khan, K. Global Trends in Air Travel: Implications for Connectivity and Resilience to Infectious Disease Threats. J. Travel Med. 2020, 27. [Google Scholar] [CrossRef]
  28. Mitruka, K.; Felsen, C.B.; Tomianovic, D.; Inman, B.; Street, K.; Yambor, P.; Reef, S.E. Measles, Rubella, and Varicella Among the Crew of a Cruise Ship Sailing From Florida, United States, 2006. J. Travel Med. 2012, 19, 233–237. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Victor, D. Measles on Cruise Ship Leads to Quarantine in St. Lucia. The New York Times, 2019. [Google Scholar]
  30. Truelove, S.A.; Mier-y-Teran-Romero, L.; Gastanaduy, P.; Walker, A.T.; Berro, A.; Lessler, J.; Johansson, M. Epidemics, Air Travel, and Elimination in a Globalized World: The Case of Measles. medRxiv 2020. [Google Scholar] [CrossRef]
  31. Sarkar, S.; Zlojutro, A.; Khan, K.; Gardner, L. Measles Resurgence in the USA: How International Travel Compounds Vaccine Resistance. Lancet Infect. Dis. 2019, 19, 684–686. [Google Scholar] [CrossRef]
  32. Otten, M.; Kezaala, R.; Fall, A.; Masresha, B.; Martin, R.; Cairns, L.; Eggers, R.; Biellik, R.; Grabowsky, M.; Strebel, P.; et al. Public-Health Impact of Accelerated Measles Control in the WHO African Region 2000–2003. Lancet 2005, 366, 832–839. [Google Scholar] [CrossRef] [Green Version]
  33. Oidtman, R.J.; Lai, S.; Huang, Z.; Yang, J.; Siraj, A.S.; Reiner, R.C.; Tatem, A.J.; Perkins, T.A.; Yu, H. Inter-Annual Variation in Seasonal Dengue Epidemics Driven by Multiple Interacting Factors in Guangzhou, China. Nat. Commun. 2019, 10, 1–12. [Google Scholar] [CrossRef] [Green Version]
  34. Nationally Notifiable Infectious Diseases and Conditions, United States: Annual Tables; Centers for Disease Control and Prevention: Atlanta, GA, USA, 2018.
  35. Morbidity and Mortality Weekly Report: Summary of Notifiable Infectious Diseases; Centers for Disease Control and Prevention: Atlanta, GA, USA, 2018.
  36. Sanyaolu, A.; Okorie, C.; Marinkovic, A.; Ayodele, O.; Abbasi, A.F.; Prakash, S.; Gosse, J.; Younis, S.; Mangat, J.; Chan, H. Measles Outbreak in Unvaccinated and Partially Vaccinated Children and Adults in the United States and Canada (2018–2019): A Narrative Review of Cases. Inquiry 2019, 56. [Google Scholar] [CrossRef]
  37. Taylor, E.M.; Burke, H.; Zhou, W. Crossing Borders: One World, Global Health. Clin. Infect. Dis. 2012, 55, v–vi. [Google Scholar]
  38. World Health Organization Provisional Monthly Measles and Rubella Data. Available online: https://www.who.int/teams/immunization-vaccines-and-biologicals/immunization-analysis-and-insights/surveillance/monitoring/provisional-monthly-measles-and-rubella-data (accessed on 15 May 2019).
  39. United Nations Department of Economic and Social Affairs. World Population Prospects; United Nations Department of Economic and Social Affairs: New York, NY, USA, 2018. [Google Scholar]
  40. Simons, E.; Ferrari, M.; Fricks, J.; Wannemuehler, K.; Anand, A.; Burton, A.; Strebel, P. Assessment of the 2010 Global Measles Mortality Reduction Goal: Results from a Model of Surveillance Data. Lancet 2012, 379, 2173–2178. [Google Scholar] [CrossRef]
  41. Perry, R.T.; Gacic-Dobo, M.; Dabbagh, A.; Mulders, M.N.; Strebel, P.M.; Okwo-Bele, J.-M.; Rota, P.A.; Goodson, J.L. Progress Toward Regional Measles Elimination—Worldwide, 2000–2013. MMWR Morb. Mortal. Wkly. Rep. 2014, 63, 1034–1038. [Google Scholar] [PubMed]
  42. Perry, R.T.; Murray, J.S.; Gacic-Dobo, M.; Dabbagh, A.; Mulders, M.N.; Strebel, P.M.; Okwo-Bele, J.-M.; Rota, P.A.; Goodson, J.L. Progress Toward Regional Measles Elimination—Worldwide, 2000–2014. MMWR Morb. Mortal. Wkly. Rep. 2015, 64, 1246–1251. [Google Scholar] [CrossRef] [PubMed]
  43. Patel, M.K.; Gacic-Dobo, M.; Strebel, P.M.; Dabbagh, A.; Mulders, M.N.; Okwo-Bele, J.-M.; Dumolard, L.; Rota, P.A.; Kretsinger, K.; Goodson, J.L. Progress Toward Regional Measles Elimination—Worldwide, 2000–2015. MMWR Morb. Mortal. Wkly. Rep. 2016, 65, 1228–1233. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Dabbagh, A.; Patel, M.K.; Dumolard, L.; Gacic-Dobo, M.; Mulders, M.N.; Okwo-Bele, J.-M.; Kretsinger, K.; Papania, M.J.; Rota, P.A.; Goodson, J.L. Progress toward Regional Measles Elimination—Worldwide, 2000–2016. MMWR Morb. Mortal. Wkly. Rep. 2017, 66, 1148–1153. [Google Scholar] [CrossRef] [Green Version]
  45. International Air Transport Association. Montreal, QC, Canada, 2018. Available online: http://www.iata.org (accessed on 10 December 2020).
  46. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2019. [Google Scholar]
  47. Robin, X.; Turck, N.; Hainard, A.; Tiberti, N.; Lisacek, F.; Sanches, J.-C.; Müller, M. PROC: An Open-Source Package for R and S+ to Analyze and Compare ROC Curves. BMC Bioinform. 2011, 12, 77. [Google Scholar] [CrossRef]
  48. State Population Totals and Components of Change: 2010–2019; United States Census Bureau: Suitland, MD, USA, 2018.
Figure 1. Observed imported measles cases accounted for by the fitted models (A) with full detail, (B) with averaged incidence, (C) with averaged passengers, (D) with modeled incidence, (E) with modeled flight data, and (F) with population only. Black dots represent imported measles cases by state and year. The dark red band indicates the 95% confidence interval of the fitted relationship, while the light red band indicates the 95% prediction interval of the data.
Figure 1. Observed imported measles cases accounted for by the fitted models (A) with full detail, (B) with averaged incidence, (C) with averaged passengers, (D) with modeled incidence, (E) with modeled flight data, and (F) with population only. Black dots represent imported measles cases by state and year. The dark red band indicates the 95% confidence interval of the fitted relationship, while the light red band indicates the 95% prediction interval of the data.
Pathogens 10 00155 g001
Figure 2. Predicted origins and magnitudes of measles importations into US states 2011–2016. Pie chart coloring indicates likely country of origin, while state fill color denotes magnitude of importation. As previously noted, New Jersey is grouped with New York, while Delaware has no major airport and is therefore marked as “Other” throughout. Countries shown on the pie charts are Canada (CAN), China (CHN), Equatorial Guinea (GNQ), France (FRA), Germany (DEU), India (IND), Ireland (IRL), Italy (ITA), Mongolia (MNG), Netherlands (NLD), Nigeria (NGA), Philippines (PHL), Romania (ROU), Spain (ESP), Switzerland (CHE), Thailand (THA), Ukraine (UKR), United Kingdom (GBR), Vietnam (VNM), and Other (OTH), which encompasses all other countries that were infrequently predicted as the origins of measles importations.
Figure 2. Predicted origins and magnitudes of measles importations into US states 2011–2016. Pie chart coloring indicates likely country of origin, while state fill color denotes magnitude of importation. As previously noted, New Jersey is grouped with New York, while Delaware has no major airport and is therefore marked as “Other” throughout. Countries shown on the pie charts are Canada (CAN), China (CHN), Equatorial Guinea (GNQ), France (FRA), Germany (DEU), India (IND), Ireland (IRL), Italy (ITA), Mongolia (MNG), Netherlands (NLD), Nigeria (NGA), Philippines (PHL), Romania (ROU), Spain (ESP), Switzerland (CHE), Thailand (THA), Ukraine (UKR), United Kingdom (GBR), Vietnam (VNM), and Other (OTH), which encompasses all other countries that were infrequently predicted as the origins of measles importations.
Pathogens 10 00155 g002
Table 1. Summary statistics including the fitted parameter λ, correlation between observed and predicted imported cases, and area under the receiver operating characteristic curve.
Table 1. Summary statistics including the fitted parameter λ, correlation between observed and predicted imported cases, and area under the receiver operating characteristic curve.
Inflow VariableλCorrelationAUC 1
Full detail0.0410.840.78
Averaged incidence0.0410.760.79
Averaged air travel0.0410.760.79
Modeled incidence0.00220.770.79
Modeled flight data0.0120.610.67
Population only4.32 × 10−50.660.58
1 Area Under the ROC Curve.
Table 2. Cross-validated summary statistics with uncertainty, including the fitted parameter λ, correlation between observed and predicted imported cases, and area under the receiver operating characteristic curve (full distributions are shown in Supplementary Figure S1).
Table 2. Cross-validated summary statistics with uncertainty, including the fitted parameter λ, correlation between observed and predicted imported cases, and area under the receiver operating characteristic curve (full distributions are shown in Supplementary Figure S1).
Inflow VariableCross-Validated λ (Mean ± SD 1)Cross-Validated Correlation (Mean ± SD)Cross-Validated AUC (Mean ± SD)
Full detail0.041 ± 0.0020.78 ± 0.20.78 ± 0.06
Averaged incidence0.041 ± 0.0020.71 ± 0.20.79 ± 0.05
Averaged air travel0.041 ± 0.0020.76 ± 0.20.79 ± 0.05
Modeled incidence0.0022 ± 1 × 10−40.77 ± 0.20.79 ± 0.06
Modeled flight data0.012 ± 9.3 × 10−40.61 ± 0.30.67 ± 0.07
Population only4.32 × 10−50.66 ± 0.10.58 ± 0.03
1 Standard Deviation.
Table 3. Flux and incidence data inputs to Equation (1) for each inflow scenario.
Table 3. Flux and incidence data inputs to Equation (1) for each inflow scenario.
Inflow VariableFluxIncidence
Full detailComplete flight dataComplete incidence data
Averaged incidenceComplete flight dataAveraged incidence data
Averaged air travelAveraged flight dataComplete incidence data
Modeled incidenceComplete flight dataAlternative incidence data
Modeled flight dataAlternative flight dataComplete incidence data
Population onlyNo flight dataNo incidence data
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Poterek, M.L.; Kraemer, M.U.G.; Watts, A.; Khan, K.; Perkins, T.A. Air Passenger Travel and International Surveillance Data Predict Spatiotemporal Variation in Measles Importations to the United States. Pathogens 2021, 10, 155. https://doi.org/10.3390/pathogens10020155

AMA Style

Poterek ML, Kraemer MUG, Watts A, Khan K, Perkins TA. Air Passenger Travel and International Surveillance Data Predict Spatiotemporal Variation in Measles Importations to the United States. Pathogens. 2021; 10(2):155. https://doi.org/10.3390/pathogens10020155

Chicago/Turabian Style

Poterek, Marya L., Moritz U. G. Kraemer, Alexander Watts, Kamran Khan, and T. Alex Perkins. 2021. "Air Passenger Travel and International Surveillance Data Predict Spatiotemporal Variation in Measles Importations to the United States" Pathogens 10, no. 2: 155. https://doi.org/10.3390/pathogens10020155

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop