1. Introduction
Initially introduced to the United States in the 1500s, wild pigs (
Sus scrofa), also known as feral swine, wild swine, wild boar, or feral hogs [
1], are a successful invasive species [
2]. For this study, the collective term wild pig will be used [
1] unless it is appropriate to use one of the common names discussed above. Native to Europe, Asia, and Northern Africa [
3], wild pigs have been repeatedly introduced into the United States, with populations observed in at least 38 states [
4]. Further, high reproductive rates and generalist habitat use have led to transient population dynamics [
5] and highly variable geographic rates of population spread [
6,
7].
The literature on the economic damages caused by the spread of wild pigs is growing. In a survey of producers of six crops in 11 states, McKee et al. [
8] estimate that USD 203 million of crop production was lost in 2022. Using a survey of producers of additional crops across 12 states in 2019, McKee et al. [
9] estimate crop losses of USD 272 million. Boughton et al. [
10] studied the effects of wild pig rooting and concluded that damage to pastureland and loss of forage generated regional losses greater than USD 2 million annually. Further, Didero et al. [
11] provide examples of a wide range of methodologies used to produce damage estimates. Lastly, Vercauteren et al. [
12] contribute comprehensive treatment on a variety of issues regarding the extent of knowledge about wild pig control and damage.
As a result of the outlined population dynamics and increasing damage, US Congress appropriated funds in 2014 to establish the National Feral Swine Damage Management Program (NFSDMP). The objectives of the program include operational population reduction, such as removal and eradication, cooperative research, and outreach and communication campaigns. The impacts from wild pig damage have primarily been felt in areas with large wild pig populations, such as the Southeastern United States and California. As a result of this geographic concentration, the NFSDMP’s resources have been focused on mitigating damage in a few states and eliminating wild pigs in other states. In states with significant invasive wild pig populations, surveys have been conducted to estimate the extent of damage to corn, wheat, peanuts, rice, sorghum, soybeans, cotton, hay, almonds, pecans, melons, sugarcane, sweet potatoes, and berries in these areas [
8,
9].
Focusing on invasive wild pig population control, the NFSDMP has eliminated feral swine from 11 states [
13], reduced spread rates [
5], and prevented the spread of wild pigs to regions with no contemporary or previous wild pig populations [
7]. By reducing the spread of wild pigs, the introduction of the NFSDMP has alleviated the threat of damage to resources including crops, land, property, and livestock.
However, little is known about the damage prevented by management in areas where pig populations would have been established and grown in the absence of intervention [
7]. Estimating the extent of wild pig geographic spread prevented by NFSDMP activities allows for the evaluation of resources safeguarded by management. In this paper, we use two ecological modeling frameworks, a dynamic occupancy approach [
14,
15] and boosted regression trees [
16] to forecast the spread of wild pigs between 2014 and 2021 in the absence of any intervention by the NFSDMP. Further, we utilize the spread forecasts to quantify the primary resources safeguarded from the threat of wild pigs during this period.
Analyzing the full extent of damages caused by the spread of wild pigs requires information on population densities and the degree to which wild pigs damage resources. However, the models forecasting the spread of wild pigs focus on predicting the share of counties occupied by wild pigs without providing predictions on density. Little is known about the relationship between the presence and density of wild pigs and the damage they cause [
12], nor of the extent of damage caused by wild pigs to a variety of other crop resources and to land resources, such as wetlands [
11]. For these reasons, it has been intractable to ascertain the full economic impact of wild pig damage avoided by introducing the NFSDMP. Therefore, our main objective was to quantify the economic value of resources safeguarded by a national-scale wild pig damage management program. We estimate the total resource acreage (including agricultural crops, pasture, and wetlands) and livestock inventories safeguarded from the presence of wild pigs by linking forecasted geographic spread of wild pigs in the absence of NFSDMP to the value of selected commodities in those areas where spread was prevented. We then estimate a dollar value for a subset of the resources for which annual revenue per acre is available.
Our results find that from 2014 to 2021, the NFSDMP has successfully prevented the spread of wild pigs to additional counties. Further, our analysis demonstrates that significant acreage and value in field crops, pasture, and grasses has been successfully safeguarded by the NFSDMP. These results indicate that the additional benefits generated by implementing the NFSDMP in areas where wild pigs have not been observed are significant and should be accounted for when evaluating the benefits of the program. Our framework can be used to evaluate the value of resources safeguarded by a national damage management program.
2. Materials and Methods
We modeled the economic consequences of preventing the spatial spread of wild pigs using an ensemble approach [
17]. We forecast the spread of wild pigs using two approaches; boosted regression tree modeling with step-ahead forecasting from these models and a dynamic occupancy approach. For each approach, we further include a variety of covariates, simulating each model using four distinct parameterizations. This yields a total of eight forecasts that predict the spread of wild pigs in the absence of NFSDMP intervention. We quantify the resources safeguarded by containing the spread of wild pigs by using the total acres or head of a resource and the proportion of the county forecasted as occupied by wild pigs. Further, we combine this amount with the economic value of the respective resource to quantify the value of resources safeguarded. The two modeling frameworks were implemented at the county and watershed scales. All final model predictions are provided at the county scale annually and provide both the presence/absence and proportion of the county occupied by wild pigs. We follow previous work [
7,
18] by including a variety of covariates to predict the rate of spatial spread.
2.1. Data and Processing
We modeled the geographic expansion of wild pigs using annual county-level and watershed-level mapping of wild pig presence/absence [
6,
7,
18]. These data were expressed as a county area occupied by wild pigs in km
2 and are a proportion of the county occupied by wild pigs. We subdivided the data into counties where there have been wild pigs at least once during 2009–2013 (‘transient counties’,
N = 926) and those where there have always been wild pigs during 2009–2013 (‘persistent counties’,
N = 376) because we expected spread rates and covariate effects to differ in these two situations. For estimating the pre-NFSDMP spread rates, first, we estimated annual spread rates for the 5 years immediately prior to the start of NFSDMP (2009–2013) by subtracting the km
2 area or proportion occupied in the current year from that in the previous year. Then, we took the mean of these annual spread rates per county to generate the average pre-program spread rates to estimate covariate effects.
Watershed level response data were obtained using the following procedure. Polygons representing the observed distribution of wild pigs were aggregated to 12-digit watershed boundary data using methods described in Miller et al. [
5] resulting in the presence/absence of wild pigs by 12-digit watersheds. These 12-digit watersheds were assumed to represent discrete populations. The number of the invaded and total number of 12-digit watersheds within each coarse scale 8-digit watershed was generated and used as a response variable.
We use data from the National Feral Swine Mapping System to estimate the rate of spread of wild pigs in the contiguous United States. These data have been compiled annually since 2008. Each year, wildlife professionals in state wildlife resource agencies and the United States Department of Agriculture report polygons (polygons are drawn by technicians and vary in size based on extent of observed wild pigs) representing their opinion of the geographic extent of established wild pig populations to the National Feral Swine Mapping System. The definition of pig presence in this methodology includes populations present for two or more years with evidence of reproduction. The polygons are then processed to determine the proportion of each county that has wild pigs.
There are two major sources of error in the data that are difficult to account for because we did not have the requisite data: (1) error between the perception of where wild pigs are when experts draw the polygons and the true distribution of wild pigs; (2) differences in the reporting methodology over time and across states in terms of how detailed the polygons were and how much observational effort was allotted to their reporting. Because of these data limitations with interannual variation, we estimate the pre-program spread rate from 2009 to 2013 as an average rate across those 5 years. This was performed by first calculating the county-level annual rate for each year (2009–2013) as the difference in proportion occupied for each county between yeart − yeart−1, which ranged from −1 to 1. We also investigated models of the spread rates per km2 because counties varied widely in their size. To estimate this second response variable, we multiplied the proportion differences by the county area to model the rate spread in km2 and account for differences in county size. This response distribution ranged [−542.4, 3165.8], and as with the difference in proportion distribution, the change in km2 response probability distribution was characterized by a high density near 0, a short tail on the negative-value side, and a long tail on the positive-value side. We investigate models of the change in proportions as well as models of the change in km2 occupied.
We obtain crop, fruit, vegetable, grass, and pasture resource data at the county level from the National Agricultural Statistical Service (NASS) to calculate the quantity and value of resources safeguarded by containing and in some cases, reversing the spread of wild pigs. The data on acreage, yields, and prices were sourced from the 2017 Census of Agriculture. The agricultural census is conducted every five years and the analysis focuses on the period spanning 2014 to 2021; thus, we assume that crop data from 2017 are constant across all years of the analysis. Further, information on livestock counts was obtained from the 2017 Census of Agriculture; however, data covering the annualized values of livestock are not available from NASS, which prevented us from investigating the value of livestock that were unthreatened by the spread of wild pigs. Lastly, data gathered from the 2015 USGS National Land Cover Database were used to estimate the acreage of wetlands, which would have been threatened by the unmitigated spread of wild pigs. To calculate the resource acreage that would have been exposed to wild pigs, we interact the total acreage in each county with the forecasted proportion of the county occupied. Dollar values for crops and land were also obtained for the year 2017 and were used to quantify the value of resources safeguarded by the NFSDMP. After estimating the annualized value of resources that would have been threatened by the spread of wild pigs, the total value of resources safeguarded was computed by aggregating across the additional years in which a county was forecasted to be occupied.
2.2. Boosted Regression Tree Models
We estimated the covariate effects on response data using boosted regression trees with least-square boosting because the response variable did not follow a known parametric distribution and because we expected complex non-linear relationships between the response and covariates. Covariates for spread rates based on the difference in proportion of area occupied include the proportion occupied in the focal county in the previous year, the mean proportion of counties occupied in the adjacent counties (i.e., an occupancy pressure from adjacent counties), amount of wild pigs removed per km
2 in the focal county in the previous year, the mean count of removals per county in the adjacent counties in the previous year (log scale), the proportion of the focal county with active removal work in the previous year, the mean proportion of adjacent counties with active removal work in the previous year, the habitat suitability index (the habitat suitability index standardizes biotic and abiotic factors across counties and is obtained using the methods of Ref. [
18] for use as a covariate to fit the boosted regression tree models) [
18], median density estimates rescaled, the percentage of the focal county with hydrology, the percentage of the focal county with tree cover, the percentage of the focal county with crops, the percentage of the focal county with pasture, and the percentage of deciduous plant cover.
Covariates for spread rates based on the difference in the area (km
2) occupied in the focal county in the previous year, the mean proportion of counties occupied in the adjacent counties, the sum of removals in the focal county in the previous year, the mean count of removals per county in the adjacent counties in the previous year (log scale), the proportion of the focal county with active removal work in the previous year, the mean proportion of adjacent counties with active removal work in the previous year, the habitat suitability index [
18] median density estimates rescaled, the percentage of the focal county with hydrology, the percentage of the focal county with tree cover, the percentage of the focal county with crops, the percentage of the focal county with pasture, and the percentage of deciduous plant cover. Several covariates are subject to the sources of error discussed in the previous section. Further, it is difficult to account for how wild pig management would have evolved in the absence of the NFSDMP in response to the continuously spreading wild pigs.
For each response, we fit models with and without the covariate describing status of the focal county in the previous year because this covariate was a very strong predictor. We took this approach to account for the extent of path dependency and uncertainty in forecasting the spread of wild pigs. When interpreting the results, it is important to emphasize that regardless of our modeling assumptions, the expansion of wild pig populations without intervention is considerable. We denote the first four models A through D for each possible response–covariate pair. Thus, we examined the following four models of wild pig spread: change in proportion occupied with proportion occupied in 2008 (model A), change in proportion occupied without proportion occupied in 2008 (model B), change in km2 with km2 occupied in 2008 (model C), and change in km2 without km2 occupied in 2008 (model D).
We use the fitted models to conduct step-ahead forecasting for years 2014–2021 (post-introduction of the NFSDMP), starting with the data in 2013. For each year, we use the Persistence and Transient models to predict the rate of change for each county given the current year’s covariate values. We then add the change to the current value in each county (proportion occupied for A and B models, km2 for C and D models). For A and B models, we bound the predictions between 0 and 1; for C and D models, we bound the predictions between 0 and the upper maximum of the county area in km2. For each year, we recorded which counties became newly occupied and which counties became newly unoccupied. We used the updated proportion occupied values to update the mean proportion occupied in adjacent counties to be used in the next year’s prediction.
2.3. Dynamic Occupancy Models
We modeled the occupancy dynamics using a two-step process. We modeled the occupancy rate within 8-digit watersheds using 12-digit watersheds as spatial replicates. We then used a stochastic framework to account for changes in the annual rate of introduction (invasion) and extinction due to stochastic processes. The dynamic occupancy models do not account for imperfect detection due to computational infeasibility. Covariates include a combination of annually time-varying and non-time-varying climate and land cover data obtained from Refs. [
7,
18]. In addition, the rate of invaded watersheds in the previous year and the distance to the nearest invaded watershed were also included. Based on previous work [
6,
7,
18,
19], we included the following non-time and time-varying covariates for predicting the rate of spatial spread.
Non-time-varying covariates include terrain ruggedness, predicted equilibrium density [
18], and mast tree species richness. Time-varying covariates are shown in
Table 1.
All models include the rate of invaded watersheds in the previous year and the distance to the nearest invaded watershed. Initial model screening was conducted using projection predictive variable selection that allows for large sets of candidate models to be evaluated quickly. We evaluated 108,537 possible candidate models using all possible combinations for eight sets of variables that did not have a large covariance. From that initial screening, a reduced set of 127 candidate models was evaluated using leave-one-out cross validation. Predictive capacity of the final model was evaluated using Bayesian version of R-squared and LOO-adjusted R-squared. Model convergence was evaluated by comparing the between- and within-chain predictions for model parameters as well as bulk and tail effective sample size. Evaluation of the top model indicated some potential regionally varying effects. To address this, we evaluated models with uncorrelated random intercepts and correlated intercepts with random slopes to account for regional variation in invasion rates. We considered four regions—west, plains, Great Lakes, and east. The final Bayesian model predicts the probability of a watershed being invaded annually given the covariates included in the model. Bayesian models and model evaluation were conducted using the rstanarm (rstanarm version 2.21.3 was used to estimate the model. The most recent update can be found at
https://cran.r-project.org/web/packages/rstanarm/index.html, accessed on 14 June 2023) package within the R computing environment.
To predict the spread of wild pigs in each year from 2014 to 2021, we used step-ahead forecasting using a stochastic framework to account for changes in annual rate of invasion and extinction due to stochastic processes. To implement the simulation, we first predict the probability of invasion using the final Bayesian model for all uninvaded watersheds in year t using associated time-varying data for year t. This results in a probability of invasion for every uninvaded watershed. The number of invaded watersheds in year t was drawn from a beta distribution representing the range of observed invasion rates from 2004 to 2012. Watersheds are randomly assigned as invaded using the probability of invasion as a weight. The proportion of 12-digit watersheds within each 8-digit invaded watershed is updated and the distance to the nearest invaded watershed for all uninvaded watersheds is updated. In year t + 1, the probability of invasion and watersheds assigned as invaded was the same as in year t. Additionally, in year t + n, the number of watersheds with extinctions was drawn from a beta distribution representing the range of observed extinction rates from 2004 to 2012. This process of simulation was conducted until t + 8 (2021). The simulation was run 1000 times. Using these simulations, the median proportion of each 8-digit watershed invaded was calculated. These watershed-level proportions are used to estimate the proportion of each county invaded.
2.4. Resources Safeguarded
To evaluate the economic impacts of preventing the spread of wild pigs, we begin by accounting for all resources that would have been threatened under each modeling scenario. The resources that would have been threatened without intervention by the NFSDMP are also referred to as resources safeguarded due to intervention by the program. We interact the proportion of each county invaded by wild pigs with total resource acreage and livestock inventories. The acreage and value of resources were computed and visualized using the R computing environment (R version 4.3.1 and ggplot2 version 3.4.4 were used to generate maps and calculate acreage and values). A variety of resources are included under the following broad categories: field crops, fruits, vegetables, tree nuts, field and grass seeds, forage, and hay, land (including pasture and wetlands), and livestock. Details for each category can be found in
Appendix A Table A1.
Studying the period running from 2014 to 2021, we allow for variation in the amount of time wild pigs invade a given county and changes over time in the proportion of a county occupied for each scenario. As a result of the caveats discussed above, there is a high degree of uncertainty within each scenario. Thus, aggregating across each scenario results in a high level of uncertainty when calculating the quantity of resources threatened by wild pigs in the absence of the NFSDMP.
2.5. Value of Resources Safeguarded
To quantify the value of resources that would have been threatened in the absence of intervention by the NFSDMP, we utilize information on the value of an acre for each resource for which data are available and scale by the additional proportion of a county that is forecasted to be occupied by wild pigs in each year.
Information on dollar values for crops is obtained using national-level prices. We then combine the price with information on crop yields at the state level, which produces a state-level dollar value per acre for each crop. Information on the dollar value for pasture comes from cash rents, measured in dollars per acre. This is available for 42 states and at the national level; the national-level value is used in states where cash rents are unavailable. For details on the dollar values used, see
Appendix A Table A2.
For each model, we computed the total amount of resources for which the threat from wild pigs is averted. We refrained from estimating the value of damages to resources; though surveys have been conducted to estimate the rate of damages from wild pigs in 11 southern states [
8,
9], extrapolating these results to other regions is impracticable. Employing data on prices and yields, we then calculated the total value of resources safeguarded from wild pig presence due to the introduction of the NFSDMP. We calculated the value of resources safeguarded for each county and year and then aggregated these values across all years and counties for each model. The resulting value is presented for each broad category of resources and is available for each individual resource.
4. Discussion
Areas in which invasive wild pig populations have been established or may emerge are currently subject to outreach and eradication efforts under the NFSDMP. Our results indicate that in addition to these areas, these efforts by the NFSDMP have effectively prevented the spread of wild pigs to counties where wild pig populations have not been observed. We demonstrate that between 421 and 895 counties would have experienced at least one additional year of wild pig presence. For each additional year in which wild pigs were prevented from occupying a county, we compute and aggregate the acreage of land resources and estimate the value of a subset of commodities safeguarded. This analysis shows that between USD 11 and USD 116 billion in value of field crops, pasture, grasses, and hay has been safeguarded because of intervention by the NFSDMP between 2014 and 2021. This value does not include the value of resources protected in counties that have experienced wild pig presence throughout the study period. These results indicate that the introduction of the NFSDMP delivered significant economic benefits to regions that have not experienced a wild pig invasion. When evaluating the efficacy of the NFSDMP and other similar programs, these benefits must be considered. Further, if control efforts are maintained over time, the benefits of safeguarding resources will continue to grow as wild pig invasions are prevented over a longer timeframe. Regardless, the large range of outcomes with respect to the area experiencing additional wild pig presence and the economic value of resources safeguarded can be attributed to high levels of uncertainty present in the underlying modeling framework and several limitations, which are outlined below. Despite this uncertainty, without relying on a single most accurate model, the models collectively suggest that the magnitude of our results is large and significant.
Uncertainty regarding the spread of wild pigs and the extent of the damage resulting from wild pig presence is an additional challenge. The environmental and climatic factors that drive wild pig population growth documented in McClure et al. [
19] have been influential in predicting their northward expansion [
6]. Once established, Miller et al. [
5] used watershed-scale modeling to uncover the determinants of wild pig population growth. Regardless, predicting the spread and growth of wild pig populations using ecological modeling utilizes pre-period data and a variety of assumptions. Due to errors in pre-period data, unpredictability in the ecological factors governing wild pig population dynamics, and assumptions inherent to a given modeling strategy, there is a high degree of uncertainty regarding the timing and location of wild pig population growth. Further, information on population densities in observed wild pig habitats is difficult to ascertain, which yields an additional source of uncertainty in spread forecasting. Lastly, the pre-period data used to inform the ecological models did not account for the international expansion of invasive wild pigs from Canada or Mexico. Notwithstanding, in all models we evaluated, the extent of the spread of wild pigs and the magnitude of the associated resources safeguarded are considerable.
There are significant challenges in ecological forecasting that result in potentially large uncertainties in predicted ecological states. To predict the spread of wild pigs in the contiguous US in the absence of the NFSDMP, we use a conservative approach with multiple modeling frameworks. This was performed to account for potential uncertainties and a diversity of different model assumptions. This has the benefit of providing multiple predictions that can be used in an ensemble framework for further assessment of potential economic impacts averted because of the NFSDMP.
For each boosted regression tree model, we acknowledge the following caveats. First, the predictions are deterministic. Thus, in the first year of forecasting, most counties become newly occupied and the number decreases thereafter. This is because the average spread rate from 2009 to 2013 is quite high. We tried adding noise by sampling the predictions from a normal distribution using the variance of the empirical distribution. This results in more spread overall). Second, management occurred before the program, but it is difficult to predict how that would continue as new counties become invaded. We tried adding a separate model in the forecasting as follows. We updated the amount of removal in the focal county using a separate model of the relationship between removal amount per km2 or proportion of the county in the focal county in the current year and covariates (current km2 occupied, removal amount per km2 in the previous year, mean removal amount in adjacent counties in the previous year, and the habitat suitability and landcover variables as in the other models. We fit this model using the same methodology as the Persistence and Transient models, although we did not subset the data because there was no evidence that the relationship between take amount and covariates differed depending on historical wild pig presence. This model had an R2 of 0.67 and 0.94 for in-sample predictions of models of number removed/km2 and log numbers removed, respectively. At each time step, we used this model to update the amount of removal occurring in focal and adjacent counties in the previous year based on updated occupancy. This allowed us to maintain pre-program levels of removal as the spread to new areas progressed, but there is uncertainty in those estimates. These models produced very similar forecasts to their corresponding models without removal updates, except with slightly higher invasion rates overall). Lastly, there is a substantial amount of reporting variation both over time and space in the observed data. There are no data to explain it. Thus, our predictions are influenced by these data limitations.
The following caveats apply to the dynamic occupancy models. Firstly, while we accounted for time-varying factors influencing the probability of invasion and stochastic processes of invasion and extinction, there is uncertainty about which model might represent the invasion process best. We also did not explore non-linearities among covariates. Furthermore, watershed-level models did not explicitly account for control that likely would have continued to occur without a national program, although they did allow for extinction, which may have resulted from local or regional control activities. We assume that regional effects (random intercept and slopes) account for some of this variation. Additionally, associations with covariates are likely influenced greatly by the geographic location of the spread that occurred from 2004 to 2012. The majority of spread occurred in more arid regions and likely influenced covariate associations. This could be addressed by fitting models to different subsets of data. Finally, we assume perfect detection of watersheds with wild pigs, which is likely invalid.
Several caveats limit the scope of the economic analysis as it pertains to valuing the resources avoided by wild pigs due to the NFSDMP. First, comprehensive estimates of the annualized value of wetlands and livestock are not available to be used in the analysis. Specifically, previous evaluations of wetlands [
20] have examined specific sites and estimated the value of specific features of wetlands; however, these estimates have not been applied to all wetland acres throughout the United States. Additionally, estimates of the stock value of livestock have been produced for cattle, domestic swine, sheep, and goats [
21,
22]; however, we are not aware of studies that convert these to annualized values that account for the production and depreciation of livestock. Lastly, Brown et al. [
21] and Sauter-Louis et al. [
23] demonstrate the extent of disease transmission risk from wild pigs to livestock, emphasize the degree of uncertainty regarding the economic consequences of disease risk, and highlight the self-sustaining cycles of disease transmission between wild pigs and domestic livestock. For example, the costs resulting from the death of livestock, culling exposed livestock, and potential trade restrictions due to a disease outbreak [
24,
25] have not been precisely estimated. For the above reasons, we focused primarily on field crops, fruits and vegetables, and pasture for the economic analysis.
Second, we completed our analysis under the assumption that resource acreage and prices would have been unaffected by the presence of wild pigs. In counties where the NFSDMP reduced or prevented wild pig populations from being established, it is possible that had wild pigs been present, producers would have responded by changing the mix of crop and livestock resources from what was observed in the 2017 Census of Agriculture. A reduction in planted crop acreage would have reduced the quantity of resources threatened by wild pigs; however, if this reduction would have generated an increase in price then the value of resources safeguarded would have increased. With limited information regarding changes in acreage and prices that would have resulted from a wild pig invasion, the effect of this assumption is ambiguous.
Lastly, the analysis assumed that the only way to control, mitigate, and eradicate wild pig presence and damage was through the NFSDMP. In the scenario where the NFSDMP was never introduced, it is likely that producers and landowners would have privately attempted to limit the spread of wild pigs. Further, we have ignored efforts that could have replicated the NFSDMP at the state and county levels. Though it is likely that effort would have been made to mitigate the impact of the spread of wild pigs in the absence of the NFSDMP, it is difficult to analyze the costs of implementing these measures at the sub-national level as well as their effectiveness in the absence of NFSDMP intervention. Acknowledging the above, interventions in the absence of the NFSDMP would have reduced the probability of a wild pig invasion relative to the model forecasts, and we are unable to account for this.