Next Article in Journal
Traditional Fire Knowledge: A Thematic Synthesis Approach
Previous Article in Journal
Dynamics of Anthropogenic Wildfire on Babeldaob Island (Palau) as Revealed by Fire History
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluating the Performance of Fire Rate of Spread Models in Northern-European Calluna vulgaris Heathlands

by
Charles D. Minsavage-Davis
1 and
G. Matt Davies
2,*
1
Department of Biology, Georgetown University, 37th and O Streets, N.W., Washington, DC 20057, USA
2
School of Environment and Natural Resources, The Ohio State University, Kottman Hall, 2021 Coffey Road, Columbus, OH 43210, USA
*
Author to whom correspondence should be addressed.
Submission received: 16 March 2022 / Revised: 30 March 2022 / Accepted: 4 April 2022 / Published: 6 April 2022
(This article belongs to the Section Fire Science Models, Remote Sensing, and Data)

Abstract

:
Land-use, climate, and policy changes have impacted the fire regimes of many landscapes across northern Europe. Heathlands in oceanic climates are globally important ecosystems that have experienced an increase in the prevalence of destructive wildfire. Many of these landscapes are also managed using traditional prescribed burning that enhances their structural diversity and agricultural productivity. The changing role of wild and managed fire highlights a necessity to better understand the performance of fire behaviour prediction models for these ecosystems to support sustainable fire risk management. Our research evaluates the outputs of several empirical and quasi-empirical prediction models, as well as their varying software implementations, against observations of fire behaviour. The Rothermel model and its implementations predict rates of spread with similar accuracy to baseline empirical models and provide tolerable estimates of observed fire rate of spread. The generic shrubland empirical model developed by Anderson et al. consistently overpredicts observed rates of spread for prescribed burns in target fuel structures, but its predictions otherwise have a strong correlation with observed spread rate. A range of empirical models and software tools thus appear appropriate to assist managers who wish to evaluate potential fire behaviour and assess risk in heathland landscapes.

1. Introduction

Fire is a common disturbance process in ecosystems, including boreal peatlands in Alaska, Canada, Fennoscandia, and Russia, as well as shrublands and forests in the British Isles, Scandinavia, and Mediterranean countries [1,2,3,4,5,6,7,8]. In many of these regions, climate change, fire suppression, and land-use change have, or are projected to increase, the incidence of wildfire and alter carbon emissions [8,9,10]. For example, climate change is expected to increase the number of wildfires across Italy [11]; Sweden has experienced an increase in wildfire activity as compared to records from before the industrial revolution [10]; in boreal forests, climate change impacts, such as severe droughts and vegetation change, are critical drivers of altered fire regimes [5,8,12,13]; and in Portugal, recent wildfires have impacted large areas of forest due to increasing extreme weather conditions [14]. Furthermore, fire suppression often has indirect social impacts such as in Fennoscandia where changes to boreal fire regimes have impacted traditional land usage by indigenous groups [15].
Uncontrolled wildfires can result in significant effects on economies, human health, and ecosystem function [16,17]. Because of this, ecologists increasingly acknowledge the fundamental role of fire in northern ecosystems (e.g., [18]) and seek to integrate this into management [19,20]. In oceanic northwestern Europe, shrublands, such as the heathlands and moorlands of the United Kingdom (UK) and Norway, hold globally important carbon stores and have experienced a long history of both wild and managed fire [21,22,23,24]. Furthermore, traditionally managed burning has been a common tool in Calluna vulgaris L. Hull (heather, hereafter Calluna) dominated heathlands throughout Europe [24]. Such managed burning is argued to be important in promoting ecological processes, such as niche diversity [25,26,27] and managing fuels to reduce the impacts of severe wildfire [28]. Common burning practice involves lighting fires with comparatively short (~30 m) long fire fronts and burning strips that create a mosaic of fuel ages and habitat structures across landscapes. While we have limited data on the behaviour of wildfires in heathland fuels, experimental burns have demonstrated highly variable rates of spread and fireline intensities (1.3–12.6 m min−1 and 137–4056 kW m−1, respectively [21]). As a practice it has, however, diminished significantly in Norway [22] and is an increasingly contentious topic in the UK due to concerns about effects on water quality, ecosystem carbon stocks, and peatland carbon sequestration [5,29]. Nevertheless, there is concern over the potential for increased impacts from wildfires in northern heathlands due to a projected increase in severe fire weather [30], as well as changes in land-management policy (including restrictions on prescribed burning [31] and declines in traditional management). In Norway, unmanaged Calluna-dominated vegetation was found to experience rapid fire spread in the late winter and spring that has been exacerbated by climate change, dead fuel build-up [32], and drought [33]. To date, managers and policy makers in Europe have not been provided with adequate demonstration of the applicability of existing fire risk planning tools. This lack of knowledge and confidence limits the uptake of existing models and support systems which, in turn, leads to the potential to underestimate the changing fire risk environment [34].
Effective fire risk management requires a robust understanding of key controls on fire behaviour and the ability to produce reliable fire behaviour predictions. Thus, fire behaviour models have been developed for many different ecosystems across the world [35,36,37]. In the heathlands of northern Europe, fire ecology research has focused heavily on the life cycle, regeneration, and growth of Calluna [38,39,40]. Further important studies have quantified Calluna fuel chemistry [41], temperatures generated during Calluna fires [42], and fire rates of spread [43]. More recently, Davies et al. [44] recorded fire behaviour in experimental heathland fires in the UK, representing an array of fuel structures denoted by the growth phases of Calluna described by Gimingham et al. [45]. They were able to produce empirical models for rates of spread based on parameters, including the height of Calluna, fuel moisture, and wind speed. Subsequently, empirical models were produced for Calluna heathland fireline intensity and flame properties [21]. Away from heathland-specific analyses, generic empirical models of fire behaviour in shrub-dominated ecosystems have also been produced and cover a broad range of global climates [35]. These models aim to provide generalizable estimates of fire behaviour, but are not calibrated to ecosystem specific variations in fuel loadings, fuel composition and weather [35].
Empirically derived fire behaviour models can provide important guidance and knowledge for fire managers, yet are innately situation-specific and potentially misleading when extrapolated to new fuel, weather, or landscape conditions [46]. Thus, for example, the heathland fire behaviour models developed by Davies et al. are limited to flat terrain and a constrained range of weather conditions appropriate for prescribed burning [21,44]. In light of this alternative, more broadly applicable alternative models would be valuable. Fully physical-based approaches are often costly and require powerful computational hardware [47]. These methods, however, are becoming more viable as computational resources become more advanced and can provide intricate analyses of the effects of characteristics, such as fuel heterogeneity on fire behaviour [48]. In reality, there are trade-offs that come with using any fire behaviour modeling technique; the decision on which technique to use should be based on funding availability, time allotted for a given study, and the urgency of the situation for which fire is to be predicted, rather than on assumptions about the relative validity of any given model [49].
The Rothermel model [50] was a foundational development in the prediction of fire behaviour [36]. It provides a quasi-empirical approach combining relationships derived from observed experimental fire behaviour data, as well as an appreciation of fundamental chemical and physical properties and processes relevant to fire behaviour [36,51]. In theory, the Rothermel model should be more broadly applicable than fuel-type specific empirical models, such as those produced by Anderson et al. [35] and Davies et al. [44], as a user is able to manipulate fuel chemistry, structure, and weather inputs. The Rothermel model has been widely applied and adopted, most frequently and extensively in the United States, to organize the deployment of firefighting resources and make fuel management decisions. A suite of software tools has been developed based on the Rothermel model that allows researchers and field managers to apply it more readily in their work [36]. BehavePlus provides instantaneous results for fire behaviour using constant conditions for fire weather but is typically less applicable for studies with larger spatial and temporal scales and variations [52]. FlamMap contains the tool FlamMap BASIC which expands BehavePlus predictions to a two-dimensional landscape to model spatial patterns of potential fire behaviour for constant weather and fuel moisture [53]. Farsite, also available within FlamMap, provides the ability to predict fire behaviour over time and across weather scenarios [54]. Finally, Vacchiano and Ascoli [55] translated the original Rothermel model into the package ‘Rothermel’ [56] for the statistical analysis software R [57]. Validation and testing are critical prior to the adoption of models in new systems to provide managers and policy makers with confidence in such decision support tools. Studies in a number or shrubland systems, including in the Mediterranean region of Europe and similar climates in California, have suggested that the Rothermel model and its associated software implementations can provide relatively robust predictions of shrubland fire behaviour [55,58,59,60]. To date, however, the Rothermel model and its derived tools have not been evaluated for oceanic heathland ecosystems in the UK and Norway. The objectives of this research were thus to: (i) evaluate the ability of key implementations of the Rothermel model to reproduce observed fire behaviour in Calluna-dominated heathland fuels; and (ii) to perform model sensitivity analyses to compare the behaviour of empirical models and Rothermel implementations across a representative range of fire-weather conditions for oceanic heathlands.

2. Materials and Methods

2.1. Comparing Modeled and Observed Fire Rate of Spread

Modeled fire rates of spread were compared with data collected during 27 experimental prescribed burns in Calluna-dominated heathland fuels (Table S1 in Supplementary Material). Full procedures for these experiments are described in Davies et al. [44]. Briefly, experimental fires (dimensions 15 m × 15 m or 20 m × 20 m) were burned in spring or late autumn on flat ground (<5% slope) in Calluna stand stages, representing the early-building, late-building, mature, and degenerate phases of the Calluna growth cycle [45]. Legg et al. qualitatively classified these plots into “High”, “Medium”, and “Low” fuel loading classes based on their Calluna stage and structural attributes [61]. Fuel structure, including fuel bed depth, the loading of live and dead fuels by size class and type (i.e., woody/herbaceous), and fuel bed bulk density, was monitored using destructive harvesting and the non-destructive FuelRule technique prior to the burns [62]. Fires were ignited using a driptorch to produce a line ignition along the upwind edge of the plots. Calluna comprised at least 90% of the overall fuel bed and the vast majority of the fuel was comprised of live shrubs. The Calluna canopy was generally underlain by a mat of pleurocarpous mosses and Calluna litter. These layers frequently had a very high fuel moisture content and experienced little consumption [63]. They were thus not considered as available fuel during our initial model testing. Fire weather conditions (wind speed at 1.5 m—mid-flame height, temperature, and humidity) were measured using a portable weather station located upwind of the burn. Samples of live and dead fuels were collected immediately prior to ignition to determine fuel moisture content. Data on dead fuel moisture content (FMC) for some fires was lacking; thus, we used the estimate for dead FMC provided by Legg et al. for these burns [61]. The fire rate of spread was measured by two methods: (i) a line of thermocouples located 5 m apart down the center of the plot; and (ii) making visual estimates of the arrival time of the headfire at a series of measuring posts co-located with the thermocouples. The final assigned rate of spread was the mean of these two methods. The experiments captured a wide range of fuel, fire weather, and fire behaviour conditions, though they did not include the very dry conditions when wildfires are common. One-hour fuel loadings ranged from 0.90 t ha−1 to 3.90 t ha−1, live herbaceous fuel loadings from 4.00 t ha−1 to 10.60 t ha−1, live woody fuel loadings from 0.20 t ha−1 to 8.90 t ha−1, and fuel bed depths from 0.12 m to 0.51 m. Dead FMC ranged from 14.87 % to 29.00 %, live FMC from 55.19 % to 97.18 %, and wind speed from 5.83 km hr−1 to 32.51 km hr−1. Observed fire rates of spread ranged from 0.00 m min−1 (i.e., no sustained spread) to 12.64 m min−1. The known effect of fireline length on rate of spread [35] means that our estimated rates of spread may be conservative compared to the true quasi-steady-state spread rate for the given fuel structure. Our fires were, however, similar in size or larger than previous experimental shrub fires [64,65,66,67] and, critically, are of similar width to managed burns applied in Calluna-dominated heathlands [68].
We compared measured rates of spread with predictions from three different implementations of the Rothermel model: the ‘ros’ function of the R ‘Rothermel’ package (hereafter ‘Roth’) [56], BehavePlus [52], and Farsite [54]. Units for characteristics used as inputs for all Rothermel modeling tools were sourced from Andrews [36]. The Rothermel model and its implementations require a number of fixed chemical and physical fuel characteristics. Information for heathland fuels is limited but could be obtained from a variety of sources (Table 1). Using these constants, and the measured fuel characteristics associated with each individual experimental burn, we produced 27 individual fuel beds (Table S1 in Supplementary Material)—one for each burn. These were then used to generate the fire rate of spread predictions with each Rothermel implementation. Because Farsite produces temporally dynamic and spatially explicit predictions of fire behaviour, it was run on landscapes with flat ground and spatially and temporally constant inputs across 24 h. We used the maximum rate of spread as the estimate of steady-state head fire rate of spread.
To provide a baseline against which to evaluate the performance of the Rothermel implementations, we examined rate of spread predictions from three empirical models (Equations (1)–(3)): rate of spread models 1 and 2 from Davies et al. (hereafter Davies 1 and Davies 2, Equations (1) and (2)) [44] and the generalized shrubland rate of spread model from Anderson et al. (hereafter Anderson, Equation (3)) [35].
ROS = 0.791 + 7.917 h2 U
ROS = 8.304 + 7.286 h2 U − 0.097 M1
where ROS is predicted steady-state rate of spread (m min−1), h is mean Calluna height (m), U is 10–20 m wind speed upwind of fires (m s−1), and M1 is canopy fuel moisture content that translates to live woody moisture (%).
ROS = 6.421 U20.9942 h0.3722 exp(–0.0761 Md) exp(–0.003131 Ml)
where ROS is predicted steady-state rate of spread (m min−1), U2 is wind speed at 2 m height (km hr−1), h is mean vegetation height (m), Md is dead fine fuel moisture content (%), and Ml is live fine fuel moisture content (%).
Some of these models (Equations (1) and (2) [44]) were developed with the same experimental fire data used to evaluate the Rothermel implementations. Our analysis thus does not provide any independent verification of these empirical models. Rather, these analyses provide context against which to consider the predictive ability of the other models. Anderson et al.’s model was developed based on shrubland fires with a minimum fire front length of 50 m and they demonstrated that smaller fires are unlikely to reach maximal quasi-steady-state rate of spread for the given fuel type [35]. When testing Equation (3), we therefore examined predictions compared to our original spread values and to the steady-state rate of spread estimated using the relationship between the ignition line length and the spread rate also presented in Anderson et al. [35] (Equation (4)).
Rss = R (1 + 9 exp(−0.00316L2))
where Rss is quasi-steady-state rate of spread (m min−1), R is measured rate of spread (m min−1), and L is ignition line length (m)
All statistical analyses were performed in R [57]. To evaluate agreement between predicted and observed rates of spread, root mean squared error (RMSE) was calculated using the ‘rmse’ function of the ‘Metrics’ package in R [70]. Linear models were then generated to examine the strength and pattern of association between predicted and observed spread rates. Model predictions were assessed by testing for significant deviation between the slopes of the predicted vs. observed regression line and the 1:1 line of perfect agreement (LPA) [71]. We used Equation (5) to calculate t-values which were then compared to a table of critical values for n − 2 degrees of freedom. A potentially significant over- or under-prediction was indicated when the slope of the regression line differed significantly from the 1:1 line. The position of the 1:1 line relative to the 95% confidence intervals of the regression line was also examined. Where the majority of the 1:1 line fell within a model’s 95% confidence intervals, it was deemed that predicted and observed results were not significantly different from each other.
t = (1 − b) SEb−1,
where b is the coefficient for a regression line, SEb is the standard error of that regression, and t is a critical value score.
Finally, we used a two-way ANOVA (‘aov’ function in base R) to test for differences in predicted fire behaviour as a function of fuel class (High, Medium, Low), fire behaviour model and their interaction [57]. We were particularly interested in results for the latter which would indicate that predictions for a particular fuel class were contingent upon the fire behaviour model used. For any significant model terms, post-hoc pairwise comparisons were performed using the ‘TukeyHSD’ function in base R [57].

2.2. Comparing Fire Model Performance

Rate of spread predictions were made for varying fuel structures, fuel moistures. and wind speeds—variables known to be critical controls on rate of spread in Calluna-dominated fuels [44]. Spread rates were predicted for the High, Medium, and Low Rothermel fuel beds described by Legg et al. for Calluna heathlands (Table S1 in Supplementary Material) [61]. A representative range of live fuel moisture and wind speed conditions was developed based on data reported in Davies et al. [72]. Specifically, five steps of live woody FMC, ranging from 55 to 95% (10% increments), were combined with ten steps of wind speed, ranging from 5 to 23 km hr−1 (2 km hr−1 increments) to create a suite of fifty fire weather scenarios that broadly represent conditions encountered during the legal managed burning season in the UK [61]. Rate of spread was predicted for each combination of fuel bed, fuel moisture. and wind speed using all of the Rothermel implementations and empirical models.
To evaluate differences in model performance across the broader range of FMC and wind speed conditions we used (i) an ANOVA (interacting effects of fuel class and fire behaviour model; ‘aov’ function in base R) [57] to test for differences in the mean predicted spread rate between models and between models within fuel classes; (ii) a Levene’s test, using the ‘leveneTest’ function of the ‘car’ package in R [73] to assess differences in spread rate variances between models within each fuel class; and iii) a sensitivity analysis to evaluate the independent effects of changes in fuel class, live FMC, and wind speed on rate of spread.

3. Results

Predicted fire rates of spread for all 27 fuel structures, collected alongside prescribed fires, varied both within and between the empirical models and Rothermel implementations (Table S2 in Supplementary Material). For the empirical models, predictions from Davies 1 ranged from 1.23 m min−1 to 9.78 m min−1 (mean ± 1 SD = 3.98 ± 2.53 m min−1), Davies 2 from 0.11 m min−1 to 11.23 m min−1 (mean ± 1 SD = 3.99 ± 2.75 m min−1), Anderson from 4.21 m min−1 to 27.65 m min−1 (mean ± 1 SD = 10.97 ± 6.82 m min−1), Roth from 0.48 m min−1 to 12.87 m min−1 (mean ± 1 SD = 3.53 ± 3.19 m min−1), BehavePlus from 0.06 m min−1 to 9.99 m min−1 (mean ± 1 SD = 2.81 ± 2.65 m min−1), and Farsite from 0.05 m min−1 to 8.25 m min−1 (mean ± 1 SD = 2.37 ± 2.18 m min−1) versus observed values from 0 m min−1 to 12.64 m min−1 (mean ± 1 SD = 3.98 ± 3.34 m min−1).

3.1. Comparing Modeled and Observed Fire Rate of Spread

When compared to the observed rates of spread from the experimental fires, RMSE was, unsurprisingly, lowest for the Davies 1 and Davies 2 empirical models which were built using this same dataset (2.13 m min−1 and 1.83 m min−1, respectively). These results thus provide a baseline against which to judge the performance of the other models. While overall RMSE was substantially higher for the Anderson empirical model (8.64 m min−1), those for Roth (2.64 m min−1), BehavePlus (2.92 m min−1), and Farsite (3.09 m min−1) were fairly similar to the baseline expectation provided by the Davies models. When examining the performance of the Anderson model, correcting our measured rates of spread to the estimated steady-state spread rate led to an increase in RMSE of 8.39 m min−1. When considering the three fuel structure classes separately, RMSEs were generally greatest within the “High” fuel load class while values were lower for the “Medium” and “Low” fuel classes for all fire behaviour models except Anderson.
For all fire behaviour prediction models, slopes of the regressions of predicted versus observed rates of spread did not significantly differ from the 1:1 line (Table 2 and Figure 1). Regression R2 values ranged from 0.39 for BehavePlus and Farsite to 0.69 for the baseline provided by Davies 2. Anderson generated consistent and substantial over-predictions resulting in spread rates approximately twice those observed in the field. Anderson’s performance was, however, otherwise strong with a slope matching the 1:1 and a relatively high R2 (0.46), suggesting it provides comparatively precise, but biased, estimates. With steady-state correction of our observed rates of spread, the substantial overprediction by Anderson was reduced and the regression line shifted below the 1:1 (Figure S1 in Supplementary Material). However, R2 for the resulting regression was much lower at 0.31. All other fire behaviour models tended to underpredict at higher rates of spread with the 1:1 line generally falling above the 95% confidence intervals of the regression line (Figure 1 and Table 2). This was most noticeable for the BehavePlus and Farsite implementations of the Rothermel model but was less extreme for the R version (Roth).
For predictions of observed fires, ANOVA revealed significant effects of the fire behaviour model used and fuel class modeled, but no significant interaction between the two (Table 3). Post-hoc pair-wise comparisons confirmed that predictions from the Anderson model were significantly different to the others (Table S3 in Supplementary Material). There were no significant differences in mean predicted rate of spread between the other fire behaviour models. Roth, BehavePlus, and Farsite, all implementations of the Rothermel model, were the most similar to each other. For the fuel class factor, mean rate of spread was significantly greater in the High class, but there was no significant difference between the Medium and Low classes. From our Levene’s test based on the interaction of fire behaviour model and fuel class, we found that population variances were unequal, suggesting that different prediction methods produced an unequal spread of fire behaviour within different fuel classes.

3.2. Variation in Rate of Spread Model Sensitivity

When examining model behaviour for the High, Medium, and Low class fuel beds across the wider range of fuel moistures and wind speeds we defined, there were significant differences within both fire behaviour model and fuel class effects. The interaction between fire behaviour model and fuel class was significant, though its effect size was much lower (Table 4). Post-hoc pair-wise comparisons indicated that there were significant differences between Anderson and all other fire behaviour models (Table S4 in Supplementary Material). There were no significant differences found between the other models, the most similar of which were Roth and BehavePlus. Significantly higher rates of spread were reported for the High fuel class but the Low and Medium classes did not differ.
Considering the effects of live woody fuel moisture content, wind speed, and fuel class, the model sensitivities for Roth, Behave, and Farsite were very similar (Figure 2). The Davies 2 model displayed the greatest sensitivity to FMC, with reduced rates of spread as live FMC increased, but none of the Rothermel model implementations showed any meaningful change in their predictions. For all models, the high fuel class displayed a much greater response to increasing wind speed compared to the low and medium classes. The Anderson model was the most sensitive to increasing wind speed, particularly in the low fuel class where changes were more muted for the Davies models and the Rothermel implementations. All fire behaviour models, other than Davies 2, were consistently more sensitive to changes in wind speed than changes in live woody FMC. For Davies 2, the model was more sensitive to changing live FMC when examining the Low fuel class (Figure 2). The three implementations of the Rothermel model showed very similar responses to changing fuel structure, FMC, and wind speed. The R implementation (Roth) did however display numerically different results, producing increased predictions at higher wind speeds.

4. Discussion

The experimental fires used to evaluate fire rate of spread models capture a broad array of fuel conditions from multiple stages of the Calluna growth cycle and a range of fire weather conditions typical during the legal prescribed burning period in the UK [45]. This data could not be used to make an independent evaluation of the empirical models we examined, but the assessment here provides useful context against which to consider the performance of the Rothermel model [35,44]. Extrapolating purely empirical models is, however, fraught with risks and, in our case, the available experimental data do not capture, for example, the full diversity in Calluna fuel types found in northern heathlands, nor the variation in fire weather conditions seen throughout the year. For example, previous research has demonstrated that during extended periods of hot and dry weather, layers of moss and litter below the Calluna canopy may be ignited, significantly altering burn severity and, potentially, fire behaviour [63,74]. Other work has shown that live fuel moisture contents can drop to as low as 41–44% during conditions when the ground is frozen in winter and early spring [32,75]. Conditions such as these are associated with significantly increased wildfire risk but are not captured in existing empirical models of fire behaviour.
Given the wide variety of fuel and fire weather conditions encountered in northern heathlands, and the growing challenge of managing wild and prescribed fires in these ecosystems, it is imperative that managers have access to robust and broadly applicable fire hazard and fire behaviour prediction tools [24]. The basis of the Rothermel model in fundamental physical processes [51], its widespread adoption in multiple fuel types, and its implementation in multiple manager-orientated tools makes it a potentially important solution to this problem [55,58,76]. Our results demonstrated that the Rothermel model in R, BehavePlus, and Farsite produced rates of spread that were broadly representative of observations, demonstrating their relative suitability for use in oceanic heathlands. RMSEs for all fuel structures were relatively similar within each fire behaviour model. R2 values for the Rothermel implementations (range = 0.39 to 0.46) indicated a somewhat noisy fit to observed rates of spread and thus a considerable degree of uncertainty when using this model. In comparison, the fully empirical Anderson model had a comparatively high R2 but showed substantial and consistent over-prediction, especially across a broadened range of possible fire weather, possibly due to its generation using longer fire fronts and its more extensive use of shrublands in drier and warmer ecosystems. This further highlights the importance for empirical models to be calibrated to specific ecosystems and potential climatic and weather conditions. We can summarize the predictive ability of the generalizable fire models as follows:
  • Rothermel implementations have moderate precision, but lower bias compared to Anderson. Bias increases for higher rates of spread where there appears to be consistent under-prediction of observed fire behaviour.
  • Anderson is comparatively precise but biased, producing rates of spread that are dramatically higher than those observed in fires with ignition line lengths used in managed burning.
  • With correction of our observed rates of spread for differences in ignition line length, overprediction by Anderson was reduced at the cost of considerably greater RMSE and a lower R2 correlation value.
Broadly speaking, the models showed similar sensitivities to changes in wind speed, though this was somewhat dependent on the fuel class considered. The Rothermel implementations differed from the empirical models with regards to the effect of live FMC (where included as a predictor)—Rothermel implementations essentially showed no effect. Other studies have noted the Rothermel model’s lack of sensitivity to live fuel moisture contents [77], especially with respect to canopy foliage [78], and that empirical models are more effective at representing the moisture dampening effects of live fuels [79,80]. This is something of a concern as it may lead to underestimates during high-risk conditions seen in winter and spring that are driven by dramatic crashes in live FMC [32,75]. Furthermore, the Rothermel model does not consider convective processes governing fire spread [81], an issue that could be addressed with physics-based models [51] and which may explain much of the noise in comparisons with observed fire behaviour. Nevertheless, other than for Anderson fire, behaviour predictions between models were not significantly different. This indicates that Roth, BehavePlus, and Farsite produce statistically similar fire behaviour, using real-life fuel structures, both to each other and to empirical models calibrated for oceanic heathlands (Davies 1 and 2).

5. Conclusions

Our results indicate that the Rothermel model could be cautiously utilized as a tool for future fire research and land management objectives. Although Rothermel’s predictions align tolerably well with empirical models generated for oceanic heathlands [21], issues of under and overprediction must be considered when determining the right course of action in any project or management [82]. We thus encourage further research to validate and calibrate the model over a wider range of heath, moorland, and peatland fuel types, as well as across more diverse fire weather scenarios. Changes in live fuel moisture content can significantly alter fire behaviour [83], such as those present in Calluna-dominated heathlands [61]; however, the Rothermel model shows limited responsivity to this driver. If fire behaviour is to be forecasted, further research must seek to develop models for live fuel moisture and better constrain its effects on fire spread. Our study was purposefully conducted with flat terrain and for steady-state headfires to simplify comparisons. Future studies should investigate the impacts of varying geography and for different sections of a fire (e.g., backfires and flanks), since fires on slopes and backing fires have been observed to display different fire behaviours [84]. Finally, collecting observations of fire behaviour from case-study wildfires and experimental fires with longer ignition line lengths is important. Such data will help to evaluate these models in operational settings and develop more robust relationships between fire behaviour predictions and direct observations.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/fire5020046/s1, Figure S1: Results of linear regression analyses examining the relationship of Anderson v. observed rates of spread; Table S1: Fuel structural characteristics for all prescribed burns; Table S2: Fire behaviour summary table used to generate model performance testing versus observed fire behaviour; Table S3: TukeyHSD post-hoc analyses following the ANOVA for rate of spread versus fire behaviour model and fuel class for observed fire behaviour comparisons; Table S4. TukeyHSD post-hoc analyses following the sensitivity analysis ANOVA; Table S5. Fire behaviour summary table used to generate all sensitivity analyses. All data and analytical scripts used in the paper are also provided in the Supplementary Material.

Author Contributions

Conceptualization, C.D.M.-D. and G.M.D.; methodology, C.D.M.-D. and G.M.D.; formal analysis, C.D.M.-D.; data curation, G.M.D.; writing—original draft preparation, C.D.M.-D.; writing—review and editing, C.D.M.-D. and G.M.D.; supervision, G.M.D.; funding acquisition, C.D.M.-D. and G.M.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Scottish Government and Scottish Natural Heritage through the FireBeaters project, the Game and Wildlife Conservation Trust, the Natural Environment Research Council (NER/S/C/2001/06470), and the Research Council of Norway (Grant number 298993).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw data, manipulated data, and R scripts used in this study’s analyses are openly available in FigShare at (https://doi.org/10.6084/m9.figshare.16635919) (accessed on 20 January 2022).

Acknowledgments

A large number of individuals contributed to fieldwork that allowed collection of the fuel bed and fire behaviour data used in this study. In particular, we thank Colin Legg, Adam Smith, Scott Newey, David Howarth, Alan Kirby, Harry Robertson, Carol Smithard, Isla Graham, Ellie Watts, Ella Steele, Bill Higham, Teresa Valor Ivars, and Elaine Boyd. We especially thank the FireBeaters; the Scottish Fire Danger Rating System; and the dynamic research teams at the University of Edinburgh, James Hutton Institute, the University of Bergen, and Western Norway University of Applied Sciences for their collaboration and assistance, namely Colin Legg, Michael Bruce, Angus MacDonald, Rory Hadden, Guillermo Rein, Jason Owen, Andy Taylor, Torgrim Log, Liv Guri Velle, Vigdis Vandvik, Anna Marie Gjedrem, and many others. We are extremely grateful to Ralia Enterprises and Whitborough Estate for allowing us to use their land for the experimental burning trials and to their staff and gamekeepers for their generous logistical support and advice. Finally, we would like to thank Stephen Matthews and Roger Williams for their detailed input during the development and review stages of this research. We thank the anonymous reviewers whose comments helped improve the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Viereck, L.A. Wildfire in the taiga of Alaska. Quaternary Res. 1973, 3, 465–495. [Google Scholar] [CrossRef]
  2. Weber, M.G.; Flannigan, M.D. Canadian boreal forest ecosystem structure and function in a changing climate: Impact on fire regimes. Environ. Rev. 1997, 5, 3–4. [Google Scholar] [CrossRef]
  3. Rolstad, J.; Blanck, Y.; Storaunet, K.E. Fire history in a western Fennoscandian boreal forest as influenced by human land use and climate. Ecol. Monogr. 2017, 87, 219–245. [Google Scholar] [CrossRef] [Green Version]
  4. Novenko, E.Y.; Tsyganov, A.N.; Volkova, E.M.; Kupriyanov, D.A.; Mironenko, I.V.; Babeshko, K.V.; Utkina, A.S.; Popov, V.; Mazei, Y.A. Mid-and Late Holocene vegetation dynamics and fire history in the boreal forest of European Russia: A case study from Meshchera Lowlands. Palaeogeogr. Palaeocl. Palaeoecol. 2016, 459, 570–584. [Google Scholar] [CrossRef]
  5. Davies, G.M.; Kettridge, N.; Stoof, C.R.; Gray, A.; Ascoli, D.; Fernandes, P.M.; Marrs, R.; Allen, K.A.; Doerr, S.H.; Clay, G.D.; et al. The role of fire in UK peatland and moorland management: The need for informed, unbiased debate. Philos. T. Roy. Soc. B 2016, 371, 20150342. [Google Scholar] [CrossRef] [Green Version]
  6. Koivula, M.; Vanha-Majamaa, I. Experimental evidence on biodiversity impacts of variable retention forestry, prescribed burning, and deadwood manipulation in Fennoscandia. Ecol. Proc. 2020, 9, 11. [Google Scholar] [CrossRef] [Green Version]
  7. Calvo, L.; T’arrega, R.; Luis, E. Regeneration patterns in a Calluna vulgaris heathland in the Cantabrian mountains (NW Spain): Effects of burning, cutting and ploughing. Acta Oecol. 2002, 23, 81–90. [Google Scholar] [CrossRef]
  8. Doerr, S.H.; Santín, C. Global trends in wildfire and its impacts: Perceptions versus realities in a changing world. Philos. T. Roy. Soc. B 2016, 371, 20150345. [Google Scholar] [CrossRef]
  9. de Groot, W.J.; Flannigan, M.D.; Cantin, A.S. Climate change impacts on future boreal fire regimes. For. Ecol. Manag. 2013, 294, 35–44. [Google Scholar] [CrossRef]
  10. Krikken, F.; Lehner, F.; Haustein, K.; Drobyshev, I.; van Oldenborgh, G.J. Attribution of the role of climate change in the forest fires in Sweden 2018. Nat. Hazard. Earth Sys. 2021, 21, 2169–2179. [Google Scholar] [CrossRef]
  11. Michetti, M.; Pinar, M. Forest Fires Across Italian Regions and Implications for Climate Change: A Panel Data Analysis. Environ. Resource Econ. 2019, 72, 207–246. [Google Scholar] [CrossRef] [Green Version]
  12. Johnstone, J.F.; Chapin, F.S.; Hollingsworth, T.N.; Mack, M.C.; Romanovsky, V.; Turetsky, M. Fire, climate change, and forest resilience in interior Alaska. Can. J. For. Res. 2010, 40, 1302–1312. [Google Scholar] [CrossRef]
  13. Stocks, B.J.; Fosberg, M.A.; Lynham, T.J.; Mearns, L.; Wotton, B.M.; Yang, Q.; Jin, J.-Z.; Lawrence, K.; Hartley, G.R.; Mason, J.A.; et al. Climate Change and Forest Fire Potential in Russian and Canadian Boreal Forests. Clim. Chang. 1998, 38, 1–13. [Google Scholar] [CrossRef]
  14. Viegas, D.X. Wildfires in Portugal. Fire Res. 2018, 2, 1. [Google Scholar] [CrossRef]
  15. Cogos, S.; Östlund, L.; Roturier, S. Forest Fire and Indigenous Sami Land Use: Place Names, Fire Dynamics, and Ecosystem Change in Northern Scandinavia. Hum. Ecol. 2019, 47, 51–64. [Google Scholar] [CrossRef] [Green Version]
  16. Paveglio, T.B.; Brenkert-Smith, H.; Hall, T.; Smith, A.M.S. Understanding social impact from wildfires: Advancing means for assessment. Int. J. Wildland Fire 2015, 24, 212–224. [Google Scholar] [CrossRef]
  17. Bond, W.J.; Keeley, J.E. Fire as a ‘global herbivore’: The ecology and evolution of flammable ecosystems. Trends Ecol. Evol. 2005, 20, 387–394. [Google Scholar] [CrossRef]
  18. Cronan, J.; Jandt, R. How Succession Affects Fire Behaviour in Boreal Black Spruce Forest of Interior Alaska; U.S. Department of the Interior, Bureau of Land Management, Alaska State Office: Anchorage, AK, USA, 2008. Available online: https://www.blm.gov/documents/national-office/blm-library/report/how-succession-affects-fire-behaviour-boreal-black (accessed on 15 November 2019).
  19. Granström, A. Fire Management for Biodiversity in the European Boreal Forest. Scand. J. Forest Res. 2001, 16, 62–69. [Google Scholar] [CrossRef]
  20. Franklin, J.F.; Spies, T.A.; Pelt, R.V.; Carey, A.B.; Thornburgh, D.A.; Berg, D.R.; Lindenmayer, D.B.; Harmon, M.E.; Keeton, W.S.; Shaw, D.C.; et al. Disturbances and structural development of natural forest ecosystems with silvicultural implications, using Douglas-fir forests as an example. For. Ecol. Manage. 2002, 155, 399–423. [Google Scholar] [CrossRef]
  21. Davies, G.M.; Legg, C.J.; Smith, A.A.; MacDonald, A.J. Development and participatory evaluation of fireline intensity and flame property models for managed burns on Calluna-dominated heathlands. Fire Ecol. 2019, 15, 30. [Google Scholar] [CrossRef]
  22. Gjedrem, A.M.; Log, T. Study of Heathland Succession, Prescribed Burning, and Future Perspectives at Kringsjå, Norway. Land 2020, 9, 485. [Google Scholar] [CrossRef]
  23. Robertson, G.S.; Newborn, D.; Richardson, M.; Baines, D. Does rotational heather burning increase red grouse abundance and breeding success on moors in northern England? Wildlife Biol. 2017, 1, 2017. [Google Scholar] [CrossRef] [Green Version]
  24. Davies, G.M.; Vandvik, V.; Marrs, R.; Velle, L.G. Fire management in heather-dominated heaths and moorlands of North-West Europe. In Prescribed Fire: Global Applications; Weir, J., Scasta, J.D., Eds.; CSIRO: Clayton, VIC, Australia, in press.
  25. Grau-Andrés, R.; Davies, G.M.; Waldron, S.; Scott, E.M.; Gray, A. Increased fire severity alters initial vegetation regeneration across Calluna-dominated ecosystems. J. Environ. Manage. 2019, 231, 1004–1011. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Marrs, R.H.; Marsland, E.-L.; Lingard, R.; Appleby, P.G.; Piliposyan, G.T.; Rose, R.J.; O’Reilly, J.; Milligan, G.; Allen, K.A.; Alday, J.G.; et al. Experimental evidence for sustained carbon sequestration in fire-managed, peat moorlands. Nat. Geosci. 2019, 12, 108–112. [Google Scholar] [CrossRef]
  27. Vandvik, V.; Heegaard, E.; Måren, I.E.; Aarrestad, P.A. Managing heterogeneity: The importance of grazing and environmental variation on post-fire succession in heathlands. J. Appl. Ecol. 2005, 42, 139–149. [Google Scholar] [CrossRef]
  28. Lydersen, J.M.; Collins, B.M.; Brooks, M.L.; Matchett, J.R.; Shive, K.L.; Povak, N.A.; Kane, V.R.; Smith, D.F. Evidence of fuels management and fire weather influencing fire severity in an extreme fire event. Ecol. Appl. 2017, 27, 2013–2030. [Google Scholar] [CrossRef]
  29. Harper, A.R.; Doerr, S.H.; Santin, C.; Froyd, C.A.; Sinnadurai, P. Prescribed fire and its impacts on ecosystem services in the UK. Sci. Total Environ. 2018, 624, 691–703. [Google Scholar] [CrossRef] [Green Version]
  30. Arnell, N.W.; Freeman, A.; Gazzard, R. The effect of climate change on indicators of fire danger in the UK. Environ. Res. Lett. 2021, 16, 044027. [Google Scholar] [CrossRef]
  31. Harper, A.R. Vegetation Fires in Temperate Upland Heaths: Environmental Impacts, Recovery, and Management Implications. Ph.D. Thesis, Swansea University, Swansea, UK, 2020. [Google Scholar]
  32. Log, T.; Thuestad, G.; Velle, L.G.; Khattri, S.K.; Kleppe, G. Unmanaged heathland—A fire risk in subzero temperatures? Fire Safety J. 2017, 90, 62–71. [Google Scholar] [CrossRef]
  33. Log, T. Modeling Drying of Degenerated Calluna vulgaris for Wildfire and Prescribed Burning Risk Assessment. Forests 2020, 11, 759. [Google Scholar] [CrossRef]
  34. Fujioka, F.M.; Gill, A.M.; Viegas, D.X.; Wotton, B.M. Chapter 21 Fire Danger and Fire Behavior Modeling Systems in Australia, Europe, and North America. Dev. Environm. Sci. 2008, 8, 471–497. [Google Scholar] [CrossRef]
  35. Anderson, W.R.; Cruz, M.G.; Fernandes, P.M.; McCaw, L.; Vega, J.A.; Bradstock, R.A.; Forgarty, L.; Gould, J.; McCarthy, G.; Marsden-Smedley, J.B.; et al. A generic, empirical-based model for predicting rate of fire spread in shrublands. Int. J. Wildland Fire 2015, 24, 443–460. [Google Scholar] [CrossRef] [Green Version]
  36. Andrews, P.L. The Rothermel Surface Fire Spread Model and Associated Developments: A Comprehensive Explanation; RMRS-GTR-371; U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station: Fort Collins, CO, USA, 2018. Available online: https://www.fs.usda.gov/treesearch/pubs/55928 (accessed on 18 November 2019).
  37. Sullivan, A.L. Wildland surface fire spread modelling, 1990–2007. 2: Empirical and quasi-empirical models. Int. J. Wildland Fire 2009, 18, 369–386. [Google Scholar] [CrossRef] [Green Version]
  38. Barclay-Estrup, P.; Gimingham, C.H. The description and interpretation of cyclical processes in a heath community. I. Vegetational change in relation to the Calluna cycle. J. Ecol. 1969, 57, 737–758. [Google Scholar] [CrossRef]
  39. de Hullu, E.; Gimingham, C.H. Germination and establishment of seedlings in different phases of the Calluna life cycle in a Scottish heathland. Vegetatio 1984, 58, 115–121. [Google Scholar] [CrossRef]
  40. Kayll, A.J.; Gimingham, C.H. Vegetative regeneration of Calluna vulgaris after fire. J. Ecol. 1965, 53, 729–734. [Google Scholar] [CrossRef]
  41. Hobbs, R.J. Post-Fire Succession in Heathland Communities. Ph.D. Thesis, University of Aberdeen, Aberdeen, UK, 1981. [Google Scholar]
  42. Whittaker, E. Temperatures in heath fires. J. Ecol. 1961, 49, 709–715. [Google Scholar] [CrossRef]
  43. Thomas, P.H. Rates of spread of some wind-driven fires. Forestry Int. J. For. Res. 1971, 44, 155–175. [Google Scholar] [CrossRef]
  44. Davies, G.M.; Legg, C.J.; Smith, A.A.; MacDonald, A.J. Rate of spread of fires in Calluna vulgaris-dominated moorlands. J. Appl. Ecol. 2009, 46, 1054–1063. [Google Scholar] [CrossRef]
  45. Gimingham, C.H.; Hobbs, R.J.; Mallik, A.U. Community dynamics in relation to management of heathland vegetation in Scotland. Vegetatio 1981, 46, 149–155. [Google Scholar] [CrossRef]
  46. Cruz, M.G.; Gould, J.S.; Alexander, M.E.; Sullivan, A.L.; McCaw, W.L.; Matthews, S. Empirical-based models for predicting head-fire rate of spread in Australian fuel types. Aust Forestry 2015, 78, 118–158. [Google Scholar] [CrossRef]
  47. Rios, O.; Valero, M.M.; Pastor, E.; Planas, E. A Data-Driven Fire Spread Simulator: Validation in Vall-llobrega’s Fire. Front. Mech. Eng. 2019, 5, 8. [Google Scholar] [CrossRef]
  48. Atchley, A.L.; Linn, R.; Jonko, A.; Hoffman, C.; Hyman, J.D.; Pimont, F.; Sieg, C.; Middleton, R.S. Effects of fuel spatial distribution on wildland fire behaviour. Int. J. Wildland Fire 2020, 30, 179–189. [Google Scholar] [CrossRef]
  49. Cruz, M.G.; Alexander, M.E.; Sullivan, A.L. Mantras of wildland fire behaviour modelling: Facts or fallacies? Int. J. Wildland Fire 2017, 26, 973–981. [Google Scholar] [CrossRef]
  50. Rothermel, R.C. A Mathematical Model for Predicting Fire Spread in Wildland Fuels; INT-115; U.S. Department of Agriculture, Forest Service, Intermountain Forest and Range Experiment Station: Ogden, UT, USA, 1972. Available online: https://www.fs.usda.gov/treesearch/pubs/32533 (accessed on 16 September 2019).
  51. Sullivan, A.L. Wildland surface fire spread modelling, 1990–2007. 1: Physical and quasi-physical models. Int. J. Wildland Fire 2009, 18, 349–368. [Google Scholar] [CrossRef] [Green Version]
  52. Andrews, P.L. Current status and future needs of the BehavePlus Fire Modeling System. Int. J. Wildland Fire 2013, 23, 21–33. [Google Scholar] [CrossRef] [Green Version]
  53. Finney, M.A. An Overview of Flammap Fire Modeling Capabilities. In Fuels Management—How to Measure Success: Conference Proceedings; RMRS-P-41; US Department of Agriculture, Forest Service, Rocky Mountain Research Station: Fort Collins, CO, USA, 2006; pp. 213–220. Available online: https://www.fs.usda.gov/treesearch/pubs/25948 (accessed on 25 January 2021).
  54. Finney, M.A. Farsite: Fire Area Simulator—Model Development and Evaluation; RMRS-RP-4; U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station: Fort Collins, CO, USA, 2004. Available online: https://www.fs.usda.gov/treesearch/pubs/4617 (accessed on 2 October 2019).
  55. Vacchiano, G.; Ascoli, D. An Implementation of the Rothermel Fire Spread Model in the R Programming Language. Fire Technol. 2015, 51, 523–535. [Google Scholar] [CrossRef]
  56. Vacchiano, G.; Ascoli, D. Package ‘Rothermel’; R Foundation for Statistical Computing: Vienna, Austria, 2015; Available online: https://cran.r-project.org/web/packages/Rothermel (accessed on 25 September 2019).
  57. R Foundation for Statistical Computing. R: A Language and Environment for Statistical Computing (Version 3.6.3); R Foundation for Statistical Computing: Vienna, Austria, 2020; Available online: https://www.r-project.org/ (accessed on 13 February 2020).
  58. Dimitrakopoulos, A.P.; Dritsa, S. Novel nomographs for fire behaviour prediction in Mediterranean and submediterranean vegetation types. Forestry Int. J. For. Res. 2003, 76, 479–490. [Google Scholar] [CrossRef]
  59. Fernandes, P.M. Examining fuel treatment longevity through experimental and simulated surface fire behaviour: A maritime pine case study. Can. J. For. Res. 2009, 39, 12. [Google Scholar] [CrossRef] [Green Version]
  60. Salis, M.; Arca, B.; Alcasena, F.; Arianoutsou, M.; Bacciu, V.; Duce, P.; Duguy, B.; Koutsias, N.; Mallinis, G.; Mitsopoulos, I.; et al. Predicting wildfire spread and behaviour in Mediterranean landscapes. Int. J. Wildland Fire 2016, 25, 1015–1032. [Google Scholar] [CrossRef]
  61. Legg, C.J.; Davies, G.M.; Kitchen, K.; Marno, P.; Scottish Wildfire Forum. Developing a Fire Danger Rating System for Vegetation Fires in the UK: FireBeaters Phase I Final Report. 2007. Available online: https://era.ed.ac.uk/handle/1842/3011 (accessed on 23 September 2019).
  62. Davies, G.M.; Gray, A.; Hamilton, A.; Legg, C.J. The future of fire management in the British uplands. Int. J. Biodivers. Sci. Manage. 2008, 4, 127–147. [Google Scholar] [CrossRef] [Green Version]
  63. Davies, G.M.; Domènech, R.; Gray, A.; Johnson, P.C.D. Vegetation structure and fire weather influence variation in burn severity and fuel consumption during peatland wildfires. Biogeosciences 2016, 13, 389–398. [Google Scholar] [CrossRef] [Green Version]
  64. Ascoli, D.; Beghin, R.; Ceccato, R.; Gorlier, A.; Lombardi, G.; Lonati, M.; Marzano, R.; Bovio, G.; Cavallero, A. Developing an Adaptive Management approach to prescribed burning: A long-term heathland conservation experiment in north-west Italy. Int. J. Wildland Fire 2007, 18, 727–735. [Google Scholar] [CrossRef]
  65. Bilgili, E.; Saglam, B. Fire behavior in maquis fuels in Turkey. For. Ecol. Manage. 2003, 184, 201–207. [Google Scholar] [CrossRef]
  66. Fernandes, P.A.M. Fire spread prediction in shrub fuels in Portugal. For. Ecol. Manage. 2001, 144, 67–74. [Google Scholar] [CrossRef]
  67. Pepin, A.-C.; Wotton, M. Fire Behaviour Observation in Shrublands in Nova Scotia, Canada and Assessment of Aids to Operational Fire Behaviour Prediction. Fire 2020, 3, 34. [Google Scholar] [CrossRef]
  68. Allen, K.A.; Denelle, P.; Ruiz, F.M.S.; Santana, V.M.; Marrs, R.H. Prescribed moorland burning meets good practice guidelines: A monitoring case study using aerial photography in the Peak District, UK. Ecol. Indic. 2016, 62, 76–85. [Google Scholar] [CrossRef] [Green Version]
  69. EUFirelab. Physical, Chemical and Thermal Characteristics of the Wildland Fuel Particles: Answer from the Partners; Deliverable D-02-02_A; EUFirelab: Avignon, France, 2002; unpublished report. [Google Scholar]
  70. Hamner, B.; Frasco, M.; LeDell, E. Package ‘Metrics’: Evaluation Metrics for Machine Learning; R Foundation for Statistical Computing: Vienna, Austria, 2018; Available online: https://cran.r-project.org/web/packages/Metrics (accessed on 1 November 2020).
  71. Ranganathan, P.; Pramesh, C.S.; Aggarwal, R. Common pitfalls in statistical analysis: Measures of agreement. Persp. Clin. Res. 2017, 8, 187–191. [Google Scholar] [CrossRef]
  72. Davies, G.M.; Legg, C.J.; Smith, A.; MacDonald, A. Developing shrub fire behaviour models in an oceanic climate: Burning in the British uplands. For. Ecol. Manage. 2006, 234 (Suppl. S1), SI07. [Google Scholar] [CrossRef] [Green Version]
  73. Fox, J.; Weisburg, S. An R Companion to Applied Regression, 3rd ed.; Sage: Thousand Oaks, CA, USA, 2019. [Google Scholar]
  74. Grau-Andrés, R.; Gray, A.; Davies, G.M.; Scott, E.M.; Waldron, S. Fire severity is more sensitive to low fuel moisture content on Calluna heathlands than on peat bogs. Sci. Total Environ. 2018, 616–617, 1261–1269. [Google Scholar] [CrossRef] [Green Version]
  75. Davies, G.M.; Legg, C.J.; O’Hara, R.; MacDonald, A.J.; Smith, A.A. Winter desiccation and rapid changes in the live fuel moisture content of Calluna vulgaris. Plant Ecol. Divers. 2011, 3, 289–299. [Google Scholar] [CrossRef]
  76. Scott, J.H.; Burgan, R.E. Standard Fire Behaviour FuelModels: A Comprehensive Set for Use with Rothermel’s Surface Fire Spread Model; RMRS-GTR-153; U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Center: Fort Collins, CO, USA, 2005. Available online: https://www.fs.usda.gov/treesearch/pubs/9521 (accessed on 15 June 2020).
  77. Jolly, W.M. Sensitivity of a surface fire spread model and associated fire behaviour fuel models to changes in live fuel moisture. Int. J. Wildland Fire 2007, 16, 503–509. [Google Scholar] [CrossRef] [Green Version]
  78. Alexander, M.E.; Cruz, M.G. Assessing the effect of foliar moisture on the spread rate of crown fires. Int. J. Wildland Fire 2012, 22, 415–427. [Google Scholar] [CrossRef]
  79. Catchpole, E.A.; Catchpole, W.R. Modelling Moisture Damping for Fire Spread in a Mixture of Live and Dead Fuels. Int. J. Wildland Fire 1991, 1, 101–106. [Google Scholar] [CrossRef]
  80. Rossa, C.G.; Fernandes, P.M. Short communication: On the effect of live fuel moisture content on fire-spread rate. For. Sys. 2017, 26, eSC08. [Google Scholar] [CrossRef] [Green Version]
  81. Viegas, D.X. Forest fire propagation. Philos. T. Roy. Soc. A 1998, 356, 2907–2928. [Google Scholar] [CrossRef]
  82. Sutherland, W.J.; Bailey, M.J.; Bainbridge, I.P.; Brereton, T.; Dick, J.A.T.; Drewitt, J.; Dulvy, N.K.; Dusic, N.R.; Freckleton, R.P.; Gaston, K.J.; et al. Future novel threats and opportunities facing UK biodiversity identified by horizon scanning. J. Appl. Ecol. 2008, 45, 821–833. [Google Scholar] [CrossRef]
  83. Viegas, D.X.; Piñol, J.; Viegas, M.T.; Ogaya, R. Estimating live fine fuels moisture content using meteorologically-based indices. Int. J. Wildland Fire 2001, 10, 223–240. [Google Scholar] [CrossRef]
  84. Rossa, C.G.; Davim, D.A.; Viegas, D.X. Behaviour of slope and wind backing fires. Int. J. Wildland Fire 2015, 24, 1085–1097. [Google Scholar] [CrossRef]
Figure 1. Results of linear regression analyses examining the relationship between predicted and observed rate of spread from six fire behaviour models. Coloured lines represent the regression and dashes represent 95% confidence intervals. The black line is the 1:1 LPA and individual observations of fire behaviour are shown as dots. Davies 1 and Davies 2 were built using the same fire behaviour observations; therefore, this analysis does not provide independent verification of their performance—these results are given to contextualize the performance of the other models. Further, the correction for Anderson is not shown as error was greatly increased.
Figure 1. Results of linear regression analyses examining the relationship between predicted and observed rate of spread from six fire behaviour models. Coloured lines represent the regression and dashes represent 95% confidence intervals. The black line is the 1:1 LPA and individual observations of fire behaviour are shown as dots. Davies 1 and Davies 2 were built using the same fire behaviour observations; therefore, this analysis does not provide independent verification of their performance—these results are given to contextualize the performance of the other models. Further, the correction for Anderson is not shown as error was greatly increased.
Fire 05 00046 g001
Figure 2. Sensitivity responses to changing fuel structural and fire weather inputs. High and Low fuel classes are aggregate fuel classes from Legg et al. [61]. Displayed fire behaviour models were selected to minimize clutter and overlaps. Full results are presented in the Supplementary Material (Table S5). Here, to gauge the interaction of fire weather parameters, lower (LQ) and upper quartiles (UQ) of wind speed were selected as constants to compare the effects of changing live woody (LW) fuel moisture contents (FMC) on the predicted rates of spread. Because a smaller effect on the rate of spread by live woody FMC was recorded, minimum and maximum values were selected for live woody FMC to compare the effects of changing wind speeds on the predicted rates of spread. A jitter was applied on the x-axis for clarity.
Figure 2. Sensitivity responses to changing fuel structural and fire weather inputs. High and Low fuel classes are aggregate fuel classes from Legg et al. [61]. Displayed fire behaviour models were selected to minimize clutter and overlaps. Full results are presented in the Supplementary Material (Table S5). Here, to gauge the interaction of fire weather parameters, lower (LQ) and upper quartiles (UQ) of wind speed were selected as constants to compare the effects of changing live woody (LW) fuel moisture contents (FMC) on the predicted rates of spread. Because a smaller effect on the rate of spread by live woody FMC was recorded, minimum and maximum values were selected for live woody FMC to compare the effects of changing wind speeds on the predicted rates of spread. A jitter was applied on the x-axis for clarity.
Fire 05 00046 g002
Table 1. Input constants for Roth, BehavePlus, and Farsite. Live herbaceous fuels were combined, based on relative sizes, with 10 and 100 h fuels due to a lack of representation. SAV is surface-area-to-volume ratio. Table adapted from Legg et al. [61].
Table 1. Input constants for Roth, BehavePlus, and Farsite. Live herbaceous fuels were combined, based on relative sizes, with 10 and 100 h fuels due to a lack of representation. SAV is surface-area-to-volume ratio. Table adapted from Legg et al. [61].
Input DescriptionValueData Source
1 Hour SAV (m−1)9560EUFirelab [69]
10, 100-Hour and Live Herbaceous SAV (m−1)8810EUFirelab [69]
Live Woody SAV (m−1)1000EUFirelab [69]
Calluna Heat of Combustion (kJ kg−1)20,810Hobbs [41]
Moisture of Extinction (%)30Legg et al. [61]
Table 2. Performance of each modeling technique versus observed fire behaviour. ‘Model’ is fire behaviour linear model. ‘R2′ is the adjusted correlation for each regression. ‘b’ is the coefficient of each regression. ‘df’ is n − 2 degrees of freedom. ‘t’ is the test statistic for performance testing. ‘pslope’ is a significance value for differences between the slope of each regression line and the 1:1 LPA, based on the t-statistic. For any non-significant p-value based on α = 0.05, ‘LPA’ represents where the LPA resides relative to the 95% confidence intervals of each regression line: W is within, A is above, and B is below. Corrected is Anderson versus corrected observations of rates of spread for ignition line lengths used in our experimental burns from Equation (4) [35].
Table 2. Performance of each modeling technique versus observed fire behaviour. ‘Model’ is fire behaviour linear model. ‘R2′ is the adjusted correlation for each regression. ‘b’ is the coefficient of each regression. ‘df’ is n − 2 degrees of freedom. ‘t’ is the test statistic for performance testing. ‘pslope’ is a significance value for differences between the slope of each regression line and the 1:1 LPA, based on the t-statistic. For any non-significant p-value based on α = 0.05, ‘LPA’ represents where the LPA resides relative to the 95% confidence intervals of each regression line: W is within, A is above, and B is below. Corrected is Anderson versus corrected observations of rates of spread for ignition line lengths used in our experimental burns from Equation (4) [35].
Linear ModelR2bIntercept ± Errordf (n − 2)tpslopeLPA
Davies 10.580.581.69 ± 0.51250.250.80A
Davies 20.690.681.27 ± 0.48250.200.84A
Anderson0.461.395.46 ± 1.5525−0.080.94B
Roth0.450.600.94 ± 0.68250.150.88A
BehavePlus0.390.500.69 ± 0.64250.230.94A
Farsite0.390.410.64 ± 0.53250.340.94A
Corrected0.310.277.72 ± 1.74250.140.89A
Table 3. ANOVA comparing the effects of the fire behaviour model (Model), fuel class (Low, Medium, or High load), and their interaction on rate of spread predictions using observed fuel structures. ‘df’ is n−1 degrees of freedom. ‘F Value’ is the test statistic computed. ‘Pr (>F)’ is a significance value for each test set against α = 0.05. N = 27.
Table 3. ANOVA comparing the effects of the fire behaviour model (Model), fuel class (Low, Medium, or High load), and their interaction on rate of spread predictions using observed fuel structures. ‘df’ is n−1 degrees of freedom. ‘F Value’ is the test statistic computed. ‘Pr (>F)’ is a significance value for each test set against α = 0.05. N = 27.
Response:
Rate of Spread
dfF ValuePr (>F)
Model528.608<0.001
Fuel233.747<0.001
Model × Fuel100.9030.532
Table 4. ANOVA comparing the effects of fire behaviour model (Model), fuel class (Low, Medium, or High load), and their interaction on rate of spread predictions for the broader range of fire weather conditions. ‘df’ is n − 1 degrees of freedom. ‘F Value’ is the test statistic computed. ‘Pr (>F)’ is a significance value for each test set against α = 0.05. N = 50.
Table 4. ANOVA comparing the effects of fire behaviour model (Model), fuel class (Low, Medium, or High load), and their interaction on rate of spread predictions for the broader range of fire weather conditions. ‘df’ is n − 1 degrees of freedom. ‘F Value’ is the test statistic computed. ‘Pr (>F)’ is a significance value for each test set against α = 0.05. N = 50.
Response:
Rate of Spread
dfF ValuePr (>F)
Model5230.793<0.001
Fuel 2134.830<0.001
Model × Fuel101.9180.040
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Minsavage-Davis, C.D.; Davies, G.M. Evaluating the Performance of Fire Rate of Spread Models in Northern-European Calluna vulgaris Heathlands. Fire 2022, 5, 46. https://doi.org/10.3390/fire5020046

AMA Style

Minsavage-Davis CD, Davies GM. Evaluating the Performance of Fire Rate of Spread Models in Northern-European Calluna vulgaris Heathlands. Fire. 2022; 5(2):46. https://doi.org/10.3390/fire5020046

Chicago/Turabian Style

Minsavage-Davis, Charles D., and G. Matt Davies. 2022. "Evaluating the Performance of Fire Rate of Spread Models in Northern-European Calluna vulgaris Heathlands" Fire 5, no. 2: 46. https://doi.org/10.3390/fire5020046

Article Metrics

Back to TopTop