1. Introduction
Earth’s atmosphere is a turbulent, ever-changing system whose future states can be difficult to forecast (e.g., [
1]). Past research has examined planetary-scale flow patterns, also referred to as large-scale flow regimes, and their tendency to reoccur and/or persist in certain regions of the Northern Hemisphere (NH) (e.g., [
2]). Planetary scale flow patterns in the NH, such as teleconnection regimes or those associated with atmospheric blocking anticyclones, have been found to have positive correlations between the weather and climate of the North Pacific and the mid-western and eastern USA [
3,
4,
5]. Knowing when these patterns may reoccur and how they affect certain regions upstream or downstream would be applicable in long-range forecasting (e.g., [
6,
7]). When generating forecasts for ten days or more, these phenomena and their evolution are helpful in explaining the underlying dynamics involved in long-range forecasting methods, such as: analogs, climatology, contingency, numerical, persistence, or statistical. Having an additional tool to forecast or project regime transition would continue to improve short-range predictions and sub-seasonal forecasts. Atmospheric predictability is limited by, at least in part, an incomplete representation, or even a full understanding of relevant physical processes in the atmosphere (e.g., [
8]).
However, atmospheric predictability using primitive equation (PE) models has been a difficult question to address historically. The work of [
9,
10] demonstrated the concept of sensitive dependence on initial conditions (SDOIC), the paradigm that small differences in the initial state of two atmospheres representing solutions to the primitive equations can develop along very different trajectories over time. In [
10], it was shown that error in the initial conditions can double in approximately four days. While the capability of weather forecast models since [
9] and [
10] have improved greatly, even today operational models can be considered to be reliable out to about five to seven days [
11,
12]. These estimates of predictability are based on synoptic-scale phenomena such as mid-latitude cyclones and anticyclones for example. Another recent study (e.g., [
13] and references therein), states that typically forecasters rely on numerical models as guidance for synoptic scale predictions, which can be made reliably for up to seven days but with the absolute limit for dynamic weather forecasting being about 10–14 days.
Predictability beyond the forecast limit described above has been demonstrated to be possible for persistent low-frequency flow regimes using a combination of statistical and dynamic (hybrid) techniques (e.g., [
14,
15]). The former study examined the ability of coarse resolution three-layer PE model and statistics compiled by the model to show moderate skill in forecasting large-scale flow regime transitions. The latter study found success in skillfully forecasting severe weather outbreaks at week two and into week three using similar techniques to [
14]. However, [
15] used a 30-year set of observed 500 hPa heights and the European Centre for Medium Range Weather Forecast (ECMWF) sub-seasonal forecast system.
In order to enhance our projections of how large-scale flow will progress and change, deriving a simple tool that can be used with numerical forecast model output in order to identify regime transitions would be helpful. In recent studies, it has been shown that the NH integrated enstrophy (IE) as in [
2], or a regional variant of IE (IRE) can be used as a measure for identifying, in general, the transition of large-scale flows [
16,
17,
18,
19,
20]. These same references have indicated also that IRE can be used to identify blocking onset or decay or suggest flow instability or predictability. Additionally, it was suggested observationally by [
2,
18,
21] that blocking regimes will decay when there is a strong change in large-scale flow regime. Further, [
16,
18,
21] proposed that blocking does not survive large-scale flow regime transition. Although [
22] demonstrates that blocking can survive flow regime transition if the synoptic-scale dynamics are favorable. More theoretically based studies (e.g., [
23,
24,
25]) have suggested similar findings with regard to changes in large-scale flow regimes.
Blocking can be defined as a dynamic ridging in the jet stream or as stated by [
26] is a persistent large-scale mid-latitude positive geopotential height anomaly. Blocking is supported by the phasing of between the synoptic-scale storm tracks with a large-scale quasi-stationary ridge (e.g., [
27,
28,
29] and references therein). It is important to note that blocking is driven in part by large-scale flow patterns, but not the general circulation. In the NH, many have shown that blocking involves the strong interactions between planetary-scale and synoptic-scale forcing processes (e.g., [
27,
30,
31,
32,
33,
34,
35]) while the Southern Hemisphere blocking results from primarily the superposition between the two scales [
28,
36]. The decay of blocking is a more complex problem than block onset or maintenance involving synoptic and planetary-scale interactions than block onset or maintenance (e.g., [
3,
18,
19,
37]), which is why blocking cannot be used as a one-to-one indicator of flow regime transition (e.g., [
2,
20,
30]). Therefore, regime transition or block onset and decay [
14,
37,
38] can create forecasting challenges for projecting regional weather patterns out to ten days and beyond.
Past research continues to point in the direction of IE or IRE as being a useful tool in indicating blocking onset/decay, but this can also be a useful tool in projecting regime transition [
2,
39]. For example, in [
18,
19] they found IRE to be a reliable indicator of blocking onset and decays by showing local maxima in the IRE values. In [
18], Southern Hemisphere IRE relative maxima were observed within 48 h of onset and decay of three blocking events, while in [
19] and [
30] these relative IRE maxima were observed within 48 h of a NH block onset and decay in the 500 hPa planetary-scale or synoptic scale partitioned flow fields. They, [
19,
30], also noted that IRE values were comparatively low during maintenance periods. Additionally, studies found that relative maxima in IE or IRE could identify flow regime transitions overall, whether blocking was present or not [
2,
16,
20,
39].
Since research suggests that IE or IRE is a good indicator of blocking onset/decay as well as regime transitions even if blocking in not present, this research will investigate the utility of NH IE as a reliable method for projecting large-scale regime transitions. This is the main purpose of this research. In order to accomplish that goal, four case studies and ensemble model forecasts during the months of May 2018 through April 2019 were utilized. These case studies used in this research were analyzed in order to test IE skill, and whether or not this is a useful operational indicator of NH regime transitions and the relationship to Missouri region temperature and precipitation character. In performing this research, a threshold for IE change with time during regime transition will be identified as well as an examination of how much lead-time an ensemble model forecast system can provide for these transitions.
Section 2 will list the data sets used in this research including the ensemble modeling system. The methodology is also outlined in
Section 2, as well as a description of the selection of our events in order to test IE forecasting skill. The measures for skill were based on the forecast verification methods used and described in [
40].
Section 3 will describe and analyze the cases and
Section 4 will summarize the findings of this research and present the conclusions.
3. Results
3.1. Flow Regime Identification
In order to assess the model forecasts, flow regime transitions needed to be identified as local maxima in the NH IE time series as in [
16,
20,
39]. An examination of the observed IE time series for each month from May 2018 to April 2019 as well as the 24 h change in IE (e.g.,
Figure 1) with time resulted in 34 identifiable regime transitions. Then, individual flow regimes persisted for an average of 10.7 days, and these lasted from four days at the shortest to 20 days for the longest. These numbers are consistent with the results of [
2] and many studies cited there. The example shown in
Figure 1a is from January 2019. There were three distinct local maxima in the observed IE time series that were greater than one standard deviation from the minima preceding or following the local maximum. These three maxima represent the approximate time of the NH flow regime change (see [
2,
20,
39]).
Figure 1b shows the 24 h change in IE, and each of the maxima in
Figure 1a are associated with a change in sign of 24 h IE change as in [
39].
In order to confirm these transitions, the 500 hPa height fields and height anomaly fields were examined as well as the major teleconnection indexes as in [
37,
53] (see also
Figure 2). Note that the previous to the IE maximum on 4 January, all three major indexes were generally increasing, then between 4 and 10 January, two of these indexes decrease (North Atlantic Oscillation (NAO) and Arctic Oscillation (AO)), while the Pacific North American (PNA) Index exhibits a “v” shaped pattern, switching sign on 7 January. Then between 10 and 22 January, two of the three indexes (NAO, AO) were generally increasing again mirroring each other, while the PNA decreased. Finally, during late January the three indexes generally are static or decreasing.
3.2. Signal Detection and Skill Results
As stated in
Section 2, the NAEFS ensembles were available out to 14 days. In order to simplify the analysis here, we examined the ensemble mean forecast IE from one to 10 days in order to determine whether the ensemble model could detect regime transition at this range. The strategy used here was similar to [
37] in that the forecast evaluation began 10 days before the identified regime transition, and then examples were presented for 10, seven, four, and one day out from the identified observed IE maximum/regime transition. Given that some flow regimes persisted for less than 10 days, some of the associated 10 and seven-day IE forecasts overlap two IE maxima or regime transitions. Thus, this section will examine the 10 day mean ensemble NH IE forecast ‘plumes’ relative to individual regime transitions only. An example (
Figure 3) of the daily NAEFS mean 10-day ensemble NH IE ‘plumes’ is shown for all of January 2019. Note, these generally identify the observed IE maxima in
Figure 1. Additionally, an observed IE maximum occurred on 1 February and that also was identified by NAEFS ensemble mean forecast NH IE.
Initially, the mean ensemble IE 10-day forecasts were evaluated in order to determine whether or not the ensemble model forecast produced a local IE maximum and how close temporally this maximum was to the observed NH IE maximum. These results are shown in
Figure 4 and
Table 2. In
Figure 4 and
Table 2, most model IE forecast maxima were predicted by the NAEFS ensemble mean within one day of actual maximum. This is confirmed by examining the mean forecast lag/lead shown in
Table 2. The standard deviation for all these forecasts was between one and two days (1.4 days). Thus, here a ‘correct’ forecast for the IE maximum was counted within one day of the observed IE maximum.
The one-day forecast POD was the best at 0.90; however, the second-best POD was noted for the seven-day model forecasts (0.85). As expected, the POD decreased substantially after this and the 10-day forecasts performed the worst at 0.38. The miss rate (MISS) counted maxima that were either not forecast at all or forecast outside the one-day verification window, while the FAR was only the count of forecasts outside the one-day window. The 10-day forecasts were consistently under-forecast in the sense that the mean ensemble IE forecast maximum was 1.5 days too early. The other forecast categories projected the model IE maximum to occur too late. Only nine of the observed IE maxima were correctly forecast at 10 days. The seven-day forecasts were best in that the mean forecast IE maximum occurred in the model at seven days. For the one-day forecasts, only four mean ensemble IE forecasts occurred outside the +/− one day window. Three of these were forecast at day four or day five (counted as a MISS and FAR) and in one instance was not forecast in the entire 10 days (MISS).
Then using (4), the sensitivity index demonstrates that the one, four, and seven-day mean IE ensemble forecasts, respectively, successfully project signal above the noise, a result significant at p = 0.01, 0.1, and 0.05, respectively. Only the 10-day forecasts were not statistically significant. The forecast bias was calculated as the (POD + MISS)/(POD + FAR), and the bias was 1.0, 1.03, and 0.99 for the one, four, and seven-day forecasts, respectively, indicating little bias in these forecasts. Finally, if all the forecast performances are combined, the sensitivity index indicates significance at p = 0.10 (POD = 0.73 and FAR = 0.25).
3.3. IE Skill
The skill score (3) is a measure representing the value added for a particular forecast over some baseline or how close to perfection the forecast is from the baseline [
49]. In order to examine the ability of the NAEFS mean ensemble model to capture the magnitude or value of the observed IE maximum, the skill scores and mean absolute error is shown in
Table 3. As expected, the one-day forecasts performed the best, while the skill deteriorated with forecast lead time out to seven days. There was little difference in the skill of the seven-day forecast of mean ensemble forecast IE versus the 10-day forecasts.
The work of [
40] found that climatology was difficult to beat when considering the skill for forecasts of surface temperature anomalies in long-range forecasting, while it is well known that for short-range forecasts climatology is not difficult to beat. However, [
40] also showed that the skill for forecasts of events that were two or more standard deviations above and below normal were better forecast using teleconnections. It was expected here that climatology would provide a reasonable baseline.
If a forecast evaluated as two (zero) points was considered a ‘hit’ (‘bust’), there were 10 (9) forecast hits (busts) for climatology out of the 34-ensemble mean IE forecast maxima. For the 10, seven, four, and one-day ensemble mean NH IE forecasts, 18, 20, 23, and 24 could be considered a ‘hit’, respectively. The busted forecast counts were four, four, four, and one were considered a bust respectively.
In summary,
Section 2.2 established a quantitative measure for identifying local maxima for NH IE that previous studies in this group had only identified qualitatively. Moreover, this section demonstrated that the NAEFS ensemble identified a similar number of NH IE maxima from May 2018–April 2019 (34) to the mean annual occurrence of these maxima (30–35) found in a 30-year climatological study in [
2]. Thus, the criteria established here likely is robust.
The NAEFS mean ensemble showed skill in projecting major changes in the large-scale NH flow as much as ten days in advance as identified using the NH IE diagnostic of [
16] and used in this form or as a regional variant by this research group in many studies. The model performed more reliably at lesser lead times as expected. Using the skill score to evaluate the NAEFS ensemble model ability to anticipate the relative strength of the maximum showed that the skill scores were greater than 0.50 for the four and one-day forecasts with respect to climatology. Even at seven days, the skill score is nearly 0.50 and the number of forecasts counted as a “HIT” were consistent with the four and one-day forecasts. The POD results also demonstrated that the NAEFS ensemble model mean forecasts could identify the regime transitions above the noise at one, four, and seven days at statistically significant levels. Overall, this indicates that the NAEFS ensemble mean IE as calculated using the 500 hPa flow forecasts are reliable out to seven days, which is consistent with the time frame given for the reliability of other operational model forecasts of 500 hPa height fields as measured using their criterion for anomaly correlation [
11].
4. NH IE as an Indicator of Regional Synoptic Changes
In this section, the efficacy of IE maxima to indicate NH flow regime changes and the relationship to changes in weather and climate of our region (Missouri, USA—see
Figure 5A) is examined here. Four cases were chosen and the mean temperature and accumulated precipitation characteristics for the 10-day period before and after the observed IE maximum are given in
Figure 5 and
Figure 6 and
Table 4. Ten days was chosen since it is the length of the model forecast period and a flow regime transition occurred approximately every 10.7 days as shown in
Section 3. Two cases (23 September 2018 and 14 February 2019) were chosen since they corresponded to strong changes in the weather across our region and these changes were well-forecast in the one to three-day (short-range) time period by the NAEFS ensemble mean. One case (21 August, 2018) was chosen such that the observed IE maximum was missed by the day-one mean ensemble model forecast (a maximum does not occur until day-six). The last case was a strong IE maximum case chosen completely at random (27 October, 2018). These cases are discussed in calendar order.
For the 10 days preceding the first case study (21 August),
Figure 5A and
Table 4 showed a relatively zonal 500 hPa ridge-trough configuration over northern North America (
Figure 5A). The sea level pressure (SLP) map shows that the Midwest USA is dominated by a trough (
Figure 6A). During the 10-day period following this transition, the 500 hPa flow showed a slightly more amplified pattern (
Figure 5B) that was 180 degrees out of phase with the previous period as reflected by the strong change in the PNA index (
Figure 5A,B, and
Table 4). The SLP (
Figure 6B) shows the Missouri region on the upstream side of high pressure. What was not clear immediately is why the model mean ensemble missed the IE maximum on day one. This should be the subject of a follow-up study.
The temperature and precipitation regime for the study region changed very little prior and following 21 August (
Table 4). The temperature regime was very close to the normal for each city for this time of year (
Table 4) and the temperature was generally less than one standard deviation from the normal temperature. Only one subtle change was noted in that precipitation was observed on six days of ten before the observed IE maximum and four days of ten following within the region. Additionally, 25.4–36.8 mm of precipitation would be expected across the state for the 10 days before and after 21 August [
55]. The amount of precipitation before and after the transition date could be described as typical except for southwest Missouri (SGF), which received approximately double the typical amount of precipitation. No blocking was observed in the Pacific or Atlantic sectors during this period of time and [
40,
56] demonstrated the correlation of the large-scale flow regime upstream and downstream of the central USA.
The second case (23 September, 2018) occurred during a very warm September across the region, and a strong cold front passed through Missouri close to this date. The jet stream before this date was located far to the north (
Figure 5C). Before the IE maximum, a trough was located over western North America (
Figure 5C) at 500 hPa, but over the middle of the continent in the ten days following (
Figure 5D). The SLP fields (
Figure 6C,D) shows that the study region was downstream of a weak trough and generally northeasterly flow [
55] before the IE maximum, but with more of a southerly flow component following the maximum.
Table 4 shows that the PNA and AO became more positive and the NAO more negative following 23 September. Before 23 September, 2018, the temperatures across the region were more than three (and even four) standard deviations greater than normal.
This flow regime prior to 23 September was also quite dry and measurable precipitation was noted regionwide for only two of the ten days. It would be expected that 26.4–39.1 mm of precipitation would have occurred during the ten-day period prior; however, conditions were generally dry across the state (
Table 4). Following the large-scale flow regime change (
Table 4), temperatures decreased significantly (as much as 5 °C). The days following 23 September were still relatively dry (
Table 4—also two days of measurable precipitation regionally) and warm, but only one to just under three standard deviations above normal. During the ten-day period following the change in flow regime, blocking was noted over the eastern Pacific [
57]. This correlates often with cooler conditions over the central USA [
56].
The third case (27 October, 2018) was associated with cooler conditions regionally 10-days prior to the observed IE maximum, but then warmer conditions during the 10 days following the maximum. The large-scale flow for the period prior to the IE maximum (
Figure 5E) was characterized as an amplified 500 hPa ridge-trough pattern, and high pressure dominated the study region in the SLP field (
Figure 6E).
Table 4 showed a strongly more negative PNA index, a more negative AO index, and a more positive NAO. Following the 27 October period, the large-scale flow showed a trough over the middle North America, but zonal flow upstream (
Figure 5F). In the SLP map, the middle of the United States was dominated by a trough (
Figure 6F).
For the 10-days prior to the IE maximum (
Table 4), the temperatures were generally about one to two standard deviations below normal regionally except for northwest Missouri. Following the IE maximum and the large-scale flow regime change temperatures were close to normal across the state. The biggest change was in the precipitation characteristics. Conditions before the observed IE maximum were dry (
Table 4), and regionally, measurable precipitation occurred during three days. For a ten-day period in October, 26.7–30.0 mm of precipitation would be expected across the state [
55]. Following the IE maximum, conditions were much wetter except for the northwest part of the state (
Table 4) and precipitation occurred on six of the ten days. Additionally, blocking occurred over the eastern Pacific during mid-October [
57], which could be linked to the cooler conditions prior to 27 October 2018.
The last case study was associated with a strong IE maximum observed in mid-February 2019. During the 10-days before the 14 February IE maximum, there was a 500 hPa trough located over the eastern Pacific and western North America (
Figure 5G). The SLP map (
Figure 6G) showed the study region was between a strong high-pressure region to the northwest and high pressure to the southeast.
Table 4 demonstrates that the period was within the range of normal (generally less than one standard deviation below normal for three of the cities, except for Kansas City, which was about one sigma below normal. The 10-day period was comparatively wet, but little snow was observed across the region (not shown here—see [
52]). This period was also much wetter than normal as the state experiences 12.4 to 21.3 mm of precipitation in early February [
55]. Additionally, this case was the best anticipated by the NAEFS mean ensemble forecast IE as the 10-day, 4-day forecast each anticipated the observed IE maximum, while the seven-day forecast anticipated the IE maximum on day-eight.
For the 10-day period following the observed IE maximum (
Figure 5H), the 500 hPa trough was located further east over North America and
Table 4 indicates all three teleconnection indexes became more positive, especially the AO. The SLP map (
Figure 6H) shows that the study region was under the influence of the high pressure to the north to a greater extent even though the high itself had weakened. Moreover, the temperature regime cooled considerably as three of the cities were nearly or more than one-standard deviation cooler than normal and northwest Missouri (EAX) was more than two standard deviations below normal. The precipitation regime was a little drier but over the northern part of the state, but snow was observed ranging from 6 cm in the eastern part of the region to 20 cm or more in the western part of the region [
55]. Lastly, two mid-February blocking events [
55], one over the east Pacific and one over the eastern Atlantic were both partly responsible for bringing colder conditions over the central USA.
In summary, three of these case studies demonstrated that relatively large changes in the temperature and precipitation character of the local weather can reasonably be anticipated in association with the observed maxima in NH IE. This result combined with
Section 3 demonstrates that these changes can be anticipated in the long-range of synoptic-scale forecasting (seven to 10 days). In fact, the mid-February change was anticipated more than seven days ahead in real-time following the model guidance during the performance of this research. In only one of these four cases did the NAEFS ensemble miss the large-scale NH flow regime change in the short range. Moreover, there was not a very strong change in regional temperature and precipitation regimes as associated with this missed short-term observed IE maximum.
5. Summary and Conclusions
In this study, the ability of the NAEFS ensemble model to project the occurrence of observed IE maxima in the large-scale NH flow was tested using traditional measures of skill as well as signal detection theory. The latter is typically used for smaller scale-phenomena, but was useful in anticipating the timing of the model forecast of observed IE maxima. The model ensemble mean 500 hPa height fields were used, and the IE diagnostic derived in [
16] and employed by [
2] in this research group to identify large-scale flow regime transitions or blocking. The model data had relatively fine resolution (1° × 1° latitude–longitude). The observed IE was calculated using the NCEP reanalyses 500 hPa height fields available on a grid with resolution of 2.5° latitude/longitude.
Once these IE maxima were identified using a quantitative criterion and confirmed by examining the major NH teleconnection indexes, the timing and strength of the model forecast maxima were analyzed and summarized by presenting the results for the ten, seven, four, and one day model forecasts. The development of this quantitative criterion for identifying IE maxima was not done by other work previously published by this research group. Then four case studies were examined in order to determine whether these observed IE maxima were associated with strong changes in regional (central USA) temperature and precipitation regimes. These temperature and precipitation data were obtained via the National Weather Service [
55] archives. The following results were obtained.
Using signal detection methods, the NAEFS model ensemble generally anticipated an observed IE maximum within one day of its occurrence for forecasts out to seven days. The mean model forecast was approximately one day late, but at 10 days, the mean model forecast IE maximum was about 1.5 days early on average. Signal detection theory demonstrated that the model could project these observed maxima seven days prior to the occurrence and that the signal was identifiable above noise at p = 0.10 or greater.
Using traditional skill score, the NAEFS mean ensemble model forecast IE maxima showed skill well above that of climatology for the entire 10 day forecast period, although skill did decrease with greater lead time. Thus, using signal detection methods and skill score, the prediction of IE maximum occurrence and strength was reliable out to at least seven days. This is at least at the end of the current range of operational forecast model ability to predict 500 hPa height fields.
Lastly, the observed IE maxima, associated with large-scale flow regime changes, could be associated often with changes in the regional temperature and precipitation regimes and character as identified using four case studies. Thus, the results of
Section 3 and
Section 4 taken together indicated that the integrated enstrophy diagnostic of [
16] has value and skill in projecting changes in the large-scale and regional scale weather for long-range synoptic-scale forecasts.