4.1. Ensemble Mean Forecast
Ensemble forecasts of tropical cyclone tracks are typically represented by the ensemble mean. This is the arithmetic average of the TC latitude and longitude among all ensemble members at each time point. Muifa (2022) is selected for analyzing the performance of the ensemble prediction system. The forecast period is from 0000 UTC on 8 September 2022, to 1200 UTC on 14 September 2022. The model makes forecasts twice a day, for a total of 14 forecasts. The real-time TC message data (babj data) from CMA is selected for evaluation, which is also the official TC guide of the CMA. The track forecasts of the ensemble mean by SWARMS-EN, GEFS, and TEDAPS are shown in
Figure 2. The red line represents the subjective forecast, while the blue lines are ensemble mean forecasts.
Based on the track forecast for SWARMS-EN, in the early stages of the Muifa, it moves to the northwest. The northerly component of TC will intensify as it approaches the eastern sea of Taiwan Island, and it will progressively move closer to the eastern coast of China. As can be seen from
Figure 2a, the turning point predicted by the SWARMS-EN is westward compared to the actual, resulting in a west bias as it moves northward. The GEFS forecast (
Figure 2b) is the most accurate before the typhoon changes direction, and the turning point almost matches the actual. However, as the typhoon approaches the southeast coast later on, the track forecasts for GEFS are too slow, leading to a significant forecasting error. The forecast of the TEDAPS is presented in
Figure 2c. It is evident that the north-northwestward error of the typhoon, the turning point, and the landfalling forecast are similar to those of the SWARMS-EN. However, it is worth noting that SWARMS-EN has consistently predicted that the typhoon will make landfall on the east coast of China, which is relatively close to the actual.
At the same time, the forecasts from the three ensemble forecast systems were selected for evaluation. The track error of the ensemble forecast is shown in
Table 2. It should be noted that the number in parentheses in the first row of the table represents the sample number. The forecast leadtime of TEDAPS is 72 h, while SWARMS-EN and GEFS provide 5-day forecast results. It can be seen that the forecast of GEFS within 24 h has obvious advantages, which is comparable to the level of subjective forecasting (64.5 km/24 h (CMA); 50.4 km/24 h (Shanghai Meteorological Bureau, CMA)), SWARMS-EN slightly outperforms TEDAPS.
The 48-h forecast is similar to the 24-h forecast, and the GEFS forecast remains consistent, with the error growth over 24 h being less than 50 km, reaching 105.1 km. The error growth of SWARMS-EN is comparable to that of GEFS, with a track error of 142.2 km over 48 h, while the error of TEDAPS increases rapidly to 176.0 km within 24 h. In the next 48–72 h, the forecast indicates a different situation compared to the previous one: GEFS shows a slow increasing trend; TEDAPS reached the maximum forecast error at 60 h and then remained around 218 km; the 72-h forecast error of SWARMS-EN decreases instead of increasing, which is lower than the forecast error at 60 h and the forecast error of GEFS during the same period. In the 3-day forecast, SWARMS-EN continues to outperform GEFS, and at later lead times, this advantage becomes more pronounced. In general, the forecast error is 129.1 km for 3 days, 174.5 km for 4 days, and 203.5 km for 5 days. It is superior to subjective and deterministic forecasts, making it the best forecasting method currently available.
Table 3 presents the evaluation of the intensity forecast of the Muifa by the three ensemble forecasting systems. It can be seen that for the daily forecast within three days, SWARMS-EN has the smallest error, 8.2 ms
−1 for 24 h, 9.6 ms
−1 for 48 h, and 10.5 ms
−1 for 72 h, respectively, followed by GEFS with an error of 11.2 ms
−1 for 72 h, and TEDAPS has the largest intensity forecast, with a forecast error of 12.0 ms
−1 for 72 h. In the forecast after 3 days, the error of GEFS shows a decreasing trend and is only 9.3 ms
−1 at 120 h, indicating that the system has a good forecast ability for intensity in the later period. On the contrary, the intensity forecast error of SWARMS-EN gradually increases, and the intensity forecast is inferior to that of GEFS.
4.2. RMSE and Ensemble Spread Relationships
When assessing the reliability of an ensemble prediction system, it is typical to compare the root-mean-square error (RMSE) of the ensemble mean with the ensemble spread. The RMSE and the ensemble spread relationship for three ensemble forecast systems are shown in
Figure 3. Blue dots represent TEDAPS, black dots represent GEFS, and red dots represent SWARMS-EN. The x-coordinate represents the RMSE of the track forecast, while the y-coordinate represents the ensemble spread. The ensemble spread also provides a measure of forecast confidence. Forecasts with a larger track spread tend to have a large ensemble-mean track error [
25,
26,
27,
28]. Throughout the entire forecast period, the scatter points of GEFS are consistently situated in the upper left corner of the diagonal. This indicates that for the track forecast, the ensemble spread exceeds the forecast error, suggesting that the system is overdispersive. The scatter distribution of TEDAPS shows the opposite shape to GEFS. In other words, the scatter points are all below the diagonal, indicating that the system’s spread is much smaller than the forecast error and that the system is underdispersive. Compared to GEFS and TEDAPS, the scatter points of SWARMS-EN show no obvious systematic bias overall. The ensemble spread within 2 days is less than the RMSE. However, as the forecast lead time increases, the scatter points approach the diagonal, indicating that the system can better represent the forecast uncertainty and provide more reliable forecasts.
4.3. Landfall Forecast
Muifa (2022) was the third TC to make landfall four times since 1949 in China, after Yancy (1990) and Fung-wong (2014). It successively made landfall in Zhoushan, Zhejiang province; Shanghai; Qingdao, Shandong province; and Dalian, Liaoning province. The forecast for the first landing was particularly crucial as it was the first step in its lifespan from the ocean to the land, and its impact was much greater than that of the subsequent three landfalls. The following focuses on the analysis of the first landfall.
The CMA subjective forecast did not show any indications of a typhoon making landfall before 0200 UTC on 10 September 2022 for the whole forecasting process. Wang et al., (2023) found two significant track errors in the CMA forecast of Muifa, one of which was the mid- to long-term (3–5 days) forecast during the early stage of TC formation, and the other was the track forecast over land for Muifa, which was slower and westward compared with the observation. This paper mainly discusses the forecast of TC landfall, which is closely associated with the first point. Due to the increasing differences among various NWP forecasts, the spread between the ensemble members is also large, indicating a high level of uncertainty in the 3–5 day track forecast. That makes it challenging for forecasters to draw a conclusion on the likelihood of landfall.
Figure 4a shows the track forecast for SWARMS-EN from 12 UTC on 9 September. The blue line is the deterministic forecast, the red line is the ensemble mean, the black dotted line is the best track, and the purple lines are forecasts from ensemble members. In the process of TC recurving, the differences among the members are mainly reflected in the longitude, which ranges from 122° E to 124° E, but there is little difference in the latitude. In general, all track forecasts are to the west and south relative to the best track. For the landfalling forecast, it is evident that nearly all the members have predicted that the typhoon will likely approach the coast of Zhejiang and have a high probability of making landfall. The track error of the ensemble mean for the 120-h forecast is only 28.4 km, which represents a significant improvement compared to the 206.6 km of the deterministic forecast. This is the probability forecast information for 5 days in advance provided by the ensemble forecast. It differs significantly from the subjective forecast and serves as a reference for the subsequent forecast of the tropical cyclone movement. This information is worthy of continuous attention by forecasters.
Comparing the GEFS with the SWARMS-EN for the landfalling forecast at the same time (
Figure 4b). It can be seen that the forecast difference among GEFS members is larger than that of SWARMS-EN members. There are two different scenarios for the TC track. One is that TC moves slowly northward in the eastern part of Taiwan Island, which is similar to the subjective prediction of CMA. The other scenario is that Muifa continued to move northwest through the eastern part of Taiwan Island, approached the East China coast, and made landfall in Zhejiang, which aligns with the forecast of SWARMS-EN. The divergence in forecast can be clearly seen from the ensemble mean forecast of the two systems.
4.4. Ensemble-Based Analysis
The landfalling forecasts for TC are described in
Section 4.3. It is evident that SWARMS-EN provides a more accurate landfall forecast five days in advance. However, a careful analysis of the tracks among members shows that there are still significant differences between them. In this case, members 7 and 20 exhibit typical bifurcation. The track of member 7 is closer to the mean forecast of GEFS, exhibiting a northwest trajectory in the early stages that is similar to the observation. However, the turning point is slightly to the west of the observation. After the typhoon changed direction, it slowly moved northward while maintaining its strength, but there is no indication of it making landfall. While the track of member 20 is closer to the mean forecast of SWARMS-EN, the early track is similar to that of the GEFS, but the turning point is significantly to the west. After the TC recurvature, its northward component rapidly increased and moved to East China. The differences between the two members are so significant that they need to be analyzed in terms of large-scale environmental fields, as shown in
Figure 5. The figure displays the geopotential height of 500 hPa and the wind field of 850 hPa at 6 h before landfall. Several major systems are influencing the track of TC, including the subtropical high, TC Nanmadol (2022), and the low-pressure system over land.
Compared with the analysis filed, the circulation field of East Asia by member 7 is generally weak. On one hand, the intensity of the subtropical high over East Asia was relatively weak. The northern boundary of 588 gpdm only extended to the western region of Japan, but in fact, it had already reached northeastern China. On the other hand, the low-pressure system in central and eastern China exhibited lower intensity. This led to Muifa and Nanmadol being located within the same low-pressure circulation, forming a dual typhoon system. Consequently, Muifa gradually developed a southward component as its northward speed progressively slowed down or even stalled, ultimately leading to an unsuccessful forecast. Among all the predictions of members, Member 20 accurately depicted the overall characteristics of East Asian circulation patterns by indicating that the subtropical high was stronger over Japan and its northern boundary extended into northeast China. Additionally, it correctly identified that the southern boundary of the low-pressure circulation in central and eastern China lay near the southeastern coastlines, clearly distinguishing it from the circulation field of Nanmadol. These specific atmospheric conditions were favorable for Muifa’s northward movement along the western edge of Japan’s subtropical high after making landfall.
As can be seen from the above analysis, the primary factors influencing the track of Muifa are the subtropical high and its associated large-scale circulation field. To describe the changes in the steering flow around TC, a whole layer wind of 200–850 hPa is calculated.
Figure 6 shows a time series diagram of the steering flow for two members. The azimuth angle of the blue arrow in the figure indicates the direction of the steering flow, and the vertical axis indicates the magnitude of the steering flow, reflecting the difference in the flow field between the two members. From the perspective of the direction of the steering flow, there is little difference between the two members, and both of them change direction from northwest to northeast or north-northeast at 1112 UTC. However, there are significant differences in the magnitude of the steering flow between them. The steering flow of member 7 shows a notable decreasing trend. The magnitude of the steering flow is 1.75 ms
−1, and the oscillation increases to 2.62 ms
−1 at 1306 UTC and then gradually decreases. During the entire forecasting process, the range of the steering flow is between 1.54 and 3.5. For member 20, before 1112 UTC, the magnitude of the steering flow gradually decreased from 3.5 ms
−1 to 2.43 ms
−1. However, after the turn, the steering flow exhibited a monotonically increasing trend, and the magnitude sharply increased from 2.43 ms
−1 to 9.32 ms
−1. It can be seen that the weak environmental steering flow causes Muifa to move slowly, and on the contrary, it releases a strong landfalling signal.
4.5. Characterization of the Initial Perturbation
It can be seen from the previous analysis that there is a significant difference between member 7 and member 20 in the track forecast. Is there a significant difference in the initial time? The wind and temperature perturbations at 500 hPa were used to analyze the differences in variables (see
Figure 7 and
Figure 8). It can be seen that the distribution of geopotential height between two members is similar, but the wind and temperature perturbations are clearly different. Taking zonal wind as an example, from a horizontal perspective, positive and negative disturbances alternate in the pattern of the perturbation. In the region where the contour is relatively flat, known as the dynamic stable area, perturbation is evenly distributed among the members and the magnitude is small. On the contrary, in dynamically unstable areas such as TC and the upper trough area, the perturbation value between members increases significantly. This also reflects that perturbation at 500 hPa is clearly flow-dependent. Specifically, the perturbation value range for member 7 is from −8.35 ms
−1 to 8.13 ms
−1, while for member 20 it is from −6.86 ms
−1 to 16.90 ms
−1. The positive perturbation is particularly pronounced near TC, representing the most significant difference between the two members. The same is true for meridional wind perturbations and temperature perturbations; differences between members are more pronounced in areas of dynamic instability, especially near TC.
The above analysis reveals that there are significant differences among the members near the TC at the initial time. The TC is located at 127.9° E and 19.4° N. An area with a radius of 5 degrees has been selected for further analysis of the vertical structural characteristics of the aforementioned variables. In this paper, the north-south section is used as an example (
Figure 9). The perturbation of the zonal wind reveals that the large amplitude of the perturbation is concentrated near the TC, and the overall altitude is below 10–12 km (approximately 200 hPa). The characteristics of positive and negative disturbances around the typhoon center are evident. The disturbance of member 7 is slightly north of the typhoon center, displaying two significant value areas in vertical distribution. One is located in the middle and lower troposphere at 3 km, and the other is located in the upper troposphere at 9 km. The distribution of disturbance for member 20 is closer to the center of the typhoon in the horizontal position. In the vertical structure, there is a continuous large area of positive and negative association in the middle and lower tropospheres, and the positive disturbance extends to the upper troposphere.
In the TC region of the troposphere, the vertical development of the meridional wind perturbation differs from the zonal wind. It is characterized by positive or negative disturbances, rather than a combination of both. Member 7 primarily represents a negative disturbance, while member 20 primarily represents a positive disturbance. Similar to zonal wind, in terms of vertical structure, the maximum value is observed near the top of the troposphere at 12 km, and perturbation values are relatively uniform in the stratosphere with a significant reduction.
In addition to the differences in the troposphere near TC, the temperature perturbations also exhibit significant variations in the stratosphere among the members. Since the influence of the TC does not extend to the stratosphere, the differences in such perturbations generally occur over a wide range of the stratosphere (for example, near an altitude of 18 km), which also indicates the large uncertainty of the model in stratosphere forecast.
4.6. The Evolution of Perturbation Energy
Generally, the distribution characteristics of perturbation energy can be used to assess the rationality of the initial perturbation structure. A reasonable initial perturbation can capture the rapidly growing error in the initial field and represent areas with large uncertainties. Meanwhile, a reasonable initial perturbation should exhibit a reasonable increase with the extension of the forecast time in order to accurately reflect the objective relationship between forecast error and forecast lead time. In this paper, the total perturbation energy proposed by Palmer [
29] is used for analysis. The formula is as follows:
u′, v′, T′ is the perturbation of zonal wind, meridian wind, and temperature, respectively. Perturbation is defined as the difference between the control run and ensemble members. Cp is the constant pressure-specific heat of dry air, Tr is the reference temperature, and i, j, and k are the horizontal and vertical grid points of the model area, respectively.
Figure 10 shows the vertical distribution profiles of the average perturbation of kinetic energy, internal energy, and total energy for member 7 and member 20 for the 120 h forecast. The graphic illustrates the development of perturbated total energy, internal energy, and kinetic energy with forecast lead time, reflecting the characteristic of model forecast error increasing with the forecast lead time to some extent. Using member 7 as an example, the predicted perturbation of kinetic energy at 200 hPa is 2.65 J kg
−1 at the initial time, and it increases to 42.93 J kg
−1 after five days. The initial perturbation of internal energy increases from 0.62 J kg
−1 to 7.16 J kg
−1 after 5 days. The perturbation of total energy increases from 3.27 J kg
−1 to 50.09 J kg
−1, and the energy increases by more than 15 times. In general, the contribution of kinetic energy to total energy is greater than that of internal energy, regardless of the magnitude or rate of disturbance growth. It is also noted that there are differences in the vertical distribution of disturbance energy performance: the influence area of the disturbance energy is mainly in the upper troposphere, and the area with large values is located near 200 hPa, close to the jet stream axis. This finding is consistent with the research results of Bowler et al. [
30]. In addition to the upper level, the internal energy of the disturbance also affects the lower troposphere, specifically around 850 hPa to 925 hPa. This may be associated with the low-level jet stream and thermal changes induced by radiation. As can be seen from the total energy of the disturbance, the total energy of the disturbance is mainly kinetic energy. After 3 days of forecasting, the disturbance is easier to develop in the upper troposphere, forming an obvious large area, followed by the middle and lower tropospheres, and the disturbance in the middle troposphere and the near-surface layer is relatively small. On the other hand, the disturbance at the upper level is easier to develop, and it will be relatively difficult to increase the spread of the variables at the bottom of the atmosphere.
By comparing the differences between the two members, it can be seen that the perturbation between the two members is not significant initially. However, as the forecasting time increases, the difference between the two gradually becomes apparent. The change in internal energy is relatively minor, with member 7 exhibiting a faster development rate than member 20, and the overall amplitude remaining consistent. In contrast, there are significant changes in kinetic energy, particularly in the upper troposphere after 3 days. Member 7 exhibits a disturbance kinetic energy of nearly 30 J kg−1 at 200 hPa for 96 h and 45 J kg−1 after 5 days, whereas Member 20 develops relatively slowly, reaching only 28 J kg−1 after 5 days. The comparison of the total disturbance energy shows that the primary difference between the two is concentrated in the upper troposphere, around 200 hPa. This observation also indicates that the total disturbance energy is predominantly kinetic energy.