1. Introduction
Long-memory persistence describes the property of financial series whose sample autocorrelations are significantly different from zero, even for large lags [
1,
2,
3,
4]. In many recent studies, long-memory persistence is extensively observed, especially in financial return series [
5,
6,
7,
8]. However, apart from the actual everlasting effects of autocorrelations, it is well known that regime switching can also cause long memory [
3,
9,
10,
11,
12,
13]. Diebold and Inoue [
3] give a theoretical explanation of this phenomenon, and their simulation study further demonstrates that when structural breaks or stochastic regime switching exist, they are related to long memory and are easily confused with it (a regime-switching process, such as Markov switching, can be identified as non-stationary [
14]; therefore, it is expected that it could be confused with long memory from a technical point of view). Further, they argue that long memory and regime switching are interchangeable concepts and should not be studied separately.
However, in an influential study, Perron and Qu [
15] propose a test to effectively distinguish the long- and short-memory processes with mean shifts in the first moment of financial return series. Motivated by their work, it is expected that if the effects of regime switching can be appropriately controlled, the pure long-memory process can be distinguished from the pure regime-switching process.
This paper aims to distinguish between long memory and regime switching based on the second moment of the financial return series (it is widely recognized that the definitions of long memory and regime switching may be referred to much broader non-linear concepts; as explained in the paper, we focus on fractional integration (long memory) and Markov switching-type non-linearity (regime switching) of financial data). Among the existing models of financial volatility, the GARCH family models [
16] have enjoyed great popularity because of their ability to capture the properties of financial volatility, such as time-varying heteroskedasticity and volatility clustering [
8,
17,
18,
19,
20,
21,
22,
23]. In particular, to incorporate long-memory persistence in the GARCH framework, the Fractionally Integrated GARCH (FIGARCH) model has been proposed [
1]. This model is based on the application of the fractional differencing operator to the autoregressive structure of conditional variance by assuming that it follows hyperbolic rather than exponential decay [
1]. Despite the model’s popularity, Davidson [
24] argues that FIGARCH cannot measure the real long memory based on the second moment and proposes to use the Fractionally Integrated Exponential GARCH (FIEGARCH) model developed by Bollerslev and Mikkelsen [
2] as an alternative. In contrast, the Markov Regime-Switching GARCH (MRS-GARCH) model is developed in the seminar work by Hamilton [
25] by including regime-switching parameters into the GARCH framework to make jumps between state spaces possible. In particular, the MRS-GARCH model discussed in Haas et al. [
26] outperforms other specifications by appropriately modeling the path dependency of conditional volatility [
8]. To consider modeling the real long memory and compare its counterpart with the regime-switching framework, we employ FIEGARCH and MRS-EGARCH, respectively, in this paper.
Regarding the distribution of innovations, it is originally assumed to be Gaussian, and the Quasi-Maximum Likelihood Estimation (QMLE) of GARCH family models is developed based on the Gaussian distribution. However, significant evidence suggests that the financial return series is rarely Gaussian but typically leptokurtic and exhibits heavy-tail behavior [
27,
28,
29,
30]. In terms of the FIEGARCH model, it is argued that even if the true innovation does not follow a normal distribution, QMLE based on the normal distribution is still asymptotically consistent [
2]. Nevertheless, MLE based on the true distribution is expected to be more efficient than its QMLE counterpart. With respect to the MRS-GARCH model, however, Klaassen [
31], Ardia [
32] and Haas [
33] notice that if regimes (states) are not normal but leptokurtic, the use of within-regime normality can seriously affect the identification of the regime process. The details can be found in Haas and Paolella [
34], who further argue that QMLE based on normal components does not provide a consistent estimator of the MRS-GARCH model if the true distribution of innovations is not normal. The same argument may also apply to the MRS-EGARCH extension. We, therefore, performed a Monte Carlo study on the QMLE property of the FIEGARCH and MRS-EGARCH models, where simulated data actually followed Student’s t-distribution. Our results suggest that the QMLE of FIEGARCH is consistent but not efficient and that the QMLE of MRS-EGARCH is neither consistent nor efficient. Those results are consistent with the existing literature. As a result, this indicates that a non-Gaussian distribution of innovations should always be used to analyze the long memory and regime switching of the volatility of financial return series with GARCH-type models.
To demonstrate the confusion between FIEGARCH and MRS-EGARCH, we performed a simulation study and conducted the usual residual diagnostics. Similarly to Diebold and Inoue [
3], it was found that the MRS-EGARCH Data Generation Process (DGP) can lead to significant estimates of long memory. In addition, all of the usual residual diagnostics, including the Brock–Dechert–Scheinkman (BDS) test, the Ljung–Box test, the ARCH Lagrange multiplier (LM) test and the square root of the mean square error tended to favor the FIEGARCH model, even if the true DGP was MRS-EGARCH. Li and Mak [
35] proposed portmanteau statistics for the time series goodness-of-fit test to examine whether the ARCH specification of financial volatility is adequate. Based on their work, Fisher and Gallagher [
36] developed a more powerful weighted version of this test. However, the results of both tests are similar to those of the usual residual diagnostics, which still prefer the FIEGARCH model to the MRS-EGARCH model, even if the true DGP is MRS-EGARCH. Thus, residual diagnostics cannot distinguish between long memory and regime switching.
Diebold and Inoue [
3] theoretically analyze the causality of long memory in the regime-switching DGP based on the assumption that transition probability is time-varying. However, in the standard MRS model, it is actually constant over time [
25]. Thus, a recent study by Shi [
37] gives an improved theoretical proof where transition probability is a non-time-varying constant and suggests that the existing long memory in the MRS process is caused by smoothing probability, which indicates the specific state that the financial series lies in over time. Based on this proof, Shi [
37] further shows that if the effects of smoothing probability can be appropriately controlled, the long memory of the MRS process should disappear. Although the above results were developed based on the first moment, it is expected that they also hold for the MRS-EGARCH DGP.
We firstly verified this argument based on the second moment by proposing a two-stage FIEGARCH framework. This two-stage framework is motivated by a similar model fitting of the first moment of financial series studied by Shi [
37]. The intercept in the FIEGARCH framework is allowed to switch between states, which are identified using the smoothing probability extracted from the MRS-EGARCH model. Similar to Shi [
37], a Monte Carlo study demonstrated that with the pure MRS-EGARCH DGP, the estimates of long memory with the two-stage FIEGARCH framework were mostly insignificant and close to 0, while those with the pure FIEGARCH DGP were mostly significant and not far from the true values.
Based on this, to further incorporate the effects of smoothing probability into the FIEGARCH model, we propose an MRS-FIEGARCH framework. Another Monte Carlo study was performed, where three DGPs were considered: pure FIEGARCH, pure MRS-EGARCH and MRS-FIEGARCH DGP. We observed the following facts according to the results: when the true DGP was pure MRS-EGARCH, the estimates of long memory in the MRS-FIEGARCH model were mostly insignificant and close to 0; when the true DGP was pure FIEGARCH, the estimates were mostly significant and close to the true values; when the true DGP was MRS-FIEGARCH, the estimates were smaller than those of FIGARCH and were close to the true values. Therefore, the MRS-FIEGARCH framework can be used to distinguish between long memory and regime switching, as well as to model the data at the same time.
To empirically compare the model evaluations, we fitted the FIEGARCH, MRS-EGARCH and MRS-FIEGARCH frameworks to the daily NASDAQ Composite Index ranging from 1 January 2001 to 31 December 2022. According to the estimates, it was demonstrated that the MRS-FIEGARCH framework could estimate the true transition probabilities and identify the volatility states. Compared with the FIEGARCH model, it could generate smaller estimates of long-memory persistence. In terms of model evaluations, the MRS-FIEGARCH framework outperformed both the FIEGARCH and MRS-EGARCH models.
The contributions of this paper to the existing literature are fourfold: First, we adopted a recently developed fast Fourier transformation algorithm [
38] to calculate the fractionally integrated component of the (MRS-)FIEGARCH model. Compared with the widely used truncation strategy [
1], it is more accurate and is still computationally efficient. Hence, our simulation and empirical results are more reliable, especially for data of large size. Second, using a comprehensive simulation study, we demonstrated that the QMLE of MRS-EGARCH is not consistent for fat-tailed data. To the best of our knowledge, although this problem is mentioned in various research studies, no systematic study has been performed to support the theoretical argument. Therefore, our simulation results provide further evidence for relevant literature. Third, our proposed MRS-FIEGARCH model can effectively distinguish between the long memory and regime switching of financial series based on the second moment. Although related studies, such as Beine et al. [
39], Lux and Morales-Arias [
40] and Raggi and Bordignon [
41], consider the incorporation of regime switching into the long-memory model, they mostly focus on estimating the long-memory parameter and forecasting the volatility of data with long memory. Additionally, despite those studies mentioning that the estimated long-memory parameter from this incorporation approach is potentially more reliable, no evidence or reason is provided. Following the cause of the confusion between long memory and regime switching found by Shi [
37], our study additionally sheds light on the capability of the MRS-FIEGARCH model to distinguish between them based on the second moment of financial series. Hence, this can further explain the reliability of estimates obtained with the MRS-FIEGARCH framework, which significantly complements the works by Beine et al. [
39], Lux and Morales-Arias [
40] and Raggi and Bordignon [
41]. Finally, this paper also supplements existing studies on long memory and regime switching based on the second moment. Compared with Shi and Yang [
42], and Ho and Shi [
43], FIEGARCH may be able to capture the real long memory, rather than the hyperbolic memory, based the second moment. With respect to Gao et al. [
44] and Shi [
45], the FIEGARCH model can provide an asymmetric measure of shocks to the conditional volatility.
Additionally, our results can provide useful implications for financial studies where long memory is the main concern. In real financial data, due to reasons such as structural breaks in the real economy, regime switching is very likely to exist [
46,
47,
48]. Thus, the long memory observed in such data is `spurious’, as it could be caused by regime switching [
11,
49,
50]. Therefore, the MRS-FIEGARCH framework, which can control for the effects of regime switching, is a competitive option to estimate the `true’ (not caused by regime switching) long memory. For instance, it can be used to enhance the accuracy of dynamic hedging strategies and derivative pricing models, as the long-memory persistence of asset volatility is a key input in these strategies and models [
51,
52,
53].
The remainder of this paper proceeds as follows:
Section 2 describes the FIEGARCH model and studies its QMLE property using simulations.
Section 3 explains MRS-EGARCH with a simulation study on its QMLE property. In
Section 4, the results from the simulations demonstrate the confusion between long memory and regime switching. In
Section 5, we propose the MRS-FIEGARCH model with a Monte Carlo study.
Section 6 presents an empirical study using the daily NASDAQ Composite Index. We conclude the paper in
Section 7.
2. Long Memory and the FIEGARCH Model
As described in Diebold and Inoue [
3], long memory is defined using the rate of growth variances of partial sums as
, where
,
is a sequence of interested financial series,
T is the number of observations and
is the summation of
. Then,
d is the long-memory parameter.
For the study of time-varying financial volatility, the FIGARCH model is widely employed to estimate the long-memory characteristic. The FIGARCH model was proposed by Baillie et al. [
1], and it was extended from GARCH family models. As concluded by Marcucci [
46], GARCH family models have enjoyed popularity among academics because of their ability to capture some of the typical stylized facts of financial return series, such as volatility clustering. French et al. [
17], and Franses and van Dijk [
18] show that GARCH family models take into account the feature of time-varying volatility over a long period and provide good in-sample estimates. Despite the effectiveness of the model, Davidson [
24] points out that the FIGARCH model cannot measure the real long memory. Thus, an alternative for this aim is the FIEGARCH model proposed by Bollerslev and Mikkelsen [
2]. The original FIEGARCH(1,
d,1) model, where 1, d and 1 correspond to the AR, long memory and MA factors in the conditional variance equation, respectively, is described as
where
is the error at time
t,
is the conditional variance of
at time
t,
is an identical and independent sequence following a Gaussian distribution,
L is the lag operator,
measures the asymmetric effect of shocks to conditional volatility and
is the fractional differencing operator as defined by Hosking [
54], i.e.,
where
d is the long-memory parameter. We have a stationary long-memory process when
. If
, the process reduces to an ordinary EGARCH process without the long-memory property [
55].
The infinity process in Equation (
2) is replaced by
in practice. However, this recursive summation process can be very slow for large sample sizes
T. Hence, a widely employed strategy is to truncate it at 1000 lags (replace
with 1000) as performed by Baillie et al. [
1]. Despite its computational efficiency, the accuracy of this approach is questionable, especially for large-sized data. In order to enhance the accuracy and keep the computation efficient, we employed the fast Fourier transformation algorithm developed in a recent study by [
38]. Compared with results obtained with the truncation strategy, our results are more reliable, as they cover the entire dataset without truncation, and are still computationally efficient.
We notice that in Equation (
1), the distribution of innovations is assumed to be Gaussian. However, significant evidence suggests that the financial return series is rarely Gaussian but typically leptokurtic and exhibits heavy-tail behavior [
27,
28,
29,
30]. In addition, Student’s t-distribution is a widely used alternative, which can accommodate the excess kurtosis of innovations [
27].
To estimate the parameters of the FIEGARCH models, Bollerslev and Mikkelsen [
2] suggested a QMLE method based on the Gaussian distribution. QMLE estimators are argued to be asymptotically consistent, even if the true distribution is not Gaussian. However, Student’s t-distribution is generally expected to result in more efficient estimations than the Gaussian distribution in GARCH family models [
28].
We performed a Monte Carlo study to investigate this argument. Altogether, nine sets of simulations with different
d,
and
were generated, where
,
,
and
(we set
T to 5000, because in Diebold and Inoue [
3], the confusion between long memory and regime switching was the most significant when
T = 5000). Moreover, the simulated data followed Student’s t-distribution with 3 degrees of freedom. To avoid the starting bias, 10,000 simulated points were generated for each simulation; then, the first 5000 points were truncated. Finally, we produced 500 replicates for each set of parameters, where the first 200 replicates were discarded to avoid simulation bias.
The simulated data were fitted into FIEGARCH models with a Gaussian distribution (FIEGARCH-N) and Student’s t (FIEGARCH-t)-distribution, respectively. In
Table 1, the bias, root mean square error (RMSE) and standard error (SE) of
d,
and
are reported. Bias is the mean difference between the true parameter and its estimate; RMSE is the square root of the mean of the squared difference between the true parameter and its estimate; and SE is the standard error of the estimates. It was shown that the biases of all parameters of FIEGARCH-N were quite small and similar to those of FIEGARCH-t. In contrast, the SE, which is the indicator of estimation efficiency, suggests that the FIEGARCH-t model outperformed the FIEGARCH-N model. Thus, we demonstrated that the QMLE estimators of the FIEGARCH model are consistent but less efficient than the estimators of the FIEGARCH-t model. As a result, the FIEGARCH-t model was employed to fit the dataset in the rest of this study.
3. MRS-EGARCH Model
The main weakness of the GARCH family model is that it assumes that the conditional volatility has only one regime over the entire period. Unfortunately, this is not always true. Marcucci [
46] argues that due to reasons such as structural breaks in the real economy and changes in operators’ expectations about the future, financial returns may exhibit sudden jumps and do not stay in the same regime over a long period.
Hamilton [
25] proposes the inclusion of regime-switching parameters to make jumps between state spaces possible. To retain the advantages of GARCH models and make structural breaks possible at the same time, Cai [
56], and Hamilton and Susmel [
57] apply this seminal idea to the ARCH specification. However, the extension to the GARCH specification is difficult because of the path dependency of the conditional volatility term, and researchers such as Gray [
58], Dueker [
59], Lin [
60] and Klaassen [
31] have generate various algorithms to overcome this issue. The details can be found in Marcucci [
46].
In this paper, to be comparable with the FIEGARCH model, we employed a two-state MRS-EGARCH(1,1) model with Student’s t-innovations (MRS-EGARCH-t), which is based on the MRS-EGARCH model investigated in Haas et al. [
26], as follows:
where
is the residual at time
t in state
;
is the state that the stock lies in at time
t;
is an identical and independent sequence following Student’s t-distribution, with mean of 0 and standard deviation of 1;
v is the degree of freedom of Student’s t-distribution; and
is the conditional variance in state
at time
t. Further, the sequence
is assumed to be a stationary, irreducible Markov process with discrete state space
and transition matrix
, where
is the transition probability of moving from state
j to state
k (
.
As argued by Mullen et al. [
61], Equation (
3) can also capture the volatility clustering as in the GARCH model, as well as making structural breaks in unconditional variance possible. In the
jth regime, the unconditional logged variance is
as long as
, that is, the process is covariance stationary [
16,
26]. In this paper, we indicate state 1 as the calm (low-volatility) state and state 2 as the turbulent (high-volatility) state, so that
. In addition, we use the notations
and
to measure persistence (of logged volatility) in the calm and turbulent states, respectively.
We estimated the parameters of the MRS-EGARCH model using MLE. The conditional density of
is given by Mullen et al. [
61] as
By inserting the filtered probability in state
j at time
,
, into Equation (
5) and integrating out the state variable
, the density function in Equation (
5) becomes
can be obtained using an integrative algorithm given in Hamilton [
25]. The log-likelihood function corresponds to Equation (
3) as
and the MLE estimator
is obtained by maximizing Equation (
7).
To identify which state the financial return series lies in at time
t, the smoothing probability of the calm state is constructed as follows [
25]:
Using the fact that
, the smoothing probability series
can be generated by iterating Equation (
8) backwards from
T to 1. As suggested by Hamilton [
25], a widely recognized rule to identify the state of
is that if
is less than 0.5,
is assumed to lie in the turbulent state at time
t, and otherwise, in the calm state.
We did not use QMLE and MRS-EGARCH with the Gaussian distribution (MRS-EGARCH-N) for the following reasons: As noted by Klaassen [
31], Ardia [
32] and Haas [
33], if regimes are not Gaussian but leptokurtic, the use of within-regime normality can seriously affect the identification of the regime process. The details can be found in Haas and Paolella [
34], who further argue that the QMLE based on Gaussian components does not provide a consistent estimator of the MRS-GARCH model if the true distribution of innovations is not Gaussian. This argument may also apply to the MRS-EGARCH extension.
A Monte Carlo study was performed to verify this argument. We constructed simulations for 12 sets of different
,
(in Diebold and Inoue [
3], the confusion between long memory and regime switching is much more significant when transition probabilities are greater than or equal to 0.99; thus, we only selected the transition probabilities studied in their work that are greater than or equal to 0.99; we also investigated the case where transition probabilities are smaller (e.g., 0.90 and 0.95), and the results were generally consistent),
and
, where
,
,
,
,
,
and
. Note that although the original MRS-EGARCH model makes regime switching in the mean possible, it is not our focus in this study. Thus, we set both
and
to 0, which is the widely observed mean for financial return. Moreover, the simulated data followed Student’s t-distribution with 3 degrees of freedom. The replicates and each simulation were further truncated as described in
Section 2 to avoid simulation bias. All simulated data were fitted to the MRS-EGARCH-N and MRS-EGARCH-t models, and the results are presented in
Table 2.
The bias in
Table 2 suggests that the MRS-EGARCH-N model is not consistent in either transition probabilities or volatility persistence. The SE further indicates that the MRS-EGARCH-N model is much less efficient than the MRS-EGARCH-t model. Thus, we demonstrated that the QMLE estimator of the MRS-EGARCH model is neither consistent nor efficient when the true distribution of innovations is not Gaussian. As a result, the MRS-EGARCH-t model was employed in the rest of this study.
4. Confusion between Long Memory and Regime Switching
Diebold and Inoue [
3] argue that under certain conditions, even if the true DGP is MRS, it can cause long memory and is easily confused with it. We demonstrate this in
Table 3 and
Table 4, where the previously generated FIEGARCH and MRS-EGARCH simulations are fitted into MRS-EGARCH-t and MRS-FIEGARCH-t models, respectively.
In
Table 3, it can be seen that although the true DGP was MRS-EGARCH, the mean estimate of
d obtained with the FIEGARCH model is considerably large in all cases. Additionally, the fraction of rejection with
at 5% is large and close to 1 in all cases, which significantly suggests that the MRS-EGARCH DGP can be confused with the FIEGARCH DGP. In
Table 4, the mean estimates of
and
are all greater than 0.9. Thus, the true FIEGARCH DGP can also lead to confused MRS-EGARCH estimates (we also extended our study to the FIEGARCH DGP where
d is greater than 0.5; the estimations led to the same conclusion and are available upon request). Nevertheless, it is interesting to note that the mean estimates of the degree of freedom with Student’s t-distribution are very close to 3. This suggests that even if the DGP is fitted into the `wrong’ model, the distribution of innovations can be properly fitted and identified.
To distinguish these two DGPs, we performed the regular residual diagnostics for (squared) standardized residuals (in the MRS-EGARCH model, estimated volatility is the weighted average of estimated volatility in the calm and turbulent states; the weights are set to the corresponding update probability
); the details can be found in Hamilton [
25], Hamilton [
62] and Haas et al. [
26]) for both the FIEGARCH and MRS-EGARCH models, including the BDS test, the ARCH LM test, the Ljung–Box test and RMSE (where
is assumed to be the true volatility at time
t). In
Table 5, it can be seen that both the FIEGARCH and MRS-EGARCH models generated similar residual diagnostics when the true DGP was FIEGARCH. More specifically, it appears that residual diagnostics from the FIEGARCH model were slightly better. In relation to the MRS-EGARCH DGP, in
Table 6, it can be observed that the same conclusions still hold. In summary, the regular residual diagnostics cannot distinguish between the FIEGARCH and MRS-EGARCH DGPs. In addition, the FIEGARCH model tends to generate comparatively better residual diagnostics, even if the true DGP is MRS-EGARCH.
In addition to the traditional residual diagnostics, Li and Mak [
35] proposed portmanteau statistics for the time series goodness-of-fit test to detect whether the fitted ARCH process is adequate. Based on their work, Fisher and Gallagher [
36] proposed a weighted version of this test and argued that their test is more powerful. We here generated the original portmanteau statistics and their weighted version for the FIEGARCH and MRS-EGARCH DGPs. However, in
Table 7, no matter which DGP was true, the FIEGARCH and MRS-EGARCH models led to similar results. In addition, FIEGARCH still tended to generate slightly better portmanteau statistics. Thus, we demonstrated that the (weighted) portmanteau statistics cannot distinguish between the FIEGARCH and MRS-EGARCH DGPs either.
The above conclusions are consistent with those by Diebold and Inoue [
3], who argue that long memory and regime switching are interchangeable concepts and should not be distinguished. In addition, they further argue that the long memory in regime switching is caused by the time-varying transition probabilities
and
. However, in the standard MRS(-EGARCH) framework, transition probabilities are not time dependent. Thus, based on proposition three in Diebold and Inoue [
3], Shi [
37] gives a refined proof, arguing that the significant long memory of the MRS DGP is caused by the smoothing probability series
. Further, the author demonstrates that if the effects of
can be appropriately controlled for, the long memory of MRS DGP will disappear. Although the results obtained by Shi [
37] were derived for the first moment, the same idea could be straightforwardly extended to the case of the MRS-EGARCH DGP. In the next section, we will test this argument by proposing different approaches to control for the effect of
.
6. Empirical Results
To empirically compare our MRS-V-FIEGARCH framework with the FIEGARCH and MRS-EGARCH models, we fitted them to the daily NASDAQ Composite Index (NASDAQ). The daily closing prices of NASDAQ over the period from 1 January 2001 to 31 December 2022 were obtained from the Thomson Reuters Tick History (TRTH) database, which contains microsecond-time-stamped tick data dating back to January 1996 (the empirical dataset covers data starting from the 21st century for illustration purposes; consistent results can hold if data are sourced from 1996). The database covers 35 million over-the-counter (OTC) and exchange-traded instruments worldwide, which are provided by the Securities Industry Research Centre of Australasia (SIRCA). The corresponding return in the percentage series is defined as the logarithm of the daily closing price differences times 100, that is, , where is the return and is the daily closing price.
The return series of NASDAQ is plotted in
Figure 1a. It can be seen that the volatility of return was relatively greater between 2001 and 2003 and that it then decreased. From 2008 to 2010, the return became much more volatile again. After 2010, the volatility tended to be smaller, with some turbulence around the end of 2010 and the start of 2022. In addition, using the sample measures, we obtained that the mean and standard errors of the NASDAQ return were 0.0009 and 0.5309, respectively. The skewness was 0.2223, indicating that the NASDAQ return was slightly positively skewed. The kurtosis was 14.1575, suggesting a non-Gaussian distribution. Thus, we performed the Kolmogorov–Smirnov and Jarque–Bera normality tests (not presented), where the null hypotheses indicating normality were rejected in both cases. We then fitted the NASDAQ data into the FIEGARCH, MRS-EGARCH and MRS-V-FIEGARCH models, all with Student’s t-distribution.
The estimates are presented in
Table 13. The estimated
d with the FIEGARCH model was 0.5374—slightly greater than 0.5—potentially suggesting an overestimated long-memory persistence.
v was estimated to be significant and around 3, indicating a significant non-Gaussian distribution. Turning to the MRS-EGARCH model, the estimates of
and
were significant and greater than 0.99. This suggests a significant regime-switching process, with a small frequency to switch between states. In addition,
was around 0.13, while
was 0.98. This indicates that the volatility persistence in the calm state was much smaller than in the turbulent state. In addition, the estimate of
v was close to 3. In terms of model performance evaluations, the logarithm of likelihood, Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC) all suggest that the MRS-EGARCH model outperformed the FIEGARCH model.
As demonstrated in
Section 5.3, the MRS-V-FIEGARCH model can properly control for the effect of smoothing probability and should generate more reliable estimates of
d. In
Table 13, the estimated
d with the MRS-V-FIEGARCH model was 0.3029. As it was not close to 0, the long memory is expected to exist for the NASDAQ return volatility. Further, it confirms our argument that after controlling for the regime-switching effect, the long-memory persistence should be smaller. In terms of
and
, the MRS-V-FIEGARCH model generated estimates similar to those of the MRS-EGARCH model. The estimated smoothing probability
with the MRS-V-FIEGARCH model is plotted in
Figure 1b. The patterns of
are consistent with our observation mentioned above: between 2001 and 2003, the NASDAQ return lay in the turbulent state; between 2004 and 2008, it mostly lay in the calm state; from 2008 to 2010, the return series tended to switch back to the turbulent state and stayed there; after 2010, although the calm state was dominant, the turbulent state was observed in 2016 and was persistent after 2020. This is generally consistent with the real macro-economic situation: between 2001 and 2003, the macro-economy suffered the effects of Information Technology (IT) bubble cracks, and the Global Financial Crisis (GFC) affected the macro-economy from 2008 to 2010. In addition, 2016 Brexit, COVID-19 and the 2020 US presidential election contributed to the turbulence after 2010. In addition, the estimated
v was similar to those of the FIEGARCH and MRS-EGARCH models and was close to 3. Finally, the logarithm of likelihood, AIC and BIC all show that the MRS-V-FIEGARCH model outperformed both the FIEGARCH and MRS-EGARCH models. Specifically, the MRS-V-FIEGARCH model had the largest likelihood and the smallest AIC and BIC across all competing models.
In conclusion, using the empirical results of the daily return of NASDAQ, we demonstrated that the MRS-FIEGARCH framework is capable of estimating the true transition probabilities and identifying the volatility states. Compared with the FIEGARCH model, it can generate smaller and potentially better estimates of long-memory persistence. In terms of model evaluations, the MRS-FIEGARCH framework performs better than both the FIEGARCH and MRS-EGARCH models. Thus, the MRS-FIEGARCH framework outperforms both the FIEGARCH and MRS-EGARCH models. As long memory and heteroskedasticity are important features of financial time series, the proposed MRS-FIEGARCH frameworks could be a widely useful tool for modeling volatility in other contexts.
7. Conclusions
Diebold and Inoue [
3] argue that regime switching and long memory are easily confused with each other and should be studied as interchangeable concepts. However, a recent study by Shi [
37] argues that if the cause of this confusion is properly controlled, they can be distinguished based on the first moment of time series. Following this idea, we propose an effective method to distinguish between long memory and regime switching based on the second moment of financial return series. The FIEGARCH and MRS-EGARCH models are used to estimate the long memory and regime switching of the conditional volatility of financial return series, respectively. Using a Monte Carlo study, we firstly demonstrated that when the true distribution of innovations is non-Gaussian, the QMLE of FIEGARCH is consistent but not efficient and the QMLE of MRS-EGARCH is neither consistent nor efficient. As financial returns are rarely Gaussian, it is suggested that a non-Gaussian distribution of innovations should always be used when a EGARCH-type model is employed.
Second, the confusion between the FIEGARCH and MRS-EGARCH DGPs was shown using simulations. The regular residual diagnostics and portmanteau statistics were produced and compared. However, none of them could distinguish between these two DGPs. Following the proof and idea provided by Shi [
37], we then controlled for the effect of the smoothing probability in separate stages, which led to the 2S-FIEGARCH framework. Using a Monte Carlo study, it was demonstrated that the 2S-FIEGARCH framework can distinguish between the FIEGARCH and MRS-EGARCH DGPs.
Instead of separately controlling for the smoothing probability, we incorporated it in the FIEGARCH process by proposing the MRS-FIEGARCH framework. Another Monte Carlo study demonstrated that the MRS-FIEGARCH framework can also effectively distinguish between the pure FIEGARCH and pure MRS-EGARCH DGPs. More specifically, if the estimated d in the MRS-FIEGARCH model is significant, we can safely conclude that the long memory is not caused only by regime switching and that it does exist. In addition, when the true DGP contains both long memory and regime switching, the MRS-FIEGARCH framework is capable of identifying the volatility states and providing more reliable long-memory persistence.
An empirical study of the daily return of the NASDAQ Composite Index was conducted to compare the model performance of the FIEGARCH, MRS-EGARCH and MRS-FIEGARCH frameworks. According to the estimates, it was demonstrated that the MRS-FIEGARCH framework could identify the volatility states, the structure of which was consistent with the macro-economic situation. Compared with the FIEGARCH model, it could generate smaller and potentially more reliable estimates of long-memory persistence. In terms of model evaluations, the MRS-FIEGARCH framework outperformed both the FIEGARCH and MRS-EGARCH models. As a result, the MRS-FIEGARCH framework could be a widely useful tool for modeling the long-memory characteristic of volatility in other contexts.
For instance, our findings could be extended to enhance the accuracy of dynamic hedging strategies and derivative pricing models, as asset volatility is a key input in these strategies and models [
51,
52,
53]. As noted by Hyung et al. [
52], the FIEGARCH specification dominates various short- and long-memory volatility models in terms of its out-of-sample forecasting performance in forecast horizons of 10 days and beyond. The long-memory characteristic has important implications for volatility forecasting and option pricing. Option pricing in a stochastic volatility setting requires a risk premium for the unhedgeable volatility risk. Fractionally integrated series lead to volatility forecasts larger than those obtained with short-memory models, which immediately translates into higher option prices. This could be an explanation for the better pricing performance of the FIEGARCH model [
8]. Stentoft [
53] further notes that incorporating FIEGARCH features in option pricing models may help to explain some empirically well-documented systematic pricing errors. In addition, out-of-sample performance shows that FIEGARCH effects are important when pricing options on individual stocks and that they lead to improvements over the constant volatility model.
Apart from the proposed model, other methodologies, such as the STAR model, can also incorporate the long-memory process [
66]. More recently, with the advance of machine learning methodologies, multi-layer perceptron neural networks have been developed to accommodate regime switching and long memory in volatility modeling. Examples of those models with applications in financial data can be found in Bildirici and Ersin [
67], Bildirici and Ersin [
68], and Bildirici and Ersin [
69], among others. A systematic comparison of the proposed MRS-FIEGACH and those frameworks remains for the future.