Next Article in Journal
Empowering Non-Academic Staff for the Implementation of Sustainability in Higher Education Institutions
Previous Article in Journal
The Impact of Chief Sustainability Officers on Environmental Performance of Korean Listed Companies: The Mediating Role of Corporate Sustainability Practices
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Socio-Economic Development of European Countries in Times of Crisis: Ups and Downs

1
Department of Applied Social Sciences, Faculty of Organization and Management, Silesian University of Technology, 41-800 Zabrze, Poland
2
Oleg Balazkiy Department of Management, Academic and Research Institute of Business, Economics and Management, Sumy State University, 39 Soborna Street, 40000 Sumy, Sumy Region, Ukraine
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(20), 14820; https://doi.org/10.3390/su152014820
Submission received: 13 August 2023 / Revised: 2 October 2023 / Accepted: 6 October 2023 / Published: 12 October 2023

Abstract

:
This article analyzes the dynamics of the changes in indicators of socio-economic development under conditions of financial and economic crises and their negative consequences. The study proves that financial crises are associated with severe and prolonged downturns in economic activity. The socio-economic development of European countries in times of crises was analyzed. The cyclical nature of the onset of crises was confirmed via the study of the dynamics of socio-economic development indicators. The main emphasis was on the financial crisis of 2008–2009 and the COVID-19 crisis (2020–2021). The main indicators characterizing the crises were identified based on an analysis of literary sources. Their classification was developed according to the following groups: leading indicators, lagging indicators, and client leading indicators of expansion. Based on the correlation analysis, indicators that have a significant impact on socio-economic development and are predictors of crisis onset were identified. The authors suggest considering such leading indicators as increases in the private credit in the GDP, budget deficit, balance of payment deficit, and real interest rate. The major lagging indicators that have strong correlations with the GDP, such as the employment rate, general government debt, stock price volatility, and investment, were identified. Client leading indicators of expansion include unemployment, an increase in the number of new enterprises, an increase in purchasing power, etc. Some indicators, such as unemployment, can be both lagging indicators and client leading indicators of expansion. The negative consequences of the crisis are caused by the crisis itself as well as by the imbalances preceding the crisis. Therefore, the study of the predictors of crisis onset is relevant for timely decision making in order to prevent the negative consequences of the crisis. Based on the identified lagging indicators, the 2008–2009 crisis and the COVID-19 crisis were studied. To study the development processes of these crises, the authors analyzed by quarters the dynamics of the development of the following macroeconomic indicators: the GDP, employment, and investment levels. The similarities and discrepancies were identified in the natures of the emergences and courses of the 2008–2009 crisis and the COVID-19 crisis using the comparison method. The case study of the Eurozone and individual EU countries (Germany, France, Italy, and Spain) was used. Considering the similar courses of the crises, the forecast of the socio-economic development was made using the analyzed indicators during the COVID-19 crisis based on the 2008–2009 crisis data. The forecast approximation indicators were calculated, and a method for constructing further forecasts was selected. Based on retrospective data, the GDP forecast was developed via the use of the extrapolation method for 2023–2024. It is necessary to consider that while forecasting crises caused by unforeseen events and external influences, it is advisable to use qualitative analysis along with quantitative analysis. This article will be useful to researchers, political elites, experts, and financial analysts when developing programs for the socio-economic development of countries.

1. Introduction

A characteristic feature of socio-economic development is the crises caused by external and internal factors. Crises can lead to negative consequences in the economy, as well as become an impetus to significant positive shifts in socio-economic development. Crises have a systemic and comprehensive nature and occur at different levels of management. The banking system, the labor market, public debt, exchange rate collapse, and inflation often intersect and turn into conglomerate crises connected with economic depressions.
Let us consider in more detail the major world crises. In the early 1980s, financial and sovereign debt crises began, and the world economy went into deep recession. But until 1983, the United States and other advanced economies did not feel the effects of these crises, and these countries experienced robust growth along with declining inflation.
The global financial crisis of 2007–2009 had a negative impact on advanced economies. As the USA and Europe fell into recession, China was actively growing and raising world commodity prices [1].
In 2019, the COVID-19 crisis began. In the beginning, this crisis did not have negative consequences for the economy. However, it gradually turned into a financial crisis due to the governments’ decisions to enforce lockdowns, which led to a halt in production, the termination of supply chains, increased unemployment, increased inflation, etc. Thus, this crisis is comparable to financial crises.
According to the theory of economic cycles, financial crises occur after prolonged increases in economic activity. Growth is often followed by the intensity of lending and the growth of leverage [2,3,4]. The COVID-19 crisis does not correspond to the historical rise-and-fall pattern, as there was no observed economic growth before it [4]. The financial consequences of the pandemic did not depend on a country’s income level or geographic location. However, the countries with middle and low levels of income became more vulnerable to the consequences of the crisis caused by the pandemic [5].
During the crisis and the post-crisis period, decisions at all levels of management are, to some extent, made under conditions of uncertainty. Consideration of the peculiarities of crisis processes, which have different natures of course, accumulates experience for making effective managerial decisions while shaping fiscal and monetary policy and ensuring macroeconomic stability. For instance, the driving down of the interest rate by the US Federal Reserve and other measures on increasing liquidity under conditions of the COVID-19 pandemic have prevented new sovereign defaults [6].
Scientists study the nature of a crisis’s occurrence, the unfolding of the crisis, and their impact on the socio-economic development of countries. C.M. Reinhart [1] argues that countries’ individual crises transit into conglomerates. He suggests that crises have affected the form and speed of economic renewal. M.D. Borde, C.M. Meissner [2], M. Schularick, and A.M. Taylor [4] studied the early warning indicators of crises and discovered that a wide range of variables are potential predictors. However, these authors consider that the major indicator is the credit boom. This study focuses on the major indicator, (i.e., the credit boom), and other indicators that may be crisis predictors are not considered.
In addition, different scientists study some types of crises and do not bond them. This study attempts to compare the world’s largest crises, and to identify and classify such indicators as crisis predictors, lagging indicators, or client leading indicators of expansion. For example, Choudhry, M. T., Marelli, E., and Signorelli, M. [7] proved the impact of financial crises on youth unemployment beyond the influence of changes in the GDP. Sobotka, T., Skirbekk, V., and Philipov, D. [8] considered the impact of economic downturns on birth rates in the developed countries of the world.
Considering the wide range of studies concerning the effects of crisis processes on the socio-economic development of countries, this issue is still relevant. Due to the influence of exogenous and endogenous factors in the socio-economic development of countries, the nature of the crisis is changing. Therefore, there is a need for further research on the indicators of macroeconomic stability in the pre-crisis, crisis, and post-crisis periods.
The study puts forward the hypothesis that studying the experience of the nature of the occurrences of crises and the nature of the courses of crises can be partially used in the forecasting and prevention of future crises.
The purpose of the article is to analyze the socio-economic development of the EU countries in times of financial and economic crises in order to determine the natures of the crises and to choose a more accurate forecasting method.

2. Materials and Methods

After reviewing the literary sources by using the Scopus database, the main predictors of the onset of the crises were identified. Regression and correlation analyses determined the strengths of the links between these predictors and the GDPs for the Eurozone and four major countries (Germany, France, Italy, and Spain).
In the second stage, the similarities and discrepancies in the periods of crises were determined via the comparison method using the case study of the 2008–2009 crisis and the COVID-19 crisis.
In the third stage, GDP forecasting for these countries was performed using the extrapolation method using the linear stochastic model of GDP dynamics. The model y = f (GDP) was used.
The research algorithm is given in Figure 1.

3. Results

Literature Review

A literature analysis of 3057 results was carried out using the Scopus database using the keywords “crisis” and “Gross Domestics Product”. The analysis showed that interest in the research topic has been intensifying since 2008. This was especially observed during the period of crisis process exacerbation (Figure 2).
The problem of the crisis has been considered in different fields of knowledge. In the period 1977–2023, most research on crisis processes in the economy occurred in the following areas of knowledge: economics, econometrics, and finance (47.6%); social sciences (23.1%); business, management, and accounting (22.2%) (Figure 3).
It is possible to distinguish the following countries in which the crisis processes in the economy and their effect on the GDP are the most studied: the United States (457 documents), the United Kingdom (257), Germany (183), Italy (172), Spain (126), France (122), India (117), China (112), and Greece (92) (Figure 4).
The conducted analysis of the studies on the effect of crisis processes on the GDP confirms the relevance of this topic.
The search was carried out using the Scopus database using the VOSviewer program (version 1.6.16). The search resulted in 564 documents. The terms used for the software are given in Table 1.
The results were filtered by document type, year, source type, subject area, and keywords. Five research clusters were identified during the bibliographic analysis. Publications in economics and social sciences were chosen as the major filter. The results of the analysis are given in Table 2, and the visualization is shown in Figure 5.
Further, a detailed analysis of literary sources was carried out within the red cluster. The major publications are devoted to studying the impact of various crises on macroeconomic development. The impact of financial crises on the youth unemployment rate was considered by Choudhry M.T., Marelli E., and Signorelli M. [7]. The authors confirm that financial crises affect the youth unemployment rate for five years after the onset of the crisis, but the most favorable effects are observed in the second and third years after the financial crisis.
Schneider, F., Kallis, G., and Martinez-Alier, J. consider economic crises as the beginning of new opportunities [9]. The study analyzes the conditions under which economic degrowth is desirable and undesirable. Bardy, R. and Rubens, A. provide multiple opportunities for economic redevelopment after a crisis. The authors consider crises as opportunities not only to solve the problem of the deficit of infrastructure and social systems, but also to develop political priorities towards a “green economy” [10].
Huang, B. N., Hwang, M. J., and Yang, C. W. consider another type of crisis: the energy crisis. In their research, the authors used panel data on the energy consumption and GDPs of 82 countries from 1972 to 2002 and identified causal relationships between energy consumption and economic growth [11]. Li, C.C. and Chang, C.P. studied 22 developed and 18 developing countries and identified a dynamic interaction between the energy consumption per capita (LEC) and the real GDP per capita (LRY). The study reveals that energy crises significantly impacted both the LEC and LRY in all the countries in the sample [12].
Some authors have studied economic development during the stages of economic downturns. In particular, Arcand, J.L., Berkes, E., and Panizza, U. studied the impact of financial depth on economic development. Using various empirical approaches, the authors proved that financial depth has a negative impact on production growth [13].
In their turn, Sobotka, T., Skirbekk, V., and Philipov, D. studied the impact of economic downturns on the birth rates in the world’s developed countries. The indicators that measure economic downturns, such as declining GDP levels, falling consumer confidence, and rising unemployment, and their impacts on the birth rate were studied. The authors identified a strong relationship between recessions and birth rates [8].
Other authors have studied the development of the economy at the stage of growth. Dell’Ariccia, G., Detragiache, E., and Rajan, R. analyzed the impact of the banking crisis on the growth of industrial sectors [14].
Shen, C.H. and Lee, C.C. identified a relationship between financial development and real GDP per capita growth. The research proves that “only stock marketing development has positive effects on growth and that banking developments have an inefficient effect” [15]. In their research, Baum, A., Checherita-Westphal, C., and Rother, P. revealed the relationship between public debt and economic growth for 12 countries of the Eurozone [16]. It was proved that “for high debt-to-GDP ratios (up to 95%), additional debt has a negative impact on economic activity the long-term interest rate is subject to increased pressure when the public debt-to-GDP ratio is above 70%”.

4. Research

4.1. Research of the Nature of Crisis Occurrence

The COVID-19 pandemic has drawn the attention of scientists to the vulnerability of countries to sudden crises. Crises are a characteristic feature of socio-economic development, and they have a cyclical nature. The cyclicity is connected with fluctuations in economic activity—economic expansion and recession (crises).
The crisis of 1997–1998 was one of the crisis periods in the world. This crisis began in 1997 in the countries of South and East Asia.
In 2007–2008, the global economic crisis (“great recession”) occurred. It began with a subprime mortgage crisis in the United States. One of the causes of this crisis was incorrect pricing in the credit default swap market [17]. In April 2008, there was a decrease in the liquidity of real estate in the United States, with a decrease in prices of 10–15%. According to the IMF estimates, the securities market for American subprime mortgages experienced a decrease in their value in the amount of USD 450 billion during the year, while the total volume of the securities market was approximately USD 1.5 trillion [18]. The subprime mortgage crisis turned into a financial one in summer 2007. In 2008, the crisis acquired a global nature and caused a decrease in production volumes and the liquidity of companies, a decrease in the demand and prices for raw materials, and an increase in employment [19]. This period is characterized by the downward phase of the fifth Kondratieff long wave, which led to a protracted economic recovery [20]. The shock resistance of the sustainable functioning of the financial sector is determined not only by fluctuations in the economy, but also, to some extent, by imbalances in the processes of the financial sector itself [21]. In addition, this financial crisis was complicated by the spread of the global epidemic of H1N1 influenza [22].
The year of 2020 was associated with the spread of the coronavirus infection, which caused crises in many countries. It caused crises for public health in the first place [23], but the actions related to enforcing the lockdowns led to the deep economic crises that we are still experiencing. In the economies of the countries of the world, the following effects were observed: declines in the GDPs, increases in unemployment and underemployment, losses of jobs and income by businesses (especially in the most affected sectors), closures of small- and medium-sized enterprises, disruptions in supply chains, increases in social inequality, etc. [24].
Due to these facts and the prevailing high uncertainty, in March 2020, some key financial indicators fell to levels similar to those seen during the Great Recession of 2008–2009 (Figure 6) [25].
The figure shows that there were declines in the GDPs in 1999, 2009, and 2020. The crisis of 1997 is especially typical for Bulgaria (GDP decline: 14.1%) and Romania (GDP decline: 4.6%). Thus, in 2009, the decline in the GDP in the European Union was by 4.3%, but the largest drops in the GDPs were in such countries as Lithuania (−14.8%), Latvia (−14.2%), and Estonia (−14, 6%). All countries of the European Union were affected by the crisis of 2020, especially Italy (GDP drop: 9%), Spain (GDP drop: 10.8%), and Portugal (GDP drop: 8.4%). In addition to the impact of global crises, it is advisable to take into account internal crises. In this study, the impact of such crises is leveled.

4.2. Identification of Indicators Characterizing Crises at Different Stages

When analyzing financial crises, scientists identify the different indicators that characterize them. Based on the research of Palasca, S. and Jaba, E., the authors of this article suggest a scientific approach to the classification of indicators that characterizes the crisis at different stages of its manifestation (Figure 7) [27].
Under the reasons, the authors consider the factors that led to the crisis. Allen, F. and Carletti, E. argue that, in the USA and some other countries, there was a bubble in the real estate prices, which was caused by a combination of cheap loans and the easy availability of funds, which led to the crisis. Factors such as subprime mortgages, weak regulatory structures, and high leverage in the banking sector exacerbated the crisis [28].
Stockhammer, E. considers the inefficient functioning of the financial sector to be the cause of the global crisis that began in the summer of 2007. In particular, the securitization of mortgage loans contributed to the rapid growth of credit and the destruction of credit standards, and this fueled a property bubble [29].
In his research, Jickling, M. identified a number of factors that were determined as the causes of the crisis: imprudent mortgage lending, securitization, a lack of transparency and accountability in mortgage finance, deregulatory legislation, shadow banking systems, the failure of the system, the relaxed regulation of leverage, credit default swaps, over-the-counter derivatives, fragmented regulation, no systemic risk regulator, etc. [30].
According to the authors, the concept of leading indicators/predictors of economic crises implies the indicators that show negative social and economic development in advance. Thanks to these indicators, it is possible to identify the pre-crisis development of the economy. Chen, T. H., Lee, C. C., and Shen, C. H. consider the liquidity ratio (LiqR), liquidity creation (LiqC), and net stable funding difference (NSFD) as the early warning signals (predictors) for distressed banks [31].
Frankel, J. and Saravelos, G. studied more than 80 indicators that could have been predictors of the crisis and singled out two main ones: central bank reserves and past movements in the real exchange rate. The authors also name other predictors of the crisis: credit growth, current account deficits, the saving rate, and external and short-term debt [32].
Lane, P. R. and Milesi-Ferretti, G. M. identify the following indicators that help to determine that a crisis is coming: increases in the ratio of private credit to the GDP, current account deficits, and openness to trade [33].
Frankel, Jeffrey A. and George Saravelos suggest 30 predictors of economic crises. The main ones are as follows: reserves, short-term debt, the bank liquid reserve-to-bank asset ratio, the trade balance, inflation, the real interest rate, etc. [32].
Crisis predictors are indicators that have negative trends of change, which indicate the presence of a crisis. Antohi, V. M. et al. consider the changes in expenditure and revenue structures and deficits in the budget to be the major indicators that change during economic crises [34].
Lagging indicators are indicators that change after the onset of a crisis. At this stage of the crisis, it is too late to take measures to counter it. Palasca, S. and Jaba, E. identify such lagging indicators as the GDP, unemployment, and the price of gold [27]. The price of gold is a financial index, a leading indicator due to the fact that most economic crises start in the financial market. Unemployment can also characterize negative economic fluctuations, but its effect is seen after the crisis. Despite this fact, unemployment is also a client leading indicator of expansion. Client leading indicators of expansion are indicators in which change characterizes the beginning of an economic recovery. A growing economy needs a workforce, and so a drop in the unemployment rate is clear evidence of an economic recovery. It is observed at least one–two quarters before the results are reflected in the GDP.
Sinaga, A.P. argues that the inflation variable, interest rates, and the trade balance affect economic growth through an increase in the balance of payments. These macroeconomic indicators can accelerate economic recovery [35].
After facing such a large-scale and fast economic crisis caused by the COVID-19 pandemic, Shin, J.H. et al. insist on using “fast indicators”. These indicators are as follows: data from payment systems (such as debit and credit card transactions), cash withdrawals from ATMs, data from fintech apps, such as Money Dashboard, and Google searches for the term “unemployment benefit, price effects of shortages”, which allow for tracking price inflation and consumer spending [36].
The following types of indicators are commonly used to assess the macroeconomic stability: price inflation, growth in the real GDP, changes in employment/unemployment, current account volatility, the health of government finances, interest rate volatility (and government bond yields), and the exchange rate stability [37].
The European Union defines macroeconomic stability according to the Maastricht Treaty. Thus, macroeconomic stability consists of four criteria and five indicators: low and stable inflation, low long-term interest rates, low national debt relative to the GDP, low deficits, and currency stability [38].

4.3. Assessment of Macroeconomic Stability Indicators

Taking into account previous research, the authors suggest assessing the macroeconomic stability by using the following indicators: the GDP, the employment rate, inflation (CPI), general government debt, the FDI flow outward, long-term interest rates, short-term interest rates, exchange rates, the bank return on assets, the bank return on equity, the real interest rate, non-performing loans as a percent of all bank loans, the bank cost-to-income ratio, the stock market return, the stock market turnover ratio, stock price volatility, crude oil import prices, and investment.
The major indicator of the social and economic development of countries is the GDP, which characterizes the presence of a crisis. Therefore, we carried out a correlation analysis of other indicators specifically for the GDP indicator. The results of the calculation are given in Table 3. For the correlation analysis, the average values of the indicators for the EU (27 countries) for the years 2000–2021 were taken. Separate calculations were conducted to verify the results for the countries France, Spain, Germany, and Italy. The countries were selected according to the contributions of the member countries to the EU budget.
As can be seen from Table 3, the indicators that have strong relationships with GDP growth are as follows: the employment rate (K = 0.863574), general government debt (K = −0.84313), stock price volatility (K = −0.84663), and investment (K = 0.977859). Thus, the revival of economic activity leads to an increase in employment, which, in turn, has a positive effect on the GDP. The inflow of investments into a country contributes to economic growth. The increase in general government debt has a negative effect on the GDP. Stock market volatility is a measure of how much the overall value of a stock market fluctuates up and down. The lower the stock price fluctuations, the more stable the country’s economic system.
Indicators that have moderate correlations are as follows: the FDI flow outward (K = 0.510918), long-term interest rates (K = 0.587721), short-term interest rates (K = 0.533842), non-performing loans (K = −0.62499), and crude oil import prices (K = 0.585104).
For further research, the following four indicators of macroeconomic stability with the highest correlations with GDP growth were selected. The authors developed crisis development scenarios to classify these indicators into the following groups: crisis predictors, lagging indicators, and client leading indicators of expansion.

4.4. Comparison of Macroeconomic Stability Indicators during the Financial Crisis and the COVID-19 Crisis

Researchers often attempt to compare the expected economic consequences of the COVID-19 pandemic with the global financial and economic crisis of 2008–2009. To support this hypothesis, the authors analyzed the economic indicators that describe the economic changes during the coronavirus crisis and the financial market crisis.
For this purpose, the onset of the coronavirus-related recession in the first quarter of 2020 is compared to the onset of the financial market crisis in the second quarter of 2008. To confirm the hypothesis, we compared the increase in the GDP from the first quarter of 2008 to the fourth quarter of 2010 and from the first quarter of 2020 to the first quarter of 2022. Figure 2 and Figure 3 show the GDP growth for the Eurozone and individual EU countries (Germany, France, Italy, and Spain). The consequences of the financial crisis on the socio-economic development of the EU countries were felt after six months after the onset of the crisis, while the coronavirus crisis manifested itself immediately. To compare the data, we superimposed the graphs of the GDP growth from the third quarter of 2008 to the fourth quarter of 2010 and from the second quarter of 2019 to the second quarter of 2021.
As can be seen in Figure 8, the development cycles of the crises coincide.
The financial crisis was prolonged; thus, there was a gradual decline in the GDPs. At the same time, the coronavirus crisis is characterized by sharp fluctuations in the GDPs: a sharp fall in the third quarter of 2020 due to the implementation of lockdowns around the world, and a sharp rise in the second quarter of 2021 due to their removal.
As shown in Figure 9, the development cycles of the GDP growth coincide both for the EU countries as a whole and for the individual analyzed countries. Therefore, in further studies, the average values of the indicators for 27 EU countries will be taken.
We also compared the fluctuations in the employment levels (Figure 10) in the countries of the European Union (27 countries) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022). As illustrated in Figure 4, during the crisis of 2008–2012, there was a slow decline in employment in the first quarter of 2009, and there has been a gradual increase in employment since the first quarter of 2011. During the coronavirus crisis, a decline in employment was observed in the second quarter of 2020, but a slow increase in employment since the second quarter of 2021 has been observed.
After analyzing the investment activity during the financial crisis and the coronavirus crisis, it can be stated that the crisis of 2020 was much deeper than the crisis of 2008, but the resumption of investment activity occurred immediately after the lockdowns were lifted (Figure 11). Figure 11 shows that the decrease in the investment rate occurred in the first quarter of 2009 and that there was growth in the second quarter. As for the crises of 2019–2022, a fall in investment was observed in the second quarter of 2020, while a sharp increase occurred in the third quarter of 2020.

4.5. Forecasting the Consequences of the COVID-19 Crisis

It is necessary to take into account the forecast data of indicators of socio-economic development to prevent and avoid the manifestation of the negative consequences of the crisis. The algorithm of the forecast construction is given in Figure 12.
The following models can be used in forecasting: linear regression, extrapolation smoothing, and autoregressive (AR) models, moving-average (MA) models, autoregressive–moving-average (ARMA) models, seasonal autoregressive–integrated–moving-average (SARIMA) models, and neural networks. At this stage, the forecast errors (MARE, MAE, MSE, R2) are calculated and the model with the lowest error is selected. In the case of the evolutionary development of the economy, the forecast results are obtained at the next stage. To forecast crisis periods, it is also necessary to carry out a qualitative analysis to take into account unforeseen events and external influences. Financial crises can be caused by unforeseen events and external influences, such as economic crises in other countries, natural disasters, political instability, etc. If such events are not correctly taken into account in the forecast, then this could lead to inaccuracies.
The authors approximated the forecast using the extrapolation method in order to make a forecast for the main economic indicator—the GDP. For this purpose, a forecast for 2016–2021 was made on the basis of retrospective data from 2000–2015. The authors used the moving-average method. An assessment of the forecast realism was conducted via such coefficients as the RMSE and MAPE, using the coefficients for the qualitative assessment of the forecasting models. The results are given in Table 4.
The results of the forecasting model given in the table show the high accuracy of the forecast, but, despite this, the extrapolation method is more effective under conditions of the evolutionary development of the economy. For the more accurate forecasting of the crisis, it is necessary to conduct a qualitative analysis that takes into account unforeseen events.
Based on the suggested model, a forecast of the socio-economic development in the post-crisis period (2023–2024) was created using the extrapolation method for the EU countries. The studied countries are highlighted by color (Spain, France, Italy, and Germany). Red colors highlight the average GDPs for the 27 EU countries.
Figure 13 shows the forecast of the real GDPs until 2024 for the countries of the European Union.
Figure 13 shows the similarity of the flows of the studied crises. It is seen that the recession began the year after the crisis. Then, the indicators of socio-economic development declined during the following two years. This forecast can be used for making managerial decisions to mitigate the consequences of the crisis.

5. Discussion

Even before the onset of the COVID-19 crisis, the achievement of the sustainable development goals was slow [40]. The authors considered the peculiarities of the COVID-19 crisis, and its negative consequences on the economic, social, and energy parameters of the sustainable development of the EU countries were discovered [41,42]. This is confirmed by the forecast of the development of the countries’ economies for the next 3 years [43]. As of today, there is a possibility that most of the 169 Sustainable Development Goals will not be achieved by 2030. The rapid restoration of the parameters of sustainable development is possible due to the effective interaction of the institutions of government, business, and society. New threats (cyber threats) have also appeared, which have become a permanent part of the development landscape [44].
Further research will focus on analyzing the predictors of the crisis unfolding and assessing the risks of the decline in socio-economic development.
One of the unforeseen events of 2022–2023 could become the military aggression of Russia against Ukraine, which, in the long run, could cause a crisis. The preconditions for the crisis may be as follows: the refusal to use Russian energy resources, the termination of logistics links, the growth of migration flows (refugees who need to be supported), and military and financial assistance to Ukraine. The consequences of the military conflict in Ukraine for the EU countries may be obstacles to economic growth, an increase in prices for raw materials, and an increase in inflation. Researchers Verwey, M., Bardone, L., Orsini, K., Reinhart, C. M., and Rogoff, K. S. [45,46], in their study, proved that the baseline EU growth outlook was revised downward, taking into account the conditions of uncertainty and risks. In order to overcome the crisis, it is also necessary to revise the social policies of both the EU countries and Ukraine separately. One of the urgent problems is the reform of the medical sector. Sheliemina, N. proves that one of the factors of economic stability is the quality of the medical field [47].
The psychological aspect of recovery after a war crisis is also a cause for concern. Based on the results of a study on various societies during the post-war period, Hakobyan, N., Dabaghyan, A., and Khachatryan, A. identified strategies for overcoming social anomie in the spheres of social interactions and business. The formation of strategies for overcoming socio-psychological crises and the impact on the economic development of the post-war period may become the next direction of our research [48].

6. Conclusions

1. Financial crises can be caused by unforeseen events and external influences, such as economic crises in other countries, natural disasters, political instability, etc. If such events are not correctly taken into account in the forecast, then this could lead to inaccuracies. During the crisis and the post-crisis period, decisions at all levels of government are, to some extent, made under conditions of uncertainty. Considering the course of crises as one of the phases of the economic cycle accumulates the experience for making effective anti-crisis decisions.
The article considers the main crises beginning in 1980 and ending with the COVID-2019 crisis, which arose suddenly as a pandemic and gradually developed into a financial crisis;
2. The study analyzed the main indicators that characterize crises and conditionally divided them into the following groups: leading indicators, lagging indicators, and client leading indicators of expansion;
3. The study carried out a correlation analysis of the GDP indicator via the main indicators of macroeconomic stability: the employment rate, inflation (CPI), general government debt, the FDI flow outward, long-term interest rates, short-term interest rates, exchange rates, the bank return on assets, the bank return on equity, the real interest rate, non-performing loans as a percent of all bank loans, the bank cost-to-income ratio, the stock market return, the stock market turnover ratio, stock price volatility, crude oil import prices, and investment. According to the results of the correlation analysis, four leading indicators that have the greatest impacts on GDP growth were identified. They are as follows: the employment rate (K = 0.863574), general government debt (K = −0.84313), stock price volatility (K = −0.84663), and investment (K = 0.977859). Monitoring these indicators makes it possible to promptly prevent the onset of a crisis, taking into account the cyclical nature of economic development and unforeseen events.
Thus, according to the cycle of Kondratiev, the macroeconomic growth should have occurred in 2020 according to the sixth big cycle. However, the COVID-19 pandemic has changed the trajectory of the global economy;
4. The authors compared the COVID-19 crisis and the financial crisis of 2008–2009 by quarters in order to study the development of the crisis. The hypothesis of the same courses of crises was confirmed, but it should be noted that the COVID-19 crisis had large fluctuations. In the case study of the Eurozone and individual EU countries (Germany, France, Italy, and Spain), the dynamics of the development of macroeconomic indicators, such as the GDP, employment levels, and investment levels, were analyzed. Thus, in terms of the GDP indicator, the periods of falls and rises coincided, but there were large fluctuations in this indicator. Thus, it can be argued that the study of previous crises can be the basis for forecasting future crises;
5. When forecasting a crisis, it should be taken into account that the quality of the forecast depends on the influence of unforeseen events and external influences. The authors made a forecast of the main economic indicator—the GDP—using the extrapolation method and determined its accuracy. It is expedient to use the extrapolation method while forecasting crises caused by the cyclical development of the economy. It is advisable to carry out qualitative analysis along with other forecasting methods to predict crises that are caused by unforeseen events and external influences.
During the crisis and the post-crisis period, decisions at all levels of government are, to some extent, made under conditions of uncertainty. Studying the features of the course of the crisis processes helps management at different managerial levels to accumulate experience in making effective management decisions aimed at socio-economic development.

Author Contributions

Conceptualization, D.K., V.M. and Y.O.; methodology, V.M. and Y.O.; software, V.M. and I.R.; validation, Y.O. and I.R.; formal analysis, V.M. and Y.O. resources, V.M., Y.O. and I.R.; visualization, Y.O.; writing—original draft, V.M., Y.O. and I.R.; writing—review and editing, V.M., Y.O., I.R. and D.K.; supervision, D.K.; project administration I.R. and D.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded under the research subsidy of the Faculty of Organization and Management of the Silesian University of Technology in Poland for the year 2023 (13/990/BK_23/0178).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data used in the study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Reinhart, C.M. From health crisis to financial distress. IMF Econ. Rev. 2022, 70, 4–31. [Google Scholar] [CrossRef]
  2. Bordo, M.D.; Christopher, M. Meissner. Fiscal and Financial Crises. Handb. Macroecon. 2016, 2, 355–412. [Google Scholar] [CrossRef]
  3. Laeven, L.; Valencia, F. Systemic Banking Crises Database. IMF Econ. Rev. 2013, 61, 225–270. [Google Scholar] [CrossRef]
  4. Schularick, M.; Taylor, A.M. Credit booms gone bust: Monetary policy, leverage cycles, and financial crises, 1870–2008. Am. Econ. Rev. 2012, 102, 1029–1061. [Google Scholar] [CrossRef]
  5. Kuzior, A.; Kashcha, M.; Kuzmenko, O.; Lyeonov, S.; Brożek, P. Public Health System Economic Efficiency and COVID-19 Resilience: Frontier DEA Analysis. Int. J. Environ. Res. Public Health 2022, 19, 14727. [Google Scholar] [CrossRef] [PubMed]
  6. Farah-Yacoub, J.; von Luckner, C.G.; Reinhart, C.M. The Eternal External Debt Crisis: A Long View; World Bank: Washington, DC, USA, 2021. [Google Scholar]
  7. Choudhry, M.T.; Marelli, E.; Signorelli, M. Youth unemployment rate and impact of financial crises. Int. J. Manpow. 2012, 33, 76–95. [Google Scholar] [CrossRef]
  8. Sobotka, T.; Skirbekk, V.; Philipov, D. Economic recession and fertility in the developed world. Popul. Dev. Rev. 2011, 37, 267–306. [Google Scholar] [CrossRef]
  9. Schneider, F.; Kallis, G.; Martinez-Alier, J. Crisis or opportunity? Economic degrowth for social equity and ecological sustainability. Introduction to this special issue. J. Clean. Prod. 2010, 18, 511–518. [Google Scholar] [CrossRef]
  10. Bardy, R.; Rubens, A. Weighing Externalities of Economic Recovery Projects: An Alternative to Green Taxonomies that is Fairer and more Realistic. Bus. Ethics Leadersh. 2022, 6, 23–34. [Google Scholar] [CrossRef]
  11. Huang, B.N.; Hwang, M.J.; Yang, C.W. Causal relationship between energy consumption and GDP growth revisited: A dynamic panel data approach. Ecol. Econ. 2008, 67, 41–54. [Google Scholar] [CrossRef]
  12. Lee, C.C.; Chang, C.P. Energy consumption and GDP revisited: A panel analysis of developed and developing countries. Energy Econ. 2007, 29, 1206–1223. [Google Scholar] [CrossRef]
  13. Arcand, J.L.; Berkes, E.; Panizza, U. Too much finance? J. Econ. Growth 2015, 20, 105–148. [Google Scholar] [CrossRef]
  14. Dell’Ariccia, G.; Detragiache, E.; Rajan, R. The real effect of banking crises. J. Financ. Intermediat. 2008, 17, 89–112. [Google Scholar] [CrossRef]
  15. Shen, C.H.; Lee, C.C. Same financial development yet different economic growth: Why? J. Money Credit Bank. 2006, 38, 1907–1944. [Google Scholar] [CrossRef]
  16. Baum, A.; Checherita-Westphal, C.; Rother, P. Debt and growth: New evidence for the euro area. J. Int. Money Financ. 2013, 32, 809–821. [Google Scholar] [CrossRef]
  17. Murphy, A. An analysis of the financial crisis of 2008: Causes and solutions. Anal. Financ. Crisis 2008. [Google Scholar] [CrossRef]
  18. Lopatin, A.K. System analysis of the world financial crisis of 2007–2008 (statistical aspects). Artif. Intell. 2008, 3, 179–186. [Google Scholar]
  19. Kaya, H.D.; Engkuchik, E.N. The Impact of the 2008–2009 Global Crisis on Manufacturing Firms’ Fixed Asset Purchases: The Case of Eastern Europe and Central Asia. Financ. Mark. Inst. Risks 2022, 6, 36–42. [Google Scholar] [CrossRef]
  20. Olefir, K. Economic cycles and crises: History and modernity. Actual Probl. Econ. 2013, 10, 23–35. [Google Scholar]
  21. Vasilyeva, T.A.; Leonov, S.V.; Lunyakov, O.V. Analysis of internal and external imbalances in the financial sector of Ukraine’s economy. Actual Probl. Econ. 2013, 150, 176–184. [Google Scholar]
  22. Letunovska, N.E.; Vasilyeva, T.A.; Smyanov, V.A. The COVID-19 pandemic as a crisis-forming factor in the healthy development of regions. Bull. Sumy State Univ. Ser. Econ. 2020, 3, 191–198. [Google Scholar] [CrossRef]
  23. Kuzior, A.; Vasylieva, T.; Liuta, O.; Deineka, O.; Kashcha, M. The Impact of the Organization of Public Health Systems on the Ability of Countries to Resist the COVID-19 Pandemic: The Experience of Developed Countries of the World and Ukraine. Int. J. Environ. Res. Public Health 2023, 20, 6106. [Google Scholar] [CrossRef] [PubMed]
  24. Opanasiuk, Y.; Martynets, V.; Matvieieva, Y. Socio-economic development of Ukraine in uncertainty. Effic. Econ. 2021, 8. [Google Scholar] [CrossRef]
  25. Illanes, G.; Mordecki, E.; Sosa, A. On the impact of the Covid-19 health crisis on GDP forecasting: An empirical approach. J. Dyn. Games 2022, 9, 229–239. [Google Scholar] [CrossRef]
  26. OECD Data. Available online: https://data.oecd.org/gdp/quarterly-gdp.htm#indicator-chart (accessed on 5 May 2023).
  27. Palasca, S.; Jaba, E. Leading and lagging indicators of the economic crisis. Rev. Rom. Stat. 2014, 62, 31–47. [Google Scholar]
  28. Allen, F.; Carletti, E. An overview of the crisis: Causes, consequences, and solutions. Int. Rev. Financ. 2010, 10, 1–26. [Google Scholar] [CrossRef]
  29. Stockhammer, E. Neoliberalism, income distribution and the causes of the crisis. In The Financial Crisis; Palgrave Macmillan: London, UK, 2011; pp. 234–258. [Google Scholar] [CrossRef]
  30. Jickling, M. Causes of the Financial Crisis. 2009. Available online: https://hdl.handle.net/1813/77536 (accessed on 5 May 2023).
  31. Chen, T.H.; Lee, C.C.; Shen, C.H. Liquidity Indicators, Early Warning Signals in Banks, and Financial Crises. N. Am. J. Econ. Financ. 2022, 62, 101732. [Google Scholar] [CrossRef]
  32. Frankel, J.; Saravelos, G. Can leading indicators assess country vulnerability? Evidence from the 2008–09 global financial crisis. J. Int. Econ. 2012, 87, 216–231. [Google Scholar] [CrossRef]
  33. Lane, P.R.; Milesi-Ferretti, G.M. The cross-country incidence of the global crisis. IMF Econ. Rev. 2011, 59, 77–110. [Google Scholar] [CrossRef]
  34. Antohi, V.M.; Fortea, C.; Zlati, M.L.; Ionescu, R.V.; Mirică, C. Efficiency of financial indicators of the Romanian state budget, an objective of economic security during the epidemiological crisis. J. Financ. Stud. 2022, 7, 38–51. [Google Scholar] [CrossRef]
  35. Sinaga, A.P. Inflation, Foreign Exchange, Interest Rate, Trade Balance, Payment Balance on Growth in the COVID-19 Pandemic. SocioEcon. Chall. 2022, 6, 52–59. [Google Scholar] [CrossRef]
  36. Shin, J.H.; Lee, G.; Kim, J.S.; Oh, H.S.; Lee, K.S.; Hur, Y.; Cho, B.L. Effects of the 2008 global economic crisis on national health indicators: Results from the Korean National Health and Nutrition Examination Survey. Korean J. Fam. Med. 2015, 36, 162–167. [Google Scholar] [CrossRef] [PubMed]
  37. Development and Globalization: Facts and Figures. Available online: https://stats.unctad.org/Dgff2016/index.html (accessed on 5 May 2023).
  38. EUR-Lex: Access to European Union Law. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=celex%3A11992M%2FTXT (accessed on 5 May 2023).
  39. OECD iLibrary. Available online: https://www.oecd-ilibrary.org/governance/general-government-debt/indicator/english_a0528cc2-en (accessed on 5 May 2023).
  40. Kuzior, A.; Lobanova, A. Tools of Information and Communication Technologies in Ecological Marketing under Conditions of Sustainable Development in Industrial Regions (Through Examples of Poland and Ukraine). J. Risk Financ. Manag. 2020, 13, 238. [Google Scholar] [CrossRef]
  41. Martynets, V.V.; Opanasiuk, Y.A.; Matvieieva, Y.T. How the Covid-19 Pandemic Affects Sustainable Development: The Impact on the Social, Economic and Energy Parameters of Sustainable Development. Strateg. Plan. Energy Environ. 2022, 41, 425–456. [Google Scholar] [CrossRef]
  42. Kuzior, A.; Babenko, V.; Rekunenko, I.; Pohodenko, B. The Current State of Scientific Research of the Process of Risk Management of Ukrainian Energy Sector Enterprises. Manag. Syst. Prod. Eng. 2023, 31, 322–331. [Google Scholar] [CrossRef]
  43. European Commission. Summer 2022 Economic Forecast: Russia’s War Worsens the Outlook; European Commission: Brussels, Belgium, 2022; Available online: https://ec.europa.eu/commission/presscorner/detail/en/ip_22_4511 (accessed on 5 May 2023).
  44. Kuzior, A.; Brożek, P.; Kuzmenko, O.; Yarovenko, H.; Vasilyeva, T. Countering Cybercrime Risks in Financial Institutions: Forecasting Information Trends. J. Risk Financ. Manag. 2022, 15, 613. [Google Scholar] [CrossRef]
  45. Verwey, M.; Bardone, L.; Orsini, K. Russian Invasion Tests EU Economic Resilience. Available online: https://VoxEU.org (accessed on 20 May 2022).
  46. Reinhart, C.M.; Rogoff, K.S. This Time Is Different: Eight Centuries of Financial Folly; Princeton University Press: Princeton, NJ, USA, 2009. [Google Scholar] [CrossRef]
  47. Sheliemina, N. Interrelationship Between Indexes of the Population Medical Care Quality and Macroeconomic Efficiency. Health Econ. Manag. Rev. 2023, 4, 47–59. [Google Scholar] [CrossRef]
  48. Hakobyan, N.; Dabaghyan, A.; Khachatryan, A. Strategies of Post-War Anomie’s Overcoming in the Fields of Social Interactions and Business. Bus. Ethics Leadersh. 2022, 6, 105–112. [Google Scholar] [CrossRef]
Figure 1. The algorithm of the research conducted.
Figure 1. The algorithm of the research conducted.
Sustainability 15 14820 g001
Figure 2. Analysis of number of studies using the keywords “crisis” and “Gross Domestics Product” according to the Scopus database for the period 1977–2023 (compiled by the authors).
Figure 2. Analysis of number of studies using the keywords “crisis” and “Gross Domestics Product” according to the Scopus database for the period 1977–2023 (compiled by the authors).
Sustainability 15 14820 g002
Figure 3. Research by field of knowledge using the keywords “crisis” and “Gross Domestics Product” according to the Scopus database for the period 1977–2023 (compiled by the authors).
Figure 3. Research by field of knowledge using the keywords “crisis” and “Gross Domestics Product” according to the Scopus database for the period 1977–2023 (compiled by the authors).
Sustainability 15 14820 g003
Figure 4. The numbers of studies by country and territory using the keywords “crisis” and “Gross Domestics Product” according to the Scopus database for the period 1977–2023 (compiled by the authors).
Figure 4. The numbers of studies by country and territory using the keywords “crisis” and “Gross Domestics Product” according to the Scopus database for the period 1977–2023 (compiled by the authors).
Sustainability 15 14820 g004
Figure 5. Cluster analysis of literature sources using keywords “crisis” and “Gross Domestics Product” (compiled by the authors using the Scopus database based on the use of the VOSviewer program (version 1.6.16)).
Figure 5. Cluster analysis of literature sources using keywords “crisis” and “Gross Domestics Product” (compiled by the authors using the Scopus database based on the use of the VOSviewer program (version 1.6.16)).
Sustainability 15 14820 g005
Figure 6. Quarterly GDP, total, and percentage changes for 1995–2020 (compiled by the authors based on the data [26]).
Figure 6. Quarterly GDP, total, and percentage changes for 1995–2020 (compiled by the authors based on the data [26]).
Sustainability 15 14820 g006
Figure 7. Indicators characterizing a crisis at different stages (compiled by the authors).
Figure 7. Indicators characterizing a crisis at different stages (compiled by the authors).
Sustainability 15 14820 g007
Figure 8. Comparison of fluctuations in the average GDPs of the countries of the European Union (27 countries) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Figure 8. Comparison of fluctuations in the average GDPs of the countries of the European Union (27 countries) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Sustainability 15 14820 g008
Figure 9. Comparison of fluctuations in the average values of the GDPs in individual countries (Germany, France, Italy, and Spain) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Figure 9. Comparison of fluctuations in the average values of the GDPs in individual countries (Germany, France, Italy, and Spain) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Sustainability 15 14820 g009
Figure 10. Comparison of fluctuations in the average values of employment in countries of the European Union (27 countries) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Figure 10. Comparison of fluctuations in the average values of employment in countries of the European Union (27 countries) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Sustainability 15 14820 g010
Figure 11. Comparison of fluctuations in the average values of investment in countries of the European Union (27 countries) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Figure 11. Comparison of fluctuations in the average values of investment in countries of the European Union (27 countries) during the financial crisis (2008–2012) and the coronavirus crisis (2019–2022) (compiled by the authors).
Sustainability 15 14820 g011
Figure 12. Algorithm of forecast construction (developed by the authors).
Figure 12. Algorithm of forecast construction (developed by the authors).
Sustainability 15 14820 g012
Figure 13. GDP forecast for 2023–2024 based on retrospective data (compiled by the authors).
Figure 13. GDP forecast for 2023–2024 based on retrospective data (compiled by the authors).
Sustainability 15 14820 g013
Table 1. Terms used for the analysis of literature sources based on Scopus database and VOSviewer.
Table 1. Terms used for the analysis of literature sources based on Scopus database and VOSviewer.
Research (in Article Title, Abstract, and Keywords)Results FilteredNumber of Clusters
“Crisis” and “Gross Domestics Product”5645
Table 2. Major clusters of studied literature sources based on Scopus database and VOSviewer.
Table 2. Major clusters of studied literature sources based on Scopus database and VOSviewer.
ClusterNumber of ItemsKeywords
First cluster: red222GDP, financial crisis, economic growth, fiscal policy, monetary policy, export, import, Europe, macroeconomics
Second cluster: green152Economics, economic development, regression analysis, economic and social effect
Third cluster: blue101Economic crisis, human, unemployment, economic recession
Fourth cluster: yellow422COVID-19, pandemic, crisis management
Fifth cluster: purple26Economic policy, economic cycle, public sector
Sixth cluster: orange21Study of the macroeconomic crises in different countries
Table 3. Correlation analysis between GDP and indicators of macroeconomic stability.
Table 3. Correlation analysis between GDP and indicators of macroeconomic stability.
No.Indicator of Macroeconomic StabilityUnit of MeasurementCorrelation Coefficient
1Employment rate% of labor force0.863574
2Inflation (CPI), annual growth rate%−0.24084
3General government debt% of GDP−0.84313
4FDI flow outwardUSD million 0.510918
5Long-term interest rates% per annum0.587721
6Short-term interest rates% per annum0.533842
7Exchange ratesNational currency units/USD dollar−0.24084
8Bank return on assets%0.009853
9Bank return on equity%0.270194
10Real interest rate: bank lending rate minus inflation%−0.07278
11Non-performing loans% of all bank loans−0.62499
12Bank cost-to-income ratio%−0.31303
13Stock market return%−0.40343
14Stock market turnover ratio%0.223056
15Stock price volatility%−0.84663
16Crude oil import pricesUSD dollars/barrel0.585104
17Investment (GFCF)USD million 0.977859
The stock price volatility index is the 360-day standard deviation of the return on the national stock market index (calculated by the authors based on [39]).
Table 4. Coefficients of qualitative assessment of forecasting models.
Table 4. Coefficients of qualitative assessment of forecasting models.
CountryRMSEMAPEStandard Value of RMSE, MAPEForecast Accuracy
France8.10%6.66%Less than 10%High
Italy0.44%4.17%Less than 10%High
Spain0.63%4.82%Less than 10%High
Germany0.49%2.63%Less than 10%High
European Union6.21%5.34%Less than 10%High
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Krawczyk, D.; Martynets, V.; Opanasiuk, Y.; Rekunenko, I. Socio-Economic Development of European Countries in Times of Crisis: Ups and Downs. Sustainability 2023, 15, 14820. https://doi.org/10.3390/su152014820

AMA Style

Krawczyk D, Martynets V, Opanasiuk Y, Rekunenko I. Socio-Economic Development of European Countries in Times of Crisis: Ups and Downs. Sustainability. 2023; 15(20):14820. https://doi.org/10.3390/su152014820

Chicago/Turabian Style

Krawczyk, Dariusz, Viktoriya Martynets, Yuliia Opanasiuk, and Ihor Rekunenko. 2023. "Socio-Economic Development of European Countries in Times of Crisis: Ups and Downs" Sustainability 15, no. 20: 14820. https://doi.org/10.3390/su152014820

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop