1. Introduction
The concept of eco-efficiency, first introduced in 1990 by Schaltegger and Sturm [
1], has become an issue of great importance due to the growing need for reducing the global trend of environmental degradation. Because of its multidimensional nature, measuring the eco-efficiency of production systems with the help of Data Envelopment Analysis (DEA) in recent years has become the mainstream in the scientific literature [
2,
3,
4,
5,
6,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16]. In most studies, environmental efficiency (or eco-efficiency) is considered as the ability of a production system to minimize undesirable outputs (negative externalities of production activity) with fixed inputs (material and human resources) and maximize desired outputs (indicators of the economic performance of the production system) [
2,
5,
6,
9,
10,
11,
13]. Therefore, DEA models summarize various desirable and undesirable effects of the production system in a single efficiency index. As a rule, eco-efficiency is evaluated regionally [
2,
5,
6,
7,
10,
14] or sectorally [
8,
9,
11,
12,
13]. Such inputs of Decision-Making Units (DMUs) as energy (volume of energy consumption), labor (number of employed), capital (volume of investment in fixed assets), land (amount of fertile land used), or water (volume of freshwater consumption) are often considered as inputs. Gross regional product or the gross output of the industry are considered as desirable outputs, while the volumes of various types of pollution as undesirable outputs. Efficiency scores of DMUs, calculated by DEA, provide valuable information for formulating policies for more sustainable development of economical systems under the study.
However, research to date has paid little attention to the possibility of extending the DEA approach to the problem of measuring the economic feasibility of eco-efficiency improvement. Only a few studies include the investments in minimization of negative environmental impacts into considerations while designing DEA model [
7,
16,
17]. These previous papers have provided important information on some technical problems that can arise in the process of calculation of efficiency scores in such extended models. For instance, if we consider improvements in eco-efficiency (which appear due to investments) as outputs of the DEA model, in reality for some DMUs they can be negative. If we apply a two-stage model for production systems eco-efficiency estimation on stage 1 and efficiency of investments in pollution treatment measurement on stage 2, we face the problem of aggregation of two efficiency scores in one objective function.
In addition to the above-mentioned DEA-characteristic issues, we must also note that the basic models for eco-efficiency calculations found in the literature also have several flaws. First, basic DEA models do not put any restrictions on the weights of inputs and outputs. Therefore, in many cases equally effective DMUs can have an opposite burden on the environment: one can produce the minimum amount of emissions into the atmosphere, then the other produces, for instance, the minimum amount of solid waste. However, these DMUs can be severely sub-optimal in other environment categories. Second, basic DEA models can evaluate too many DMUs as efficient ones. In other words, they have poor discrimination of efficiency. Due to these features, such models are insufficient to investigate realistic problems and not helpful for the formulation of policy by local governments or industry leaders.
Therefore, despite the fact that extensive research has been carried out on measuring eco-efficiency with DEA-framework, there is still a lot of room for improvement.
The purpose of this study is twofold. The first aim is to evaluate the efficiency of investments focused on improving the eco-efficiency of the regional economy using DEA approach. In this study, as inputs we consider various types of costs for environmental protection measures: (1) investments in fixed assets aimed at reducing pollution and (2) current costs for environmental protection measures. As outputs, we consider the annual decrease in specific environmental impacts of the regional economy. This is different from previous research, which generally focused on environmental efficiency only, omitting the integration of economic aspects in eco-efficiency measures. From a practical perspective, the purpose of the study is to evaluate the efficiency of environmental management at the regional level. The second aim of the study is to compare three different modifications of basic DEA models in the context of technical complexity and practical feasibility. As modifications, we propose to eliminate the problem of unequal consideration of various environmental aspects in the overall assessment of the efficiency of the regional environmental management by introducing weights. Moreover, we also consider two possible ways to work with negative outputs.
The rest of this paper is structured as follows. The literature review is presented in
Section 2.
Section 3 introduces the models and methods used for efficiency evaluation.
Section 4 describes the data and variables, and then reports the results of DEA efficiency evaluation. Finally,
Section 5 provides discussions on the results and their main implications.
2. Literature Review
In environmental management, the decision process plays a vital role in implementing policies to promote development based on eco-efficient economic growth [
18,
19,
20,
21,
22,
23,
24]. In this regard, for benchmarking and environmental performance assessment different approaches are used, which include parametric (stochastic frontier analysis) [
25,
26,
27,
28], nonparametric (data envelopment analysis), and multicriteria decision-making (MCDM) [
29,
30,
31,
32,
33] approaches. In some studies on environmental efficiency assessment, MCDM methods are combined with DEA, e.g., Zhou et al. [
34] used the TOPSIS method for assessment of inputs and outputs indicators and then studied the spatiotemporal variation of the comprehensive eco-efficiency of 21 cities. Martín-Gamboa et al. [
35] presented a review of life cycle approaches coupled with data envelopment analysis within multicriteria decision analysis for sustainability assessment of energy systems. Keshavarz and Toloo [
36] proposed a hybrid DEA and multi-attribute decision-making (MADM) approach to sustainability assessment.
Nevertheless, for environmental efficiency evaluation, as confirmed by the literature mentioned in this review, the DEA approach has become more common in recent years. There exist a number of excellent literature reviews devoted to the analysis of environmental efficiency studies based on DEA. Song et al. [
4] investigate the achievements of the theoretical and practical basis of environmental policy analysis using DEA. Sueyoshi et al. [
37] systematically summarize previous research efforts on DEA applied to energy and environment from the 1980s to 2010s, including concepts and methodologies on DEA environmental assessment. Mardani et al. [
38] reviewed and classified 145 papers devoted to the application of DEA models in the assessment of environmental and energy economics. Xu et al. [
39] provide a literature review on energy efficiency evaluation based on DEA. This paper deals indirectly with environmental efficiency evaluation, including energy efficiency evaluation of regions, and therefore is also of some interest.
However, since these reviews were published, a number of researches have appeared in the scientific literature. Therefore, this review is mainly focused on recent papers. Moreover, in this section, we have reviewed articles devoted principally to the study of regions. The papers mentioned in our literature review are summarized in
Table 1.
Russian regions have large variability in their area and population. The differences become more considerable after the territorial reform 2003–2008 which led to the merging of regions in East Russia. It must be recognized that the area of some regions in Russia exceeds many European countries. Therefore, the literature review is limited not only by studies of the regions, but also includes papers where the environmental efficiency of countries is evaluated. Jebali et al. [
44] examine the energy efficiency determinants in the Mediterranean countries. A number of papers [
41,
52,
59,
62] evaluate the evolution of environmental performance in member countries of the European Union (EU). Grigoroudis and Petridis [
51] present a study of environmental efficiency measurement that concerns 108 countries from all over the world.
Several studies are devoted to the analysis of the environmental efficiency of cities. Such papers have also attracted some interest as large cities are often considered autonomous territorial units under the administrative division. Zhou et al. [
34] estimated the eco-efficiency of 21 cities in Guangdong province, China. Li et al. [
61] carried out mining eco-efficiency measurement for 14 prefecture-level cities in Guangxi Province, China. Zhou et al. [
57] discuss eco-efficiency of 48 cities in Bohai Rim mainly focused on the role of industrial structure upgrades. Perhaps the most extensive study (by the number of regions) considered here was carried out by Bianchi et al. [
58] and covers 282 European regions at NUTS-2 level.
As for the territorial aspect, note that most of the recent studies investigate the regions of China; the EU countries are in second place. The environmental efficiency of Russian regions has not been sufficiently studied using the DEA approach; only a few works there exist in the DEA literature in this area. In addition, these studies are limited, as they did not consider all the regions, but only those included in the Central Federal District [
54] and Southern Federal District [
66].
Usually, the inputs and outputs of the DEA model are chosen a priori by researchers. They are mainly dictated by the purpose of the study and are determined by the availability of data sources. In [
42], the authors use Hellwig’s method and coefficient of determination to ensure an appropriate combination of environmental and economic indicators of the eco-efficiency evaluation.
A second-stage analysis is often performed with the help of various regression methods. Shi [
55] and Zhu et al. [
64] use regression analysis to identify the relationship between the efficiency scores and its determinant factors. Deng et al. [
40] explore the factors that influence water use efficiency with a panel data model. Zhou et al. [
34], among other methods, also used a panel regression model to determine factors influencing eco-efficiency. In [
13,
45,
61], Tobit regression and truncated regression models are applied. Moutinho and Madaleno [
62] analyze the relationship of the obtained DEA scores from the possible influencing factors, namely eight different types of pollutants, with the help of a fractional regression model. Jebali et al. [
44] in the second-stage analysis applied a parametric bootstrap procedure to the truncated regression of DEA bias-corrected efficiency scores on environmental variables. Furthermore, in the second stage, Zhao et al. [
47] and Zhou et al. [
57] calculated a Moran’s I that represents a measure of spatial autocorrelation.
Often, researchers break down the eco-efficiency evaluation in several stages. Zhang et al. [
46] adopted a three-stage approach to eliminate the interference of the external environment and statistical noise. Gómez-Calvet et al. [
41] conducted a two-stage analysis which develops environmental performance indicators in the first stage for each pair country–year and evaluates its evolution in the second. Zhao et al. [
56] employed a three-stage DEA approach combining BCC model [
67] and the stochastic frontier analysis (SFA) model.
In the network DEA model, the efficiency measurement process is also split into several stages. Zhao et al. [
47] use two-stage network DEA to consider undesirable output: the first stage describes the water utilization process and the second stage characterizes the pollutant treatment process. Shi [
55] considers the internal structure of the production system to evaluate the environmental efficiency in the same way, i.e., production subsystem and pollutant treatment subsystem. Zhu et al. [
65] divided energy and environment efficiency analysis into two sub-stages: energy production sub-stage and energy utilization sub-stage. Wang et al. [
63] proposed a dynamic network DEA approach that considers the dynamic features of network DEA. This approach takes into account that capital investments in the current period are used to establish fixed assets for two stages, which can also be used in the later period, thus affecting its two-stage eco-efficiency.
Most studies employ undesirable outputs as the assessment of environmental efficiency involves the use of indicators that have a negative impact on the environment and, therefore, should be reduced. The traditional radial (BCC and CCR models) and non-radial slack-based measure (SBM) models are commonly applied for environmental efficiency assessment (see, i.e., in [
43,
48,
49]), but there exist some studies that use the directional distance function (DDF) methods [
41]. Bianchi et al. [
58] used a hyperbolic distance function measure that considers improvements on the input and output direction simultaneously. A newly proposed and rather interesting approach is proposed in [
50]; Zhang et al. applied an intermediate model, which is a combination of radial and non-radial approaches.
In order to evaluate the efficiency change over time, several approaches were applied. In [
54], dynamic problems of eco-efficiency are explored with the help of Malmquist index estimation. Piao et al. [
53] accomplished dynamic environmental performance analysis using Malmquist–Luenberger (ML) index. Wang et al. [
13] used the global Malmquist–Luenberger (GML) productivity index to overcome some difficulties with ML index. Lu et al. [
52] applied the dynamic DEA model to evaluate the intertemporal eco-efficiency. Wang et al. [
63] combined dynamic and network DEA approaches into one model to evaluate industrial eco-efficiency and assess internal ineffective sources. Window analysis is used in [
50,
60,
66].
The vast majority of previous studies use absolute values of indicators in models to analyze environmental efficiency. The main difference between this work and others is that we do not use absolute values of indicators, but their increments as variables. This leads to the values of the indicators are no longer strictly positive and can now take negative values. As a result, calculations based on DEA models become more complicated, as negative values must be taken into account.
4. Empirical Analysis
4.1. Data Source and Variables Selection
The data for the efficiency evaluation of regional environmental management systems were collected from the Russian Federal State Statistics Service’s regional statistical data [
90,
91]. The dataset includes all regions of Russia, with the exception of those in which the current costs of environmental protection measures are below the minimum of maintaining the operability of the regional environmental management system (10 million rubles were taken for the minimum threshold level). The efficiency scores of regional environmental management systems were calculated over the period from 2011 to 2017 in two-year steps, i.e., in 2011, 2013, 2015, and 2017 for three models: the regular CCR model with no weighting and scale shift restrictions (CCR), the CCR model with interval weighting and scale shift restrictions (CCR-AR), and the SBM model.
According to the Russian Federal State Statistics Service, the investments in fixed assets aimed at environmental protection and rational use of natural resources include the cost of construction, reconstruction (including the expansion and modernization) of facilities, the purchase of machinery, equipment, and vehicles. The current expenses on environmental protection include the costs of following activities: the maintenance and operation of fixed assets for environmental protection; measures for the preservation and recovery of the natural environment; the treatment of production and consumption wastes; the organization of control over emissions (discharges), production, and consumption wastes; environmental research; and environmental education.
As inputs, we considered the share of investments in fixed assets aimed at reducing environmental pollution (
) and the share of current costs in the region’s gross regional product (GRP) (
). As outputs, we consider indicators of a decrease in the specific level of pollution to the atmosphere, soil, and water, i.e., the difference in specific pollution before (
) the investments of both types (in fixed capital and current expenses) and after (
).
where
is an emissions to the atmosphere from stationary sources (thousands tones),
is a gross regional product in 2011 prices (millions rubles),
is an emissions to the atmosphere from road transport (thousands tones),
is a discharge or untreated sewage (millions m
),
W is a fresh water consumption (millions m
),
is a waste generation (tones),
R is a share of recycling and reuse of waste (%), and
k is an index of the region. Max, min, and mean statistics of variables are shown in
Table 2.
4.2. Weights Selection
We set the weight restrictions in the form of the ratio of the input/output weight coefficient to the virtual input/output. Such a model is a generalization of the assurance regions method (denoted in the work as CCR-AR). In this case, the upper and lower boundaries of the specified constraints show the relative significance of each indicator in relation to the others. In the CCR-AR model, for working with negative outputs, we perform a shift of the scale of indicators. For each indicator having negative values, the shift value was selected in such a way that all values were strictly positive.
As the second way of working with negative outputs in this paper, we used the non-radial SBM model. This model is quite general; it takes into account the presence of negative data, allows one to set weight coefficients for each indicator, and makes it possible to rank effective objects using the super-efficiency method.
As discussed earlier, many outputs have negative values, so in order to apply a model with restrictions on virtual weight coefficients (the CCR-AR model), it is necessary to perform a shift transformation of the corresponding variables. For each indicator that has negative values, the shift value was selected in such a way that all values were strictly positive.
After performing several steps of adjusting weights, the following estimates were obtained. The weight restrictions for the outputs in the CCR-AR model are shown in
Table 3 (second column); they are applied for all the DMUs. The values of the weights for the inputs and outputs of the SBM model we used in our computations are shown in
Table 3 (third column).
4.3. DEA Evaluation Results
According to determined weights, CCR-AR and SBM models were applied to the dataset, and efficiency scores were evaluated. Comparing the results obtained, note that the traditional CCR model without weight restrictions and the CCR-AR model provides very close efficiency scores (
Table 4). Although the results of the SBM model correlate with the results of calculations based on the CCR model and the CCR-AR model, the value of the correlation coefficient is significantly lower than in the previous case.
A detailed analysis of the results obtained allows us to conclude that the CCR and CCR-AR models are more sensitive to the model inputs; according to these models, the regions with the lowest environmental costs are efficient. Low or zero input makes the region efficient even if some outputs have negative values. For example, in the Bryansk Oblast in 2011, the values of investments in fixed assets are zero. The result of environmental protection activities in 2011 was a slight improvement in all environmental indicators, except for the intensity of waste generation. Nevertheless, the environmental management system of the region is recognized as efficient according to the CCR model and the CCR-AR model, see
Table 5. Similarly, the environmental management system of Moscow in 2011 was efficient, although the indicators of the intensity of waste generation in the region also deteriorated over the observed period. However, the region is efficient due to the low share of costs (investment in fixed assets is 0.06% of GRP, current costs also 0.06% of GRP). At the same time, the Lipetsk Oblast, which also has the only negative indicator of the intensity of waste generation, has the lowest efficiency, as the indicators of the region’s costs for environmental protection measures are among the highest: investments in fixed assets are 1.37% of GRP, and current costs are 3.25% of GRP.
The SBM model demonstrates a higher sensitivity to outputs: for example, the Stavropol Krai and the Arkhangelsk Oblast in 2011, as regions with the most effective environmental management systems, actually have all positive outputs. However, the regions following them in the performance rating already have one, two, or even three negative outputs, so the interpretation of the results of this model is controversial.
The spatial distribution of efficiency scores for CCR-AR and SBM models are showed in
Figure 1 and
Figure 2, respectively.
Table 4 shows that the conventional CCR efficiency scores are very close to the CCR-AR model, and thus spatial distribution diagrams for the CCR model are not included in the paper. Although the results of the SBM model correlate with the results of calculations using the CCR model and the CCR-AR model, the value of the correlation coefficient is significantly lower than in the previous case.
Looking at the results as a whole, we can conclude that the efficiency of regional environmental management has deteriorated during the period under the study. Most likely, this is due to the deterioration of the economic situation in Russia in the period after 2014 due to the imposition of sanctions: incomplete utilization of production facilities, lack of funds for the introduction of more resource-efficient technologies, etc.
The highest potential for improvement in order to achieve efficiency in environmental management have two largest Russian regions in Eastern Siberia: Krasnoyarsk Krai and Yakutia. Therefore, special attention should be paid to the study of problems in the environmental management system in these regions. The regions that demonstrate the highest indicators of the effectiveness of environmental management systems (Tuva Republic, Ivanovo Oblast, and Moscow) are also worthy of closer study in order to identify and analyze the best practices and technologies of environmental management.
A more detailed analysis of the results allows us to conclude that the CCR and CCR-AR models are more sensitive to model inputs: according to these models, regions with the lowest environmental protection costs are effective. Low or zero cost values of at least one type immediately make the region efficient, even if some of the model outputs have negative values. The SBM model demonstrates a higher sensitivity to outputs, for example, regions, which are recognized as efficient according to the results of calculations, rarely have all outputs positive. However, the regions following them in efficiency ratings already have one, two, and even three negative outputs, so an interpretation of the results of this model is controversial. According to the findings above, some policy implications may be proposed for the evaluation of efficiency in regional environmental management systems in Russia.
5. Discussion and Conclusions
5.1. Discussion and Future Research Directions
In many previous studies, various DEA models are used in order to evaluate environmental efficiency. However, the efficiency evaluation of regional environmental management systems considered in this paper differs from other DEA applications because it does not use absolute variables, but changes over a certain period. As these changes may be not positive due to environmental degradation, negative values of variables are a common occurrence. At the same time, traditional DEA models have certain difficulties with negative data. To apply them, it is necessary to make some data transformations, which would inevitably be subjective. As a result, efficiency scores would be biased and decisions based on the use of such estimates would be unsubstantiated and possibly flawed. Therefore, from a mathematical point of view, the SBM models are more attractive for environmental efficiency problems with negative data. To perform the calculations, we used a fairly new model of Lin et al., which allows us to calculate a non-radial measure and at the same time correctly processes negative variables. In addition, the model used allows us to rank efficient units by calculating the super-efficiency score. It also has some attractive properties—it is monotonous, unit-invariant, and translation-invariant for both inputs and outputs.
The limitations of this study are as follows: (1) the choice of inputs and outputs of the model was limited due to the peculiarities of the statistical accounting of various aspects of environmental management in Russia. For example, Russian statistics do not separate greenhouse gas emissions, but consider them in one indicator along with all other emissions of gaseous pollutants. Therefore, it is not possible to analyze the effectiveness of regional environmental management in such an important area as combating climate change. (2) For the same reason (features of statistical accounting), we cannot compare the effectiveness of environmental management in Russian regions with other countries, for example, with the EU countries, although such comparisons are of significant practical interest. (3) As the study was limited to CRS models, it did not provide the information to analyze the difference in the technical efficiency and scale efficiency of regional systems of environmental management, which also is an important topic for decision-making. Despite its limitations, the study certainly adds to our understanding of the problems with inefficient investments in environmental protection measures in Russian regions.
A natural progression of this work is to analyze the efficiency of regional environmental management taking into account the peculiarities of ecological problems of each region. It can be done by assigning different weight restrictions to the outputs depending on whether the improvement of the ecological situation in this area is a priority for the region or not. Another direction of future research is might be an introduction of an artificial object into the sample, which demonstrates the highest possible investment efficiency at the current level of technological development. The introduction of such an artificial object changes the efficiency frontier and makes it possible to determine not only the efficiency of regions in relation to each other, but also their efficiency in comparison with those regions that use the best available technologies in all areas of environmental management.
5.2. Conclusions
Although the primary applicable result of this research is a rating of Russian regions, this result differs significantly from other Russian ecologic ratings by its methodology. The existing ratings normally evaluate either the eco-efficiency of the regional economy (e.g., the ecological rating of the Analytical Credit Rating Agency [
92]), or use the expert estimates of regional events that have any connection to ecology (for example, the national economic rating of the national “Green Patrol” organization [
93]). Apart from regional ratings, there are also some ratings of Russian cities, which evaluate the work of municipal governments on improving waste management and planting of greenery (e.g., the combined rating of the political “All-Russia People’s Front” movement and the Ministry of Natural Resource and Ecology [
94]). However, none of the methodologies used in these ratings account for the efficiency of spending on environmental protection. Thus, a direct comparison of our three DEA models with results of other ratings is impossible, and doing so will not allow determining which of the models better reflects reality. This could be considered a limitation of our research.
Nevertheless, accounting for the differences in calculations of efficiency measures in each of our models, we consider the SBM model to provide the most accurate results. First, this model does not allow for a situation where some ecologic effects have an overly large weight coefficient and some others have an overly small one. In other words, we cannot consider regions that had huge successes in one area of environmental protection and complete failures in other areas as efficient. Second, this model has a higher discriminating power, which allows using strict ranking.
As for practical application of our methodology for creating ratings of regional ecologic management efficiency, we hold a positive viewpoint, as all necessary indicators for rating calculation are provided by official statistical organizations and are openly available. Our rating is based on quantitative indicators, can be calculated independently of regional authorities, and excludes any subjective influences. As any other official rating, it could be used for stimulating regional authorities to take genuine action in the sphere of ecology. However, unlike other ratings, the DEA-SBM model may also stimulate an optimization of environmental protection spending and, therefore, an introduction of technological and organizational eco-innovations.
The results of DEA models provide a Big Picture in the field of environmental management at the regional level. Taking into account the extreme non-transparency of this area in Russia (for example, the absence of publicly available information on what the budgetary funds allocated for environmental protection were spent on), they allow any independent researcher to identify the most problematic regions. A further detailed analysis of the environmental management processes will be required in order to determine the true reasons of inefficiency; however, DEA modeling helps to point out the potential corruption or technological violations in the region.