Next Article in Journal
Day-Ahead Scheduling of IES Containing Solar Thermal Power Generation Based on CNN-MI-BILSTM Considering Source-Load Uncertainty
Previous Article in Journal
Sustainable Energy Storage Systems: Polypyrrole-Filled Polyimide-Modified Carbon Nanotube Sheets with Remarkable Energy Density
Previous Article in Special Issue
A Multi-Time Scale Optimal Scheduling Strategy for the Electro-Hydrogen Coupling System Based on the Modified TCN-PPO
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comprehensive Benefit Evaluation Analysis of Multi-Energy Complementary Off-Grid System Operation

1
Energy Planning and Research Institute, Southwest Electric Power Design Institute Co., Ltd., China Power Engineering Consulting Group, Chengdu 610500, China
2
School of Electrical and Information, Southwest Petroleum University, Chengdu 610500, China
*
Author to whom correspondence should be addressed.
Energies 2025, 18(9), 2159; https://doi.org/10.3390/en18092159
Submission received: 12 March 2025 / Revised: 3 April 2025 / Accepted: 7 April 2025 / Published: 23 April 2025

Abstract

:
In the future, China’s demand for centralized industrial development in remote areas will gradually increase, but the operation evaluation analysis of off-grid systems applicable to the development of such areas has not yet matured, and it is an urgent challenge to improve the operation mechanism of off-grid systems and then conduct a comprehensive benefit evaluation of off-grid systems. First of all, this paper focuses on the problem that the existing dimensions of the benefit evaluation of multi-energy complementary off-grid systems are not refined and comprehensive enough, and takes into account their high safety and reliability requirements, as well as the potential impacts on local industries and people’s lives after their completion, and then constructs a more complete comprehensive benefit evaluation indicator system for multi-energy complementary off-grid systems. Secondly, the subjective and objective weighting method based on the combination of the AHP (analytic hierarchy process) and AEM (anti-entropy method) is used to assign weights to the evaluation indicators. Finally, based on the TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) comprehensive evaluation method, a comprehensive benefit evaluation of a multi-energy complementary off-grid system under different operation schemes is conducted, and the example results show that the size of the relative closeness under different operation schemes has a maximum difference of 0.5592, which verifies that the proposed evaluation indicator system and the multilevel evaluation method can comprehensively evaluate and analyze the strengths and weaknesses of multi-energy complementary off-grid systems under different operation schemes, and provide theoretical guidance and decision-making support for the further promotion and construction of multi-energy complementary off-grid systems.

1. Introduction

Achieving the sustainable development of resources and the environment and reducing greenhouse gas emissions is a common goal of all societies. A multi-energy complementary off-grid system, as a kind of system that provides power security for the production and development of alpine areas, has an important strategic position in green and low-carbon transformation. At present, a scientific and perfect evaluation indicator system has not yet been established for multi-energy complementary off-grid systems. Therefore, there is an urgent need to establish a set of more detailed and comprehensive evaluation systems for analyzing the comprehensive benefits of multi-energy complementary off-grid systems, which has important theoretical value and practical significance for promoting the clean energy consumption of energy bases in Northwest China.
The optimal operation of a multi-energy complementary off-grid system involves the supply, conversion, and storage of each energy source. Regarding the comprehensive benefit evaluation of multi-energy complementary systems, domestic and foreign scholars have also conducted many research studies.
Domestic and foreign studies on the comprehensive benefit evaluation of multi-energy complementary systems mainly focus on three aspects: the system’s economic benefits, technical reliability, and environmental benefits. Reference [1] introduces a small-scale power generation system composed of photovoltaics, battery energy storage, and garbage power generation, and evaluates its economic and technological reliability. Reference [2] establishes a comprehensive benefit evaluation indicator system for a pumped-storage power station from the point of view of the system’s operation effect, economic benefit, and environmental benefit, and constructs a comprehensive evaluation model based on TOPSIS to quantitatively analyze the comprehensive benefits of the pumped-storage power station in the multi-energy complementary system. Reference [3] proposes a dimensionless numerical indicator to evaluate the linkage between three energy sources by utilizing the complementarity among the three resources, namely, hydropower, photovoltaic power, and wind power; reference [4] comprehensively analyzes solar energy, wind energy, hydropower, geothermal energy, and biomass energy, and carries out a comparative study from the perspectives of economic benefits, technical reliability, environmental benefits, and development prospects; reference [5] proposes an MECS optimization method that integrates reliability, economy, and environmental performance, and applies the MCMC method for reliability evaluation; reference [6] proposes a new framework based on synergy theory and introduces current techno-economic evaluation indicators to validate the framework; reference [7] constructs a hybrid renewable energy system (HRES) and evaluates its management using decision algorithms and 13 case studies, analyzing economic, technological, and environmental aspects; reference [8] uses machine learning techniques to resolve uncertainties in renewable energy systems and thus analyze the economics and technical reliability of the system.
China’s research on the comprehensive benefit evaluation of multi-energy complementary systems started late, and the current research mainly focuses on small-scale multi-energy complementary systems such as park microgrids. Reference [9] proposed a comprehensive evaluation scheme for many types of microgrid systems characterized by an open range, focusing on the technical benefits as well as the economic benefits during the construction of a microgrid comprehensive evaluation indicator system, and introducing mapping functions, such as Arctangent mapping functions, to quantitatively analyze it. Reference [10] constructed a comprehensive benefit evaluation model for microgrids from the perspectives of the economy, environmental protection, and technology, and used the analytic hierarchy process and entropy weighting method to combine and assign weights to them. Reference [11] used the ANP algorithm to optimize the weight coefficients of the indicators in a comprehensive evaluation indicator system of microgrid planning in order to simplify a comprehensive evaluation model of a microgrid system.
Through an analysis of the above references, it is found that most of the current studies on multi-energy complementary off-grid systems are limited to cost considerations and energy saving and emission reduction methods in the context of the “dual-carbon” goal, and the evaluation dimension is focused on economic and environmental benefits. However, as the country’s demand for the development of remote areas with abundant industrial production resources but weak power construction gradually increases, the existing benefit evaluation system of multi-energy complementary microgrid systems can hardly meet the needs of the benefit evaluation of industrial production in remote areas without access to large power grids; thus, there is an urgent need to consider the more important social benefits in the off-grid environment and further analyze the potential social development prospects after the completion of the system to encourage the development of related industrial chains in the local area, improve the production and lives of the local residents, etc. In addition, an off-grid system has higher requirements for the safety and reliability of the system’s operation, so it is necessary to increase the power supply reliability of these systems and electric power production safety at the technical reliability level so as to fully maximize the safety and reliability of system operation. Therefore, a more detailed and comprehensive evaluation indicator system for multi-energy complementary off-grid systems has not yet been established.
Against this background, this paper proposes a more refined and comprehensive benefit evaluation system for multi-energy complementary off-grid systems based on comprehensive consideration of the operational characteristics of multi-energy complementary off-grid systems. In view of the high safety and reliability requirements of off-grid systems, the power supply reliability of these systems and electric power production safety are added to the technical reliability evaluation dimensions, which can better reflect the safety and reliability of off-grid systems. In view of the potential social development prospects of off-grid systems in terms of the development of the local industry chain and the improvement of the production and lives of the local residents, the evaluation dimension of the social benefits to the local community is added to the indicators, and an overall system of indicators for the evaluation of the benefits is established with the four aspects of economic benefits, technological reliability, environmental benefits, and social benefits in a detailed and comprehensive manner. Secondly, in view of the characteristics of the comprehensive benefit evaluation of this system, such as the large number of indicators and the open range, a corresponding standardization strategy is designed according to the different characteristics of the evaluation indicators. Then, the AHP and the AEM are introduced to calculate the weights of the indicators once each, and normalization of the indicators is performed through classification and quantification with fuzzy algorithm normalization processing, and then, the subjective and objective weighting method based on the AHP-AEM is used for combined weighting processing. Finally, on this basis, the TOPSIS-based comprehensive benefit evaluation solution method is proposed to evaluate and analyze the comprehensive benefits, and the method is verified to comparatively analyze the advantages and disadvantages of the multi-energy complementary system under different operation schemes through an analysis of examples.

2. Establishment of a Comprehensive Benefit Evaluation System for Multi-Energy Complementary Off-Grid Systems

2.1. Ideas for Constructing a Comprehensive Efficiency Evaluation Indicator System for Off-Grid Systems

The comprehensive benefit evaluation indicator system for multi-energy complementary off-grid systems constructed in this paper aims to find the advantages and disadvantages of the benefits of each part of multi-energy complementary systems in a synergistic and optimized operation, and to analyze the comprehensive benefits of the system under different operation schemes. The design flow of the comprehensive benefit evaluation indicator system of multi-energy complementary off-grid systems is shown in Figure 1.

2.2. Construction of Comprehensive Benefit Evaluation Indicators for Multi-Energy Complementary Off-Grid Systems

For the multi-energy complementary off-grid integrated benefit evaluation configuration, the core issue is whether the implementation of the comprehensive benefit evaluation configuration scheme is good or not (target layer), i.e., whether the safety of the comprehensive benefit evaluation scheme is established or not. To this end, based on the research on the optimal capacity configuration for off-grid systems, and referring to the relevant information [12,13], four key issues (criterion layer) are proposed, i.e., whether the program environment adheres to the standard, whether the program economy is good, whether the program technicality is reasonable, and the nature of the program sociality; based on the four key issues and analyzing the connotation of the four key issues, 13 indicators in the connotation index layer (connotation layer) can be derived, which form a comprehensive integrated benefit evaluation indicator assessment system for multi-energy complementary off-grid-type systems comprising 1 target layer, 4 guideline layers, and 13 connotation index layers, as shown in Figure 2 below.
(1)
Economic benefit evaluation indicators
1.
Life cycle cost
The utilization of the life cycle cost can take into account all the costs of each piece of equipment in the system from its initial procurement and construction to its end-of-life disposal, including the respective equivalent investment and operation and maintenance costs. The specific investment costs of the system are also related to the design capacity of the system, as shown in Equations (1)–(4):
F IA = F IN + F M
F IN = T 8760 i = 1 I X i c i S i , equ
F M = t = 1 T α i P i ( t )
X i = m ( m + 1 ) N ( 1 + m ) N 1
where F IA is the life cycle cost of the system; F IN is the annual equivalent investment cost of the system; F M is the operation and maintenance cost of the system; X i is the annual equivalent investment conversion coefficient for the equipment in the system; I is the unit investment cost of the respective equipment within the system; c i is the annual equivalent investment cost of the system; S i , equ is the optimal capacity of each device designed within this system; α i is the operating cost of the ith device; P i ( t ) is the power of the ith device at moment t; m is the discount rate; and N is the life cycle of the system.
2.
Internal rate of return
The internal rate of return (IRR) of the system can be obtained from the discount rate corresponding to the system when the sum of the net present values of each year of this multi-energy complementary off-grid system equals zero, which is expressed as shown in Equation (5):
t = 1 T ( C I C O ) n ( 1 + I R R ) T = 0
where C I is the inflow of money into the system in year n ; C O is the outflow of money from the system in year n ; T the computational cycle of the system; and I R R is the internal rate of return of the system.
3.
Period of investment recovery
The period of investment recovery of the multi-energy complementary off-grid system equipment is considered from the perspective of time to characterize the investment years that can be covered by the economic income of the project, and can be divided into two indicators: the static investment recovery period and the dynamic payout period of investment. The specific expressions are shown in Equations (6) and (7):
a = 0 T DPP A cin ( n ) A count ( n ) ( 1 + r ) n = 0
a = 0 T APP A cin ( n ) A count ( n ) = 0
where T DPP is the dynamic payout period of investment for the system’s equipment; T APP is the static investment recovery period for the system’s equipment; A cin ( n ) is the comprehensive income in year n ; A count ( n ) is the total investment in year n ; and r is the annual interest rate.
(2)
Environmental benefit evaluation indicators
1.
Equivalent environmental cost
The pollutant emission coefficients of the respective energy equipment within the integrated energy off-grid-type system and the environmental evaluation standards for pollutant gases in the traditional electric power industry [14,15,16] are shown in Table 1 and Table 2 below. In this paper, the emission coefficients of the respective pollutants of the two tables, the environmental benefits, and the penalty amount are combined, and they are uniformly discounted to the equivalent environmental benefits, which are expressed as shown in Equation (8) below:
C W = i c P ex χ c ( V C + C )
where P ex is the amount of electricity generated by the system’s thermal power; χ c is the emission factor for category c pollutants; V C is the environmental value of category C pollutants; and C is the cost of the penalty to be paid for Class C pollutants.
2.
Carbon dioxide emission reduction rate
In the context of achieving the goal of “double carbon”, this paper takes the carbon dioxide emission reduction rate as the object of consideration in terms of its environmental benefits. The main pollutant gas emitted by traditional energy equipment is carbon dioxide, and the use of multi-energy complementary systems can greatly reduce the emission of carbon dioxide. At the same time, the hydrogen produced at the terminal can also be transported to other equipment, which will lead other industries to realize the cleanliness of terminal energy use. The main source of carbon emissions of the multi-energy complementary system constructed in this paper is the emission from power generation with gas turbines and other equipment in the off-grid system, which is expressed as shown in Equation (9):
E co 2 = t = 0 T ω grid W grid ( t )
where E co 2 is the carbon dioxide emissions of the system; ω grid is the CO2 conversion factor for procured fossil energy generation; and W grid ( t ) is the amount of fossil energy generated by the system at time t.
The reduction rate of CO2 for the multi-energy complementary off-grid-type system is shown in Equation (10) below:
F co 2 = C co 2 coal E co 2 C co 2 coal
where F co 2 is the CO2 reduction rate of the system, and C co 2 coal is the emission of CO2 from a conventional distributed generation system.
3.
Space occupancy
Space occupancy refers to the fact that the energy generation equipment and storage equipment of each subsystem in a multi-energy complementary off-grid system need to occupy a certain amount of land area, which will have a certain impact on the external environment. The difference in the number of pieces of equipment used in different operational programs will also result in a different space occupancy, which also reflects the difference in the impact of the system on the environment.
(3)
Technical reliability evaluation indicators
1.
Clean energy consumption rate
In this paper, the clean energy consumption capacity of a multi-energy complementary off-grid system is evaluated from the three perspectives, the clean energy abandonment rate α q , clean energy penetration rate ζ x , and clean energy reduction rate δ s , which are expressed as shown in Equations (11)–(13):
α q = t T P tot ( t ) P use ( t ) P tot ( t )
ζ x = ( W RF W R ) W RF
δ s = S RES P L , m
where P tot ( t ) is the annual generation of clean energy within the system; P use ( t ) is the amount of clean energy consumed by the system load in a year; W RF is the ideal power generation for the system; W R is the actual power generation of the system; S RES is the actual installed capacity of the system; and P L , m is the peak power of the internal load of the system.
2.
The power supply reliability of the system
A multi-energy complementary off-grid system needs to maintain its own stability to ensure the reliability of the power supply. Taking into account the strong volatility of wind power and photovoltaic output, which will lead to frequency flicker oscillation of the system and so on, in order to reflect the ability of the system to meet the power loads in various situations, the power supply reliability of this multi-energy complementary off-grid system is evaluated mainly from the three perspectives, outage frequency f SIF , outage time S SID , and power supply reliability A SSA , as formulated in Equations (14)–(16):
f SIF = m E λ m , e N m , e + m H λ m , h N m , h m E N m , e + m H N m , h
S SID = m E M m , e N m , e + m H M m , h N m , h m E N m , e + m H N m , h
A SSA = 1 m E M m , e N m , e + m H M m , h N m , h Y m E N m , e + m H N m , h
where E is the collection of load points in the distribution network; H is the collection of system load points; m is the m th load point; h is the system load point; e is the distribution network load point; M m , e is the outage time of the load point in the distribution network; M m , h is the time when the load point in the system is out of supply; λ m , e is the failure rate at the m th load point of the distribution network; λ m , h is the failure rate at the m th load point of the system; N m , e is the number of users at the m th load point of the distribution network; N m , h is the number of users at the m th load point of the system; and Y is the number of hours in a year, 8760 h.
3.
Electric power production safety
The safety of power production in a multi-energy complementary off-grid system is evaluated from two perspectives: the safety of the production equipment within the system and the safety of the employees working under the system.
4.
System operation flexibility
Since this multi-energy complementary off-grid system contains energy storage equipment inside, the system power supply capacity S P , the maximum regulated capacity of the contact transmission line S W , and the ratio of the capacity of the energy storage devices S S to the maximum load of the system P L , max are defined as the operational flexibility of the system, which is expressed as shown in Equation (17) below:
K yun = ( S P + S S + S W ) P L , max
where S P is the power capacity that can be flexibly adjusted within the system; S S is the capacity of the energy storage equipment in the system; S W is the maximum regulated capacity of the contact transmission line; and P L , max is the peak power of the internal load of the system.
(4)
Social benefit evaluation indicators
1.
Provision of employment opportunities
The current employment rate in China is low, and improving the national employment rate is also a social issue of concern. After the beginning of the project, it will provide a certain number of jobs for local residents. So, the number of jobs provided after the implementation of the project has also become one of the investigation indicators to examine the social benefits of the multi-energy complementary system.
2.
Enhancing resident satisfaction
Resident satisfaction represents the real feelings of the local residents after the implementation of the multi-energy complementary off-grid system project for the improvement of local social and environmental benefits. The main purpose of building the off-grid system is to provide a clean and stable power supply to the local community, and to improve the reliability of local residents’ electricity consumption on the basis of protecting the environment. After the project is implemented, the higher the satisfaction of local residents, the better the social benefits of the project.
3.
Leading the development of the local regional economic industry
The main benefits of completing the multi-energy complementary off-grid system project are driving the development of the local economic industry and the expansion of the local economic environment, as well as driving the development of the relevant local industrial chain. As the system contains hydrogen storage subsystems, the implementation of the project can greatly promote the development of the local hydrogen industry, including hydrogen storage, manufacturing, transportation, etc.; at the same time, regarding the country’s policy support, it also provides a forward-looking platform to the relevant clean energy power generation industry.
The stronger the project’s demonstration of advanced technology is, the more it can promote the development of the relevant industrial chain, with strong social benefits. Therefore, driving the development of the local regional economic industry has also become an important indicator for measuring the social benefits of the system after its implementation.

3. Analysis of the Combination of Indicators for Evaluating the Comprehensive Benefits of Multi-Energy Complementarity

3.1. Analytic Hierarchy Process

The analytic hierarchy process (AHP) [17] is a widely used subjective weight calculation method. It is suitable for multi-objective complex decision-making, and the calculation steps consists of five parts: establishing a hierarchical structure, constructing an interval judgment matrix, solving index weights, performing consistency verification, and calculating the overall comprehensive weights [18].
After determining the interconnection between the target layer, criterion layer, and connotation layer, the interval judgment matrix can be established. This involves the pairwise comparison of indicators within the same hierarchical level to assess their relative importance, yielding the following judgment matrix:
A = a 11   a 12     a 1 n a 21   a 22     a 2 n       a n 1   a n 2     a n n  
where a i j is the relative importance of U i versus U j based on the consideration of some factors; a i j = a i j , a i j + , a j i = 1 a i j + , 1 a i j ; a i j + is the upper limit of the result; and a i j is the lower limit of the result.
At the same time, the judgment matrix should have the following properties: a i j > 0 ; a i j = 1 a j i ; a i i = 1 .
We calculate the weight vector of the indicator set through the judgment matrix and normalize it, as formulated in Equation (19) below:
a ¯ i j = a i j i = 1 n a i j
Subsequently, each row of the normalized judgment matrix A is further summed to find the summation value M i for each row of matrix A .
M i = j = 1 n a ¯ i j i = 1 , 2 , , n
Finally, we calculate the indicator weights ω i for each indicator of matrix A .
ω i = M i j = 1 n M j , i = 1 , 2 , , n
If the judgment matrix is not able to satisfy the consistency requirement, it will face a situation where the solution cannot proceed, so it needs to be checked for consistency.
The consistency indicator C I is met:
C I = λ max n n 1
The stochastic consistency ratio C R of the judgment matrix A is satisfied:
C R = C I R 1
where λ max is the maximum eigenvalue of the judgment matrix A ; n is the order of the judgment matrix; and R 1 is the average random consistency indicator.
If the obtained matrices satisfy the consistency checks, the overall weights can be calculated after computing the weights of each layer.

3.2. Anti-Entropy Method

The entropy-based anti-entropy method (AEM) [19] is formulated in Equation (24) below:
h i = i = 1 k K i ln ( 1 K i )
where 0 K i 1 , and i = 1 k K i = 1 . h i and h have opposite characteristics; the greater the degree of disorder in the system, the greater the anti-entropy.
The objective weight vector W , , = w 1 , , , w 2 , , , , w s , , for each evaluation indicator is calculated using the AEM. w i , , is calculated as formulated in Equation (25) below:
w i , , = h i i = 1 s h i
The steps of the AEM are briefly described based on the previous object of the comprehensive benefit evaluation indicator system of the multi-energy complementary off-grid-type system [20]:
The objective decision matrix A is derived based on the comprehensive benefit evaluation indicator system of the multi-energy complementary off-grid system, where A = x i j i = 1 , 2 , , m , j = 1 , 2 , , n is formulated in Equation (26):
A = x 11 x 12 x 1 n x 21 x 22 x 2 n x m 1 x m 2 x m n
where n is the number of operating scenarios for a multi-energy complementary off-grid system; m is the number of indicators for the comprehensive benefit evaluation of the multi-energy complementary off-grid system; and x i j is the original value of the j th metric in the first optimization strategy.
In order to facilitate the calculation, the cost type of the indicator type is converted into the benefit type by consistent treatment, as formulated in Equation (27):
x i j = 1 x i j
The standardized calculation of the indicators for assessing the comprehensive benefits of a multi-energy complementary off-grid system was carried out immediately after the transformation was completed:
P i j = x i j i = 1 m x i j
where P i j represents the standardized data for each evaluation indicator of the comprehensive benefit evaluation of the multi-energy complementary off-grid system.
The entropy of the comprehensive benefit evaluation indicator of the j th multi-energy complementary off-grid-type system is found through arithmetic, and is formulated in Equation (29):
e j = i = 1 m P i j ln 1 P i j j = 1 , 2 , , n
where e j is the entropy of the j th comprehensive benefit evaluation indicator of multi-energy complementary off-grid-type system.
The coefficient of variation of the comprehensive benefit evaluation indicator of the j th multi-energy complementary off-grid-type system is shown in Equation (30):
g j = 1 e j
where g j is the coefficient of variation of the j th comprehensive benefit evaluation indicator of the multi-energy complementary off-grid-type system.
Finally, the weights of the indicators for the comprehensive benefit evaluation of the multi-energy complementary system are measured, as formulated in Equation (31):
ω j = g j 1 n g j
where ω j is the weight value of the j th comprehensive benefit evaluation indicator of the multi-energy complementary off-grid system.

3.3. Classification and Quantification with Fuzzy Algorithm Normalization Processing

In this paper, the constructed comprehensive benefit evaluation indicators of multi-energy complementary off-grid systems are categorized into three kinds: those with a specific numerical limit, those with a fixed minimum and without a maximum, and those with maximum optimization-seeking saturation with a minimum and without a maximum.
Generally, those with specific numerical limits are taken to be 0 and 1, while the fixed minimum for the fixed-minimum-without-maximum class is taken to be 0, and the normalization transformation is performed with reference to Equation (32):
f ( x ) = 2 π arctan x
For the maximum optimization-seeking saturation with a minimum and no maximum, its maximum is generally not explicitly limited, but it can be wrapped and quantized around 1 by using the segmentation function when it is larger than 1, which is expressed as formulated in Equation (33) below:
f ( x ) = x x 0.99 2 π arctan 65 x x > 0.99
After classifying each sub-indicator of the comprehensive benefit evaluation indicator system of this multi-energy complementary off-grid system into the above three types, fuzzification processing is carried out by using the membership function μ ( x ) , where μ ( x ) [ 0 , 1 ] . Since the indicators are classified into two categories, benefit and cost, when the indicator k in the evaluation index layer of the comprehensive benefit of this multi-energy complementary system belongs to the benefit-type indicator, the specific expression of the membership function μ ( x ) is formulated as in Equation (34):
μ k x = f k , min f k x f k , max f k , min
When the indicator k in the evaluation indicator layer of the comprehensive benefits of this multi-energy complementary system belongs to the cost-type indicator, the specific expression of the membership function μ k ( x ) is formulated as in Equation (35) below:
μ k x = f k , max f k x f k , max f k , min
where f k , min is the minimum value of the evaluation indicator k , and f k , max is the maximum value of the evaluation indicator k .
After obtaining μ ( x ) , weighted summation can be performed to derive the optimization function of the indicators of the comprehensive benefit evaluation system of this multi-energy complementary off-grid system:
F CB = max k G k μ k x
where G k is the weighting coefficient of each indicator in the comprehensive benefit evaluation indicator system, and G k 0 , k G k = 1 is satisfied.

3.4. Combination Weight Calculation Based on AHP and AEM

Based on the classification and quantification with the fuzzy algorithm to complete the normalization of the indicators, the subjective and objective weighting method is used to determine the combination of weights, and a multi-level indicator weighting model based on the hierarchical analysis anti-entropy weighting method is established to analyze the comprehensive benefits of multi-energy complementary off-grid systems. It lays the foundation for the subsequent comprehensive benefit evaluation.
We determine the combined weight coefficients of the two weights based on the AHP and AEM, which are calculated as formulated in Equation (37):
ε i = ω i ω i + ω j δ i = ω j ω i + ω j
where ε i is the weighting coefficient of the AHP, and δ i is the weighting coefficient of the AEM.
The final combination weight value ω i is found through the combination calculation, which is formulated in Equation (38):
ω i = ε i ω i + δ i ω j i = j = 1 n ε i ω i + δ i ω j ,   ( i = j = 1 , 2 , , n )

3.5. Comprehensive Evaluation Method Based on TOPSIS

The TOPSIS evaluation method [21] is often referred to as the ideal point method. In this paper, based on the values of the weights of the comprehensive benefit evaluation indicators of the multi-energy complementary off-grid system, the comprehensive benefits of each operation scheme of this objective are evaluated using the TOPSIS method [22]. The specific calculation flowchart is shown in Figure 3, and the detailed steps are as follows:
  • Weight the standardized raw data of each evaluation indicator of the comprehensive benefit evaluation of the multi-energy complementary off-grid system to obtain the weighting matrix, which is formulated in Equation (39):
    R = P 11 ω 1 P 12 ω 2 P 1 n ω n P 21 ω 1 P 22 ω 2 P 2 n ω n P m 1 ω 1 P m 2 ω 2 P m n ω n = r 11 r 12 r 1 n r 21 r 22 r 2 n r m 1 r m 2 r m n
    where P m n is the standardized data of each evaluation indicator of the comprehensive benefit evaluation of the system; ω n is the weight of the n th operation scheme; n is the number of operation schemes of the multi-energy complementary off-grid system; and m is the number of comprehensive benefit evaluation indicators of the multi-energy complementary off-grid system.
  • Determine the positive and negative ideal points of the comprehensive benefit evaluation indicator of the multi-energy complementary off-grid-type system, as formulated in Equations (40) and (41):
    r j + = max 1 i m r i j j J 1 , min 1 i m r i j j J 2 j = 1 , 2 , , n
    r j = min 1 i m r i j j J 1 , max 1 i m r i j j J 2 j = 1 , 2 , , n
    where r j + is the set of positive ideal schemes; r j is the set of negative ideal schemes; J 1 is the set of benefit-based indicators; and J 2 is the set of cost-based indicators.
  • Calculate the Euclidean distance, as formulated in Equations (42) and (43):
    d i + = j = 1 n r i j r j + 2 i = 1 , 2 , , m
    d i = j = 1 n r i j r j 2 i = 1 , 2 , , m
    where d i + is the distance from the operating scheme to the positive ideal point, and d i is the distance from the operating scheme to the negative ideal point.
  • Calculate the relative closeness of each operation scheme of the multi-energy complementary off-grid system. The specific formula is as follows (44):
    C i = d i d i + + d i i = 1 , 2 , , m
    where C i is the relative closeness of each operating scheme and satisfies 0 C i 1 .
The relative closeness of each scheme is calculated using the above equation, and the optimal scheme for the comprehensive benefits is judged based on the relative closeness.

4. Results and Discussion

This section includes the case study and result presentation, as detailed below.
According to the comprehensive benefit evaluation indicator system of multi-energy complementary off-grid systems constructed above, a comprehensive benefit evaluation and a comparative analysis of the three different operation schemes given are carried out.
Operation Scheme 1: No wind, PV, or hydrogen storage equipment is involved in regulation, and only hydropower is operated separately, allowing hydropower to meet the system’s load demand as much as possible within certain constraints, thus reducing the amount of fossil energy purchased from outside the system.
Operation Scheme 2: This scheme involves hydro–wind–photovoltaic joint operation without adding hydrogen storage equipment. The double-layer capacity optimization allocation model constructed in this case does not have to consider the variables and constraints related to hydrogen storage equipment, and only the hydro–wind–photovoltaic constraints are included in the solution.
Operation Scheme 3: Hydropower plants are used as the basis for joint wind–solar-hydrogen storage operation, and capacity optimization is allocated based on a conventional dual-layer model.

4.1. Indicator Data Access

Based on the interrelationships of the indicators in the diagram of the comprehensive benefit evaluation indicator system of the multi-energy complementary off-grid-type system established in Figure 1 and Figure 2, a hierarchical structure of indicator evaluation is established. The nature of each indicator is analyzed in terms of costs and benefits with qualitative and quantitative aspects.
By reviewing relevant information and literature for analysis, the three operational schemes developed are organized and summarized, resulting in quantitative index data of the three operational schemes for the comprehensive benefit evaluation of the multi-energy complementary off-grid system, as shown in Table 3 below:
The qualitative indicators are handled by inviting relevant industry experts to evaluate the qualitative indicators in accordance with the qualitative indicator evaluation criteria [23] shown in Table 4 below, and we take the average value as the reference standard. The results of the scores of the qualitative evaluation indicators are shown in Table 5 below.

4.2. Calculation and Analysis of Comprehensive Benefit Evaluation Results Based on TOPSIS

The indicator data obtained to calculate the weighting matrix for the comprehensive benefit evaluation of the multi-energy complementary off-grid-type system are shown in Table 6 below:
We calculate the positive and negative ideal points for each indicator according to Equations (40) and (41), then use Equations (42) and (43) to calculate the Euclidean distance between each operating plan and the positive and negative ideal points, as shown in Table 7:
Based on Equation (44), the relative closeness of each operational scheme of the multi-energy complementary off-grid-type system is calculated as shown in Table 8 below:
From Table 7, it can be seen that the Euclidean distance to the positive ideal point for operation scheme 3 is 0.0016, the Euclidean distance to the negative ideal point is 0.0314, and the size of the calculated relative closeness is 0.8250, which is the largest among the three schemes, so the scheme has the best comprehensive benefit evaluation. Considering that operation scheme 3 is a combined operation, the utilization of hydrogen storage equipment can greatly improve the operational yield of the system as well as the clean energy consumption rate while suppressing the instability of the wind power and photovoltaic output. In this paper, the comprehensive benefits of the constructed multi-energy complementary off-grid system are evaluated from four perspectives: economic benefits, environmental benefits, technological reliability, and social benefits. The superiority of operation scheme 3 is verified, which shows that the joint operation has broad application prospects.
In addition, as the traditional indicator evaluation system is less involved in indicators of the power supply reliability of the system, electric power production safety, and resident satisfaction, under the background conditions of operation scheme 3, which is based on hydropower plants and operates together with combined wind–solar hydrogen storage, the expansion of the scale of production led to the peak load exceeding the designed capacity by 12%. In addition, regarding the traditional evaluation system, because of its focus on economic benefits and environmental benefits, considering that the cost of power generation did not rise significantly, the change in the value of the relative closeness was about 0.0013 under the solution method using the same combination of subjective and objective assignment based on the combination of the AHP and AEM, as well as the TOPSIS comprehensive evaluation method; this shows that there is short-term overloaded operation of the system compared to the normal operation of the system. The comprehensive evaluation results calculated by the traditional evaluation system did not change significantly, which shows that the traditional evaluation system is not sensitive to load demand changes; however, the evaluation system constructed in this paper takes into account the safety and reliability of off-grid system operation and the security of residents’ production and lives, and under the same background conditions, the relevant qualitative index scores plummeted, and the value of relative closeness changed to about 0.0071; it can be seen that compared with the traditional evaluation system, the evaluation system constructed in this paper provides an early warning of sensitivity to the changes in the load demand under off-grid conditions, which indicates that the constructed evaluation system has good practical application value.

5. Conclusions

(1) Considering the higher safety and reliability requirements of off-grid systems and the impact of their social benefits, this paper constructs a more perfect and comprehensive multi-level evaluation indicator system for analyzing the comprehensive benefits of multi-energy complementary off-grid systems.
(2) For the constructed evaluation indicator system, the subjective and objective weighting method combined with the AHP and AEM is utilized to determine the weights of each indicator, and a comprehensive benefit evaluation analysis of each operation scheme is carried out based on the TOPSIS method. Through example verification, it is found that the relative closeness values of operation schemes 1, 2, and 3 are 0.2658, 0.6374, and 0.8250, respectively. As the larger relative closeness in the TOPSIS method indicates the higher degree of closeness of the scheme to the ideal optimal solution, it is further verified that the proposed evaluation indicator system and multilevel evaluation method can more comprehensively evaluate and analyze the advantages and disadvantages of the multi-energy complementary off-grid system under different operation schemes, and at the same time, compared with the traditional evaluation indicator system, it is found that the constructed evaluation indicator system is able to provide better warnings as it has higher sensitivity to changes in load demand.
(3) For the evaluation dimension of social benefit in this paper, it is mainly reflected by some qualitative indicators. In future research, we will study more scientific quantitative methods to further improve it, and at the same time, we will also try to take into account the risks of the planning, operation, construction, and subsequent management of off-grid systems so as to further improve the value of its commercial application. In addition, in-depth research will be conducted on more appropriate comprehensive evaluation methods to make evaluations more reasonable and scientific.

Author Contributions

Conceptualization, Y.L. and X.Y.; methodology, Y.L., X.Y. and S.Y.; writing—original draft preparation, Y.F., C.M., Q.L., Y.H. and W.Y.; writing—review and editing, Y.L., X.Y., S.Y. and Y.F. All authors have read and agreed to the published version of the manuscript.

Funding

This project was supported by the Sichuan Science and Technology Program (2024YFHZ0138, 2023YFQ0073, 2025YFHZ0279).

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding authors.

Acknowledgments

The authors would like to take this opportunity to thank the data collection assistants and the anonymous respondents who responded to the questionnaire.

Conflicts of Interest

The author Yu Lei is employed by the Energy Planning and Research Institute of Southwest Electric Power Design Institute Co., Ltd. The remaining authors declare that this research was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest.

References

  1. Singh, A.; Basak, P. Conceptualization and techno-economic evaluation of municipal solid waste based microgrid. Energy 2022, 238, 121711. [Google Scholar] [CrossRef]
  2. Zhao, H.; Wu, K.; Sun, M.; Lv, C.; Hou, K.; Peng, Y. The research on comprehensive benefit evaluation model of pumped storage power station based on improved G1-entropy weight method. IOP Conf. Ser. Earth Environ. Sci. 2021, 651, 022019. [Google Scholar] [CrossRef]
  3. Beluco, A.; de Souza, P.K.; Krenzinger, A. A dimensionless index evaluating the time complementarity between solar and hydraulic energies. Renew. Energy 2008, 33, 2157–2165. [Google Scholar] [CrossRef]
  4. Dash, S.; Chakravarty, S.; Giri, N.C.; Ghugar, U.; Fotis, G. Performance Assessment of Different Sustainable Energy Systems Using Multiple-Criteria Decision-Making Model and Self-Organizing Maps. Technologies 2024, 12, 42. [Google Scholar] [CrossRef]
  5. Yang, Y.; Liu, Z.; Xie, N.; Wang, J.; Cui, Y.; Agbodjan, Y.S. Multi-Criteria Optimization of Multi-Energy Complementary Systems Considering Reliability, Economic and Environmental Effects. Energy 2023, 269, 126933. [Google Scholar] [CrossRef]
  6. Cui, Y.; Su, C.; Yuan, W.; Lu, L.; Jurasz, J. Capacity configuration of cascaded hydro-wind-photovoltaic complementary systems considering comprehensive benefits based on a synergetic-orderly framework. Energy Convers. Manag. 2024, 319, 118916. [Google Scholar] [CrossRef]
  7. Shayan, M.E.; Najafi, G.; Ghobadian, B.; Gorjian, S.; Mamat, R.; Ghazali, M.F. Multi-microgrid optimization and energy management under boost voltage converter with Markov prediction chain and dynamic decision algorithm. Renew. Energy 2022, 201, 179–189. [Google Scholar] [CrossRef]
  8. Shayan, M.E.; Petrollese, M.; Rouhani, S.H.; Mobayen, S.; Zhilenkov, A.; Su, C.L. An innovative two-stage machine learning-based adaptive robust unit commitment strategy for addressing uncertainty in renewable energy systems. Int. J. Electr. Power Energy Syst. 2024, 160, 110087. [Google Scholar] [CrossRef]
  9. Gao, C.; Pan, X.; Xu, Z.; Zhang, J.; Huang, Y.; Deng, W. Research on the Classification and Quantification Method of Evaluation Factors for Comprehensive Evaluation of Microgrid Planning. Electr. Drive 2023, 53, 25–32. [Google Scholar]
  10. Zhang, X. Economic Optimization Model and Benefit Evaluation of Micro-Energy Grid for New Energy Consumption in Mengxi Power Grid. Ph.D. Thesis, North China Electric Power University, Beijing, China, 2020. [Google Scholar]
  11. Zhu, L.; Yang, S.; Jiang, H.; Wang, Z.; Bian, X.; Ji, L. Study on Comprehensive Evaluation of Microgrid Planning Based on Improved ANP. Acta Energiae Solaris Sin. 2020, 41, 9. [Google Scholar]
  12. Yin, S.; Zhao, Y.; Hussain, A.; Ullah, K. Comprehensive evaluation of rural regional integrated clean energy systems considering multi-subject interest coordination with pythagorean fuzzy information. Eng. Appl. Artif. Intell. 2024, 138, 109342. [Google Scholar] [CrossRef]
  13. Li, J.; Liu, P.; Li, Z. Optimal design and techno-economic analysis of a solar-wind-biomass off-grid hybrid power system for remote rural electrification: A case study of west China. Energy 2020, 208, 118387. [Google Scholar] [CrossRef]
  14. Yi, L. Research on Hybrid Micro/Small-turbine Based CCHP-Groundwater Heat Pump System. Master’s Thesis, Chinese Academy of Sciences Graduate School (Institute of Engineering Thermophysics), Beijing, China, 2010. [Google Scholar]
  15. Herrando, M.; Ramos, A. Photovoltaic-Thermal (PV-T) Systems for Combined Cooling, Heating and Power in Buildings: A Review. Energies 2022, 15, 3021. [Google Scholar] [CrossRef]
  16. Yang, Y.; Zhang, S.; Xiao, Y.; Xiao, X.; Kan, M. Application of Monte Carlo Method in Uncertainty Evaluation for Cogeneration Systems. Proc. CSEE 2013, 33, 16–23+6. [Google Scholar] [CrossRef]
  17. Ma, H.; Zhou, Q.; Chi, D.; Longduoqi, A.; Yu, D.; Chan, C.-S. Evaluating public spaces of tourist villages by combining analytic hierarchy process and importance performance analysis: A case study of Jiaochangwei in Shenzhen, China. China City Plan. Rev. 2020, 29, 65–77. [Google Scholar]
  18. Singh, B. Land suitability analysis using geographic information system (GIS) and analytic hierarchy process (AHP): A case study. Asian Profile 2014, 42, 343–355. [Google Scholar]
  19. Wang, X.; Wang, E. Evaluation of smart grid based on AHP-anti-entropy weight method. IPPTA Q. J. Indian Pulp Pap. Tech. Assoc. 2018, 30, 478–481. [Google Scholar]
  20. Zhou, X.; Li, X.; Qu, H. Node comprehensive vulnerability assessment of power grid based on anti-entropy-AHP quadratic programming combination weighting method. Electr. Power Autom. Equip. 2019, 7, 133–140. [Google Scholar]
  21. Banadkouki, M.R.Z. Selection of strategies to improve energy efficiency in industry: A hybrid approach using entropy weight method and fuzzy TOPSIS. Energy 2023, 279, 128070. [Google Scholar] [CrossRef]
  22. Aslam, M.; Fahmi, A.; Almahdi, F.A.A.; Yaqoob, N. Extension of TOPSIS method for group decision-making under triangular linguistic neutrosophic cubic sets. Soft Comput. 2021, 25, 3359–3376. [Google Scholar] [CrossRef]
  23. Zhang, L. Application of AHP-Fuzzy Comprehensive Evaluation in Assessment of Eco-industrial Park. Master’s Thesis, Dalian University of Technology, Dalian, China, 2006. [Google Scholar]
Figure 1. Construction diagram of comprehensive benefit evaluation indicator system for multi-energy complementary off-grid systems.
Figure 1. Construction diagram of comprehensive benefit evaluation indicator system for multi-energy complementary off-grid systems.
Energies 18 02159 g001
Figure 2. A diagram of the system’s comprehensive benefit evaluation indicator system.
Figure 2. A diagram of the system’s comprehensive benefit evaluation indicator system.
Energies 18 02159 g002
Figure 3. TOPSIS comprehensive evaluation flowchart.
Figure 3. TOPSIS comprehensive evaluation flowchart.
Energies 18 02159 g003
Table 1. Pollutant emission factors for different energy equipment.
Table 1. Pollutant emission factors for different energy equipment.
Pollutant Emission Pollutant   Emission   Factors   for   Individual   Energy   Equipment   χ c [g·(kW·h)−1]
Traditional Coal-FiredGas TurbineGas BoilerPhotovoltaicWind Power
NOX3.09420.61780.25540.00000.0000
SO23.94420.0009-0.00000.0000
CO-0.1713-0.00000.0000
CO286.4525184.1830227.00000.00000.0000
Table 2. Environmental evaluation criteria for polluting gases in the conventional power industry.
Table 2. Environmental evaluation criteria for polluting gases in the conventional power industry.
Type of Pollutants Emitted Environmental   Value   V C /(yuan/kg) Penalty   Amount   C (yuan/kg)
NOX6.74931.6178
SO24.85830.8174
CO0.80960.1298
CO20.01840.0082
Table 3. Quantitative indicator data for comprehensive benefit evaluation of multi-energy complementary off-grid system.
Table 3. Quantitative indicator data for comprehensive benefit evaluation of multi-energy complementary off-grid system.
Name of Evaluation IndicatorOperation Scheme 1Operation Scheme 3Operation Scheme 3
Life cycle cost C1/CNY 10,00068,015.476,974.177,162.4
Internal rate of return C2/%7.25%7.98%8.91%
Period of investment recovery C3/year14.513.913.1
Equivalent environmental cost C4/(CNY 10,000 /year)22.5624.6728.94
Carbon dioxide emission reduction rate C5/(tons/year)103,225.1147,165.1151,623.5
Clean energy consumption rate C7/%90.195.399.4
Provide employment opportunities C11/person525864
Resident satisfaction C12/%82.385.687.1
Table 4. Qualitative evaluation indicator levels for comprehensive benefit evaluation of multi-energy complementary system.
Table 4. Qualitative evaluation indicator levels for comprehensive benefit evaluation of multi-energy complementary system.
Evaluation GradeScore Range
Excellent[90, 100]
Good[75, 90)
Average[60, 75)
Poor[0, 60)
Table 5. Qualitative indicator data for comprehensive benefit evaluation of multi-energy complementary off-grid system.
Table 5. Qualitative indicator data for comprehensive benefit evaluation of multi-energy complementary off-grid system.
Name of Evaluation IndicatorOperation Scheme 1Operation Scheme 2Operation Scheme 3
Space occupancy C684.781.380.9
Power supply reliability of system C878.586.792.4
Electric power production safety C988.587.983.2
System operation flexibility C1084.389.191.5
Lead development of local regional economic industry C1387.489.690.7
Table 6. Weighted matrix of TOPSIS comprehensive benefit evaluation indicator.
Table 6. Weighted matrix of TOPSIS comprehensive benefit evaluation indicator.
Name of Evaluation IndicatorOperation Scheme 1Operation Scheme 2Operation Scheme 3
Life cycle cost C10.00810.00840.0103
Internal rate of return C20.00950.00980.0114
Period of investment recovery C30.06730.07910.0842
Equivalent environmental cost C40.00640.00890.0095
Carbon dioxide emission reduction rate C50.02470.02780.0284
Space occupancy C60.00570.00430.0038
Clean energy consumption rate C70.02110.02250.0229
Power supply reliability of system C80.02350.03060.0384
Electric power production safety C90.02480.02240.0216
System operation flexibility C100.01460.01620.0217
Provide employment opportunities C110.00890.00940.0097
Resident satisfaction C120.00840.00920.0098
Lead development of local regional economic industry C130.03140.03560.0379
Table 7. Euclidean distances from positive and negative ideal points for each operating scheme.
Table 7. Euclidean distances from positive and negative ideal points for each operating scheme.
Name of the Operational SchemeEuclidean Distance to the Positive Ideal PointEuclidean Distance to the Negative Ideal Point
Operation Scheme 10.03140.0009
Operation Scheme 20.02670.0053
Operation Scheme 30.00160.0314
Table 8. Relative closeness of the operational schemes.
Table 8. Relative closeness of the operational schemes.
Name of the Operational SchemeRelative Closeness ValueSorted
Operation Scheme 10.26583
Operation Scheme 20.63742
Operation Scheme 30.82501
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lei, Y.; Yan, X.; Yang, S.; Fan, Y.; Ma, C.; Li, Q.; Huang, Y.; Yang, W. Comprehensive Benefit Evaluation Analysis of Multi-Energy Complementary Off-Grid System Operation. Energies 2025, 18, 2159. https://doi.org/10.3390/en18092159

AMA Style

Lei Y, Yan X, Yang S, Fan Y, Ma C, Li Q, Huang Y, Yang W. Comprehensive Benefit Evaluation Analysis of Multi-Energy Complementary Off-Grid System Operation. Energies. 2025; 18(9):2159. https://doi.org/10.3390/en18092159

Chicago/Turabian Style

Lei, Yu, Xiaobin Yan, Shenhao Yang, Yu Fan, Chao Ma, Qingsong Li, Yuanfeng Huang, and Wei Yang. 2025. "Comprehensive Benefit Evaluation Analysis of Multi-Energy Complementary Off-Grid System Operation" Energies 18, no. 9: 2159. https://doi.org/10.3390/en18092159

APA Style

Lei, Y., Yan, X., Yang, S., Fan, Y., Ma, C., Li, Q., Huang, Y., & Yang, W. (2025). Comprehensive Benefit Evaluation Analysis of Multi-Energy Complementary Off-Grid System Operation. Energies, 18(9), 2159. https://doi.org/10.3390/en18092159

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop