Next Article in Journal
Theoretical Advances in MBenes for Hydrogen Evolution Electrocatalysis
Previous Article in Journal
Effect of Solar Irradiation Inter-Annual Variability on PV and CSP Power Plants Production Capacity: Portugal Case-Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Low-Carbon Optimization Scheduling of Integrated Energy Systems Based on Bilateral Demand Response and Two-Level Stackelberg Game

1
CHN ENERGY Investment Group Co., Ltd., Beijing 100011, China
2
Department of Economics and Management, North China Electric Power University, Baoding 071003, China
*
Author to whom correspondence should be addressed.
Energies 2024, 17(21), 5491; https://doi.org/10.3390/en17215491
Submission received: 12 October 2024 / Revised: 27 October 2024 / Accepted: 31 October 2024 / Published: 2 November 2024
(This article belongs to the Section C: Energy Economics and Policy)

Abstract

:
In the context of low-carbon energy transformation, fully utilizing the integrated demand response (IDR) resources on the load side can improve the operational flexibility and economy of the integrated energy system (IES). However, establishing a reasonable trading mechanism to enhance users’ participation in IDR has become a key issue that IES urgently needs to solve. To this end, this paper first establishes an IES model that includes electricity, heat, and gas. To reduce carbon emissions, a ladder-type carbon trading mechanism is introduced while adding low-carbon technologies such as carbon capture devices and power-to-gas conversion. Secondly, a bilateral IDR mechanism centered on the load aggregator (LA) is proposed, and a multi-agent operation model including IES, LA, and users is established. The IDR subsidy price is dynamically determined through a two-level Stackelberg game model involving IES, LA, and users. Then, through KKT conditions and the Big M method, the two-level game model is turned into an IES-LA game model, which is solved using a combination of the White Shark Optimization method and the Gurobi solver. The final simulation results show that the scheduling model can fully reflect the time value of IDR resources, and the IES cost is decreased by USD 152.22, while LA and user benefits are increased by USD 54.61 and USD 31.85. Meanwhile, the ladder-type carbon trading mechanism and low-carbon technology have effectively achieved low-carbon operation of the system.

1. Introduction

Recently, the clean, efficient, and sustainable energy exploitation and utilization model has become an important development direction for the future energy field [1]. In terms of carbon peaking and carbon neutrality, integrated energy systems (IESs) can fully leverage the comprehensive advantages of various complementary energy sources, which is an effective way to achieve the transition from traditional power grids to smart grids. With the widespread integration of diverse loads, how to unleash the flexibility of demand-side resources and promote source-load friendly interaction is an important issue that IES needs to consider [2]. At present, integrated demand response (IDR) is one of the most effective methods [3], and the literature [4,5] shows that IDR guides users to use energy scientifically and reasonably through economic subsidies, playing an important role in balancing supply and demand. However, when users directly trade with IES, they will incur greater risks due to insufficient load balancing capacity, while IES needs to monitor a large number of users in real time, and the scheduling process is highly time-sensitive, which is difficult to solve by conventional techniques [6].
With the gradual maturity of the electricity market, most small- and medium-sized users trade IDR resources with IES through load aggregators (LA) [7]. As a bridge between users and IES, LA achieves cross-system scheduling of IDR resources through a bilateral IDR mechanism, which involves developing an IDR mechanism to aggregate users’ IDR resources and participating in IES’s IDR plan [8]. Literature [9] established a two-level optimization model between the distribution system operator (DSO) and LA, and the results showed that the two-level optimization scheduling model can fully exploit the regulation potential of LA and improve the revenue of both DSO and LA. Literature [10] proposed a hierarchical load scheduling framework that aggregates uninterrupted time shifting loads to optimize the operating costs of LA and DSO. Literature [11] considered community users as user aggregators (UAs) and investigated the energy interaction between community-integrated energy service providers and UA. Literature [12] proposed an optimization scheduling model for IES considering DR, with the objectives of maximizing the profits for both IES and LA. The above research achieved energy interaction between LA and IES but ignored the research of users’ interests. Literature [13] proposed an LA optimization model with the goal of maximizing users’ satisfaction and also established a pricing strategy model for IES with the goal of maximizing profits. Literature [14] developed an optimization scheduling model between the DSO, EV aggregator, and EV users and analyzed the impact of the EV aggregator’s operation mechanism on the interests of the three parties. The above research achieved the interaction of energy and benefits among energy suppliers, LA, and users through a bilateral IDR mechanism. However, the subsidy price of IDR is fixed, which cannot reflect the time value of IDR resources and cannot fully mobilize the enthusiasm of users.
In recent years, game theoretical methods have been more widely applied in IES energy price decision making and multi-subject interaction. Literature [15] established a trading strategy model between IES, LA, and users based on the master–slave game, which achieves the efficient use of DR resources by gaming the DR subsidy price. In order to achieve the balance of interests among IES operators, LA, and users, literature [16] established a hierarchical Stackelberg game model based on the consideration of users’ psychology. Reference [17] proposed a three-level framework for auxiliary service market operators, aggregators, and users and utilized the Stackelberg game model to achieve optimization scheduling of various auxiliary services, including demand response. The above studies have employed game theory methods to dynamically determine DR subsidy prices, reflecting the time value of DR resources. However, these studies only considered electricity DR resources and ignored the effective interaction between other DR resources such as heat and natural gas.
In addition, with the increasing severity of global warming, increasing the use of clean energy to reduce carbon emissions is a key issue for IES. The current research mainly focused on two aspects: innovative system architecture and the introduction of carbon trading mechanisms. In terms of IES system architecture, existing studies tend to introduce multiple low-carbon technologies to reduce system carbon emissions through multi-energy complementary and gradient utilization. Literature [18,19,20] showed that carbon capture systems (CCSs) and power to gas (P2G), as the most promising decarbonization technologies, can effectively reduce carbon emissions in the energy sector. Literature [21] added P2G and CCS to combined heat and power (CHP) and established an IES low-carbon optimization scheduling model. The simulation results showed that the carbon transaction cost of the system was reduced by 61.34%, the carbon emission was reduced by 3.94%, and the operating cost was reduced by 50.49%. In terms of the carbon trading mechanism, literature [22] developed an energy interaction and carbon trading mechanism between community IES, which reduced the overall operating costs and carbon emission costs. Literature [23] proposed a low-carbon economic operation strategy for IES based on a ladder-type carbon trading mechanism and carbon cycle, which realized the low-carbon use of energy. The above studies have effectively controlled the carbon emissions of IES in different ways, but there are fewer studies that combine multiple low-carbon technologies with carbon trading mechanisms in IES to achieve a reduction in systematic carbon emissions.
Additionally, there are many uncertainties in the operation of IES, such as the output of PV and WT. Existing research typically employs scenario analysis, stochastic programming, and robust optimization methods to simulate the effects of uncertain factors. Literature [24] used the Monte Carlo method to generate typical scenarios of PV in high-speed railway stations. Literature [25] considered the uncertainty of renewable energy output and used Latin hypercube sampling for simulation. However, the scheduling scheme obtained using the scenario analysis method cannot meet the optimal scheduling scheme for all scenarios. Literature [26] used a two-stage stochastic programming method to address the uncertainty of renewable energy output. However, both stochastic programming and scenario analysis methods require deterministic probability curves to generate scenarios, which may result in models that are not accurate enough to reflect actual situations. The robust optimization method replaces the exact probability distribution of random variables with uncertain sets and obtains the scheduling scheme of the system in the “worst-case” scenario through optimization methods, which is more in line with the needs of practical engineering. Literature [27] used robust optimization to describe the uncertainty of renewable energy output and promoted flexibility in the planning of the system. Literature [28] introduced robust optimization methods to handle electricity price uncertainty, which can maintain the conservatism of the optimization results at a relatively low level. It can be seen that robust optimization methods have broad application prospects in the scheduling decision-making problem of power systems because they do not require precise probability distribution information of uncertain parameters and can calculate quickly.
In summary, the existing research has the following shortcomings: (1) There is little study on the dynamic decision making of IDR subsidy prices in the multi-agent interaction model involving IES, LA, and users. (2) There is relatively little research on the integration of carbon trading mechanisms and various low-carbon technologies within IES to reduce system carbon emissions, and the carbon reduction capacity of IES needs further exploration. In response to the above issues, this paper proposes an integrated energy system low-carbon optimization scheduling model based on a bilateral demand response and two-level Stackelberg game. Therefore, the main contributions of this paper are as follows:
(1) By combining a ladder-type carbon trading mechanism with low-carbon technologies such as P2G and CCS, the low-carbon operation of IES can be promoted.
(2) A bilateral IDR incentive mechanism centered on LA is proposed, establishing a two-level Stackelberg game model that includes IES, LA, and users to dynamically determine IDR subsidy prices. Additionally, robust optimization method is utilized to address the uncertainty of wind turbine (WT) output within IES.
(3) By using the Karush–Kuhn–Tucke (KKT) condition and the Big M method, the two-level game model that includes IES, LA, and users is transformed into a game model between IES and LA. The White Shark Optimization (WSO) algorithm is combined with the Gurobi solver to solve the problem.
This paper consists of six parts. The energy flow structure and equipment model will be explained in Section 2. Section 3 introduces the bilateral IDR trading mechanism and establishes a multi-agent optimization model. Section 4 analyzes the two-level Stackelberg game formed between IES, LA, and users, Section 5 introduces the solution of the game model, and Section 6 conducts case analysis. Finally, the conclusion is drawn in Section 7.

2. Energy Flow and Device Model

2.1. IES Energy Flow

The energy flow inside IES is shown in Figure 1, and the main equipment includes renewable energy, CHP units for natural gas sources, gas boilers (GBs), a garbage incineration device, demand response, and energy storage systems (ESSs). Among them, CHP is composed of a gas turbine (GT) and a waste heat boiler (WHB) internally. To reduce carbon emissions, CCS and P2G devices have been added to the CHP unit. Specifically, the CCS unit captures the carbon dioxide generated during the combustion of the CHP unit and provides it to the P2G device to generate natural gas. The garbage incineration device is an ecologically beneficial controlled power generating unit that has the properties of reduction, harmless treatment, and resource utilization [22]. However, the large amount of harmful gas generated during the incineration process needs to be treated with flue gas before it can be discharged. This paper adds gas storage devices to achieve decoupling between the output of the garbage incineration device and flue gas treatment. At the same time, the distribution network and natural gas network provide electricity and natural gas to IES to ensure the normal operation of the system.

2.2. Device Model

2.2.1. CCS-P2G-CHP Model

(1) CHP model
In CHP units, GT burns natural gas to provide electricity and heat to various components of the system [29]. The relationship between its power generation and natural gas consumption is as follows:
P e , t G T = P g , t G T η G T Q C H 4
P min G T P e , t G T P max G T
where P e , t G T is the electrical energy generated by the GT, P g , t G T is the consumption of natural gas, η C H P is the power generation efficiency, and Q C H 4 is the combustion heat value of natural gas. P max G T and P min G T are the upper and lower limits of GT power generation, respectively. Considering the cogeneration power of the CHP has the constraint of “determining electricity based on heat”, the heat power P h , t G T of the GT can be expressed as follows:
max { P min h 1 P h , t G T , h m ( P h , t G T P h , o G T ) } P e , t G T P max h 2 P h , t G T
where P h , t G T is the heat generation power of the GT, h 1 and h 2 are the thermoelectric conversion coefficients corresponding to the minimum output power P min and the maximum output power P max , and h m is the linear supply slope of the CHP thermoelectric power. P h , o G T is the thermoelectric power corresponding to the lowest generation power of the GT.
The heat generation power of GB is the following:
P h , t G B = P g , t G B η G B Q C H 4
where P g , t G B is the natural gas consumption, and η G B is the heat production efficiency.
(2) CCS-P2G model
This paper uses CCS to capture carbon dioxide generated during the production process of CHP units and transfers it to P2G devices. The electrical power P t C C S consumed by CCS is directly proportional to the amount of carbon dioxide captured, and the expression is as follows:
P t C C S = γ W t P 2 G
W t P 2 G = α c o 2 η P 2 G P t P 2 G
P min C C S < P t C C S < P max C C S
P min P 2 G < P t P 2 G < P max P 2 G
where γ is the conversion coefficient of the electrical energy consumed to capture carbon dioxide, W i , t P 2 G is the amount of carbon dioxide required for P2G, α c o 2 represents the amount of carbon dioxide required to generate unit power of natural gas, η P 2 G represents the conversion efficiency of P2G equipment, and P t P 2 G represents the energy consumption of P2G equipment; P min C C S and P max C C S are the lower and upper limits of CCS power consumption, respectively. P min P 2 G and P max P 2 G are the lower and upper limits of the power consumption of P2G, respectively. P g , t P 2 G is the amount of natural gas generated by the P2G device, expressed as follows:
P g , t P 2 G = 3.6 η P 2 G P t P 2 G H g
where H g is the calorific value of natural gas.

2.2.2. IDR Model

The multiple loads studied in this paper are electricity, heat, and gas. IDR resources include transferable loads and substitutable loads, and substitutable loads represent the ability of different types of energy to replace each other [30]. Any load within IES consists of three parts: fixed load, translatable load, and alternative load, which can be expressed as follows:
P j , t l o a d = P j , t f + P j , t m + P j , t s
where j represents the type of load, and j { e , h , g } , e , h , g represent electricity, heat, and gas, respectively. P j , t l o a d represents the amount of class j load. P j , t f represents the fixed load, P j , t m represents the translatable load, and P j , t s represents the alternative load.

2.2.3. Garbage Incineration Device Model

In the flue gas treatment system of the garbage incineration device, the reaction tower processes the flue gas that enters through the smoke exhaust pipe and gas storage device, ensuring that pollutant gases in the flue gas are removed before emission. The ratio of the amount of flue gas entering the reaction tower to the amount of flue gas produced is the flue gas separation ratio λ t [31]. The amount of flue gas flowing into the gas storage tank can be adjusted by adjusting λ t , as shown below:
α t = P t W I e α = α t 1 + α t 2
P t α = w α ( α t 1 + α t 2 )
λ t = α t 1 / α t
where α t represents the amount of flue gas generated during incineration. α t 1 and α t 2 represent the amount of flue gas flowing into the reaction tower and storage tank, respectively. P t W I is the output of the garbage incineration device, and e α is the amount of flue gas generated per unit of electrical energy. P t α is the energy consumption of the flue gas treatment system, and w α is the unit processing energy consumption coefficient of the flue gas treatment system.

2.2.4. ESS

The power expression for electric and heat energy storage is as follows:
E j , t E S = ( 1 η j , l o s s ) E j , t 1 E S + ( η P j , t c h a 1 η P j , t d i s ) Δ t
E j , min e E j , t E S E j , max e
0 P j , t c h a U j , t e s P j , max c h a
0 P j , t d i s ( 1 U j , t e s ) P j , max d i s
where j represents the type of energy storage, and j { e , h } , e , h represent electrical energy and heat energy, respectively. E j , t e is the stored energy, η j , l o s s is the energy loss coefficient, and η is the efficiency of charging and discharging energy. P j , t c h a and P j , t d i s are the power of charging and discharging energy, respectively. E j , min e and E j , max e are the minimum/maximum remaining capacity allowed during the scheduling process. P j , max c h a and P j , max d i s represent the upper limit of energy power for charging and discharging, and U j , t e s represents the state of charging and discharging, with a charging value of 1 and a discharging value of 0.

3. A Multi-Agent Optimization Model Considering Bilateral IDR Trading Mechanism

3.1. Bilateral IDR Trading Mechanism

This paper establishes a bilateral IDR trading mechanism, as shown in Figure 2, involving three types of stakeholders: IES, LA, and users. IES has established incentive mechanisms to provide LA with subsidy prices for IDR resources. As the integrator of load response resources, LA maximizes its own interests through a bilateral IDR mechanism. On the one hand, it signs contracts with IES to integrate IDR resources; on the other hand, it signs contracts with users to aggregate their load response by providing IDR subsidies. Users are the ultimate participants in IDR, and they gain economic benefits from the IDR platform provided by LA by adjusting the usage time of the load.

3.2. IES Model

3.2.1. IES Objective Function

min C I E S = t = 1 T C t C H P + C t u t i l i t y + C t C 0 2 + C t I D R
(1)
The operating cost of CCS-P2G-CHP unit C t C H P
C t C H P = a P e , t G T + b ( P e , t G T ) 2 + m 1 P t P 2 G + m 2 P t C C S + c
where a , b , c are the operating cost coefficient of the CCS-P2G-CHP coupling system, and m 1 and m 2 are the operating and maintenance cost coefficients of P2G and CCS [32], respectively.
(2)
External interaction costs C i u t i l i t y
External interaction cost includes natural gas purchase cost and electricity purchase cost:
C i u t i l i t y = t = 1 T λ g , t b u y P g , t b u y + λ e , t b u y P e , t b u y
where λ g , t b u y and P g , t b u y are the purchase price and amount of natural gas; λ e , t b u y and P e , t b u y represent the purchase price and amount of electricity.
(3)
Ladder-type carbon trading cost C t C O 2
The carbon emission quota W t 0 of IES is calculated by the following formula:
W t 0 = D ( P e , t G T + P h , t G T + P h , t G B + P t W I + P t W T )
where D is the carbon emission quota for unit electricity and heat energy production; P t W T is the power generated by WT.
IES carbon dioxide emissions W t c o 2 , a are modeled as follows:
W t c o 2 , a = a c o 2 ( P e , t G T + h 1 P h , t G T ) + b c o 2 P h , t G B + c c o 2 P t W I W t P 2 G
where a c o 2 , b c o 2 , and c c o 2 are the carbon dioxide emission coefficients of CHP units, GB, and garbage incineration devices [33,34].
In summary, the carbon trading amount of IES is the following:
W t c o 2 = W t c o 2 , a W t 0
The ladder-type carbon trading mechanism divides multiple carbon emission right purchase intervals, and as IES needs to purchase more carbon emission right quotas, the purchase price of the corresponding interval will be higher. The ladder-type carbon trading model is the following:
C t C O 2 = λ W t C O 2 , W t C O 2 l λ ( 1 + α ) ( W t C O 2 l ) + λ l , l < W t C O 2 < 2 l λ ( 1 + 2 α ) ( W t C O 2 2 l ) + ( 2 + α ) λ l , 2 l < W t C O 2 < 3 l λ ( 1 + 3 α ) ( W t C O 2 3 l ) + ( 3 + 3 α ) λ l , 3 l < W t C O 2 < 4 l λ ( 1 + 4 α ) ( W t C O 2 4 l ) + ( 4 + 6 α ) λ l , 4 l < W t C O 2
where λ is the carbon trading base price, l is the interval length of carbon emissions, and α is the price increase rate.
(4)
IDR cost C t I D R
C t I D R = c e , t I E S P e , t L A + c h , t I E S P h , t L A + c g , t I E S P g , t L A
Here, c e , t I E S , c h , t I E S , and c g , t I E S are the unit electricity DR, heat energy DR, and natural gas DR subsidy price provided by IES to LA, while P e , t L A , P h , t L A , and P g , t L A are the electricity DR, heat DR, and natural gas DR aggregated by LA.

3.2.2. IES Constraint Condition

(1) IDR constraints
0 P j , t L A P j , m a x L A
c j , min I E S c j , t I E S c j , max I E S
Here, j { e , h , g } represents the type of DR resources; e , h and g represent electricity, heat, and natural gas, respectively. P j , m a x L A is the upper limits of the load response aggregated by LA, and c j , min I E S and c j , max I E S represent the minimum and maximum subsidy prices provided by IES.
(2) Electric power balance constraint
P e , t l o a d = P e , t b u y + P e , t G T + P t W I + P t W T + P e , t L A + P e , t d i s P e , t c h a P t α P t P 2 G P t C C S
(3) Heat power balance constraint
P h , t l o a d = P h , t G T + P h , t G B + P h , t c h a + P h , t L A + P h , t d i s
(4) Natural gas balance constraint
P g , t l o a d = P g , t b u y + P g , t P 2 G + P g , t L A P g , t G T P g , t G B

3.2.3. Uncertainty Model of WT Output

In practical operation, renewable energy connected to IES has uncertainty. Due to the many factors that affect uncertainty, it is easier to obtain uncertainty intervals in practical engineering. Therefore, this paper uses robust intervals to describe the uncertainty range of renewable energy output, as follows:
P W T ( t ) = [ P ¯ W T ( t ) P W T l d , P ¯ W T ( t ) + P W T u d ]
where P W T ( t ) is the actual output of WT, P ¯ W T ( t ) is the predicted value of WT, and P W T l d and P W T u d , respectively, represent the maximum allowable deviation of WT. Due to the inability to directly find the expression of the worst case corresponding to the power balance constraint (28), an analytical expression for the worst-case power balance constraint is constructed based on the robust optimization method proposed in reference [35], as follows:
P e , t l o a d = P e , t b u y + P e , t G T + P t W I + max P t W T + P e , t L A + P e , t d i s P e , t c h a P t α P t P 2 G P t C C S = P e , t b u y + P e , t G T + P t W I + max { η W T l d P W T l d + η W T u d P W T u d } + P e , t L A + P e , t d i s P e , t c h a P t α P t P 2 G P t C C S
η W T l d + η W T u d Γ t
0 η W T l d , η W T u d 1
where η W T l d and η W T u d represent the proportional deviation of WT output relative to its fluctuation range, and Γ t represents the uncertainty of the model. When Γ t = 0 , the uncertainty set is empty, and the model degenerates into a deterministic model. At this time, WT output is the predicted value. As the uncertainty of the system increases, the fluctuation range of WT continues to increase, and the robustness of the system gradually improves.
In order to obtain a manageable form of the above problem, a dual variable λ W T t , π W T t + , π W T t is introduced, and the worst-case scenario of WT output can be equivalent to a solvable dual problem, as shown in Equations (35)–(37):
min λ W T t Γ W T t + π W T t + + π W T t +
λ W T t + π W T t + P W T u d
λ W T t + π W T t P W T l d
In summary, the IES model can be expressed by Equations (1)–(30) and (35)–(37).

3.3. LA Model

3.3.1. LA Objective Function

max F L A = t = 1 T C t I D R C t L A
Here, F L A is the utility function of LA, C t I D R is the IDR subsidy cost provided by IES to LA, and the expression is the same as Equation (25). The IDR subsidy fee C t L A provided by LA to users is expressed as follows:
C t L A = k = 1 K c j , t L A P j , k , t R U
where j { e , h , g } represents the type of IDR resources, and e , h and g represent electricity, heat, and natural gas, respectively. c j , t L A represents the unit subsidy prices provided by LA to users for participating in IDR; P j , k , t R U represents the IDR response amount of the user.

3.3.2. LA Constraint Condition

(1) Load response constraint
k = 1 K P j , k , t R U = P j , t L A
Equation (40) indicates that the load response provided by LA is the sum of all users’ response amounts signed with it.

3.4. User Model

3.4.1. User Objective Function

For users, the goal is to maximize the utility obtained by participating in IDR, expressed as follows:
max F R U = t = 1 T k = 1 K C t L A μ k φ ( P j , k , t R U )
φ ( P j , k , t R U ) = θ k 2 ( P j , k , t R U ) 2 + ν k P j , k , t R U
0 μ k 1
where C t L A is the subsidy fee paid by LA, expressed the same as in Equation (39), φ ( P j , k , t R U ) is the discomfort cost incurred by the user for participating in IDR, μ k is the weight factor relative to φ ( P j , k , t R U ) , and θ k and ν k are parameters related to the user, reflecting the user’s attitude towards responding to the load [36].

3.4.2. User Constraint Conditions

0 P j , k , t R U P j , max R U
P j , k , t R U = P j , k , t m + P j , k , t s
Equation (45) indicates that the load response provided by the user includes transferable loads and substitutable loads.

4. A Two-Level Stackelberg Game Model

A Two-Level Stackelberg Game

In the IDR resource trading process, the subsidy prices published by IES will affect the load response amount of LA aggregation, and the subsidy prices provided by LA will also affect the load response amount of users. At the same time, the load response amount of users will affect the formulation of LA subsidy prices, thereby affecting the cost of IES and, in turn, the formulation of subsidy prices. IES, LA, and users coordinate their respective interests and constrain each other’s feedback by continuously adjusting their strategies, forming a Stackelberg game model with a leader–follower hierarchical structure. Therefore, this paper proposes a two-level Stackelberg game model to analyze the decision-making process, as shown in Figure 3. The proof of the existence of equilibrium solutions in the game is shown in Appendix A.
Between IES and LA, IES serves as the leader of the game and LA as the follower. IES provides IDR subsidy prices to LA, which adjusts the aggregated response amount and uploads it to IES. IES determines the output of each unit in the system based on the aggregated response amount of LA, which is consistent with the basic characteristics of the Stackelberg game model. Between LA and users, LA serves as the leader of the game, while users serve as followers. LA provides users with subsidy prices for participating in IDR, and users adjust the load response amount based on the subsidy price and upload it to LA. This process is in line with the basic characteristics of the Stackelberg game model.

5. Solving Game Models

There are two common methods for solving traditional dual agent optimization problems: (1) using KKT transformation to transform the dual agent optimization problem into a single agent optimization problem [37] and (2) directly solving based on a distributed iterative algorithm [38]. This paper refers to the solution of the dual agent optimization problem. Firstly, the KKT condition and the Big M method are used to transform the user’s objective function into a constraint condition of LA, that is, the multi-agent two-level game model is transformed into a game problem between IES and LA. Secondly, the WSO algorithm and Gurobi solver are combined to solve the game equilibrium solution.

5.1. KKT Conversion

Using KKT conditions to transform the user’s objective function into the constraint conditions of LA, the Lagrangian function of LA is obtained:
L k R U = k 1 ρ + k 2 α P j , k , t R U 1 2 μ k θ k P j , k , t R U 2 μ k v k P j , k , t R U + ( λ l b ( t ) λ u b ( t ) ) P j , k , t R U
L j , k R U P j , k , t R U = k 1 ρ + k 2 α μ k θ k P j , k , t R U μ k v k + λ j , l b ( t ) λ j , u b ( t ) = 0
0 P j , k , t R U λ j , l b ( t ) 0
0 ( P j , max R U P j , k , t R U ) λ j , u b ( t ) 0
where j { e , h , g } represents the type of load, and e , h and g represent electricity, heat, and gas, respectively. L j , k R U is the Lagrangian function of the k t h user. Equation (47) sets its first-order derivative with respect to P j , k , t R U to 0, where λ j , l b ( t ) , λ j , u b ( t ) are bivariate. Equations (48) and (49) represent the KKT transformation of Equation (44).

5.2. Linear Transformation

Due to the complementary constraints of Equations (48) and (49) being nonlinear and the objective function in LA containing a bilinear term c j , t L A P j , k , t R U , it is difficult to solve the problem directly. Therefore, by using the Big M method, Equations (48) and (49) are transformed into the following mixed integer linear constraints:
0 P j , k , t R U π j , t l b M
0 λ j , t l b ( 1 π j , t l b ) M
0 P j , max R U P j , k , t R U π j , t u b M
0 λ j , t u b ( 1 λ j , t u b ) M
where π j , t l b , π j , t u b is a 0–1 variable, and M is a sufficiently large positive number. Equations (50)–(53) are equivalent to Equations (48) and (49). In addition, using the dual variable in the KKT optimal condition in Equation (47), c j , t L A P j , k , t R U will be transformed into a quadratic term, represented as follows:
c j , t L A P j , k , t R U = μ k θ k ( P j , k , t R U ) 2 + ( λ j , u b ( t ) λ j , l b ( t ) + μ k v k ) P j , k , t R U
where the objective function of LA can be expressed as a mixed integer quadratic programming (MIQP) problem, as shown in Equation (55):
max   F L A = t = 1 T c j , t I E S P j , t L A t = 1 T k = 1 K c j , t L A P j , k , t R U = t = 1 T k = 1 K c e , t I E S P j , k , t R U μ k θ k ( P j , k , t R U ) 2 ( λ e , u b ( t ) λ e , l b ( t ) + μ k v k ) P j , k , t R U

5.3. Solving Process

The fundamental idea behind WSO, which was first put up by Malik Braik et al. in 2022, was inspired by the way great white sharks hunt and track prey as well as their keen senses of smell, hearing, and fish behavior. The principle and solution process of WSO are detailed in reference [39] and will not be elaborated on in this paper. Due to the strong optimization ability and fast convergence speed of WSO, this paper uses WSO combined with the Gurobi solver to solve the game model. First, the subsidy price c j , t I E S of IES is randomly initialized and passed to LA, and then the Gurobi solver is called to solve the Stackelberg game between LA and users, that is, the MIQP problem shown in Equation (55), and the optimal load response P j , k , t R U is determined. Next, the load response P j , t L A aggregated by LA is returned to the upper fitness function, and the optimal subsidy price c j , t I E S is solved using the WSO algorithm. At the same time, the CPLEX solver is embedded to calculate the optimal output of each unit of IES. Due to the fact that the solution of the Stackelberg game model can be transformed into the solution of optimization problems [40], using Gurobi to solve the MIQP problem, the optimal solution obtained is the equilibrium solution of the game between LA and the user. When the optimal subsidy price c j , t I E S found by the upper layer WSO algorithm in adjacent generations is the same, it can be considered that the Stackelberg game between IES and LA has reached equilibrium. The algorithm flowchart can be seen in Appendix A Figure A1.

6. Example Analysis

6.1. Parameter Settings

This paper takes an IES in northern China as an example for numerical analysis. The operating parameters of the system are shown in Appendix A Table A1 [23,34,41]. This paper considers that the fluctuation deviation of WT output is 10% of the predicted value, and the WT output curve is shown in Appendix A Figure A2 [42]. Reference [42] was used for purchase and sale electricity prices and natural gas prices in external markets. The subsidy price range for participating in IDR set by IES is [0.0983, 0.1683] USD/kWh, the subsidy price range for IDR set by LA is [0.0561, 0.0983] USD/kWh. The upper bound of the response of LA aggregated users is 10% of the benchmark load. The user baseline load curve is shown in Figure A2 [42], with attitudes θ k and ν k towards participating in demand response have values of 0.02 and 0.9, and the weight of discomfort cost μ k is 0.4 [42]. In the WSO algorithm, the population size is set to 100, and the maximum number of iterations is 500. The simulation is modeled in the MATLAB R2018a compilation environment using the Cplex 12.10 optimization tool and solved based on the Gurobi solver.

6.2. Comparative Analysis of Economic and Environmental Benefits

To analyze the impact of IDR, ladder-type carbon trading mechanisms, and low-carbon technologies such as P2G and CCS on IES optimization scheduling, the following four scenarios are set up. In this section, the robustness coefficient of WT output is taken as an example in Γ W T = 6 . The cost of IES and the benefits of LA and users in different scenarios are shown in Table 1. Scenario 4 is the model established in this paper.
Scenario 1: without considering P2G and CCS devices, using the Stackelberg game to dynamically determine IDR subsidy prices.
Scenario 2: considering P2G and CCS devices, the objective function of IES does not include carbon trading costs and uses the Stackelberg game to dynamically determine IDR subsidy prices.
Scenario 3: considering P2G and CCS devices, a fixed IDR subsidy price is adopted, while the IES benchmark subsidy price is 0.8 CNY/kWh and the LA benchmark subsidy price is 0.55 CNY/kWh.
Scenario 4: considering P2G and CCS devices, the objective function of IES includes carbon trading costs and uses the Stackelberg game to dynamically determine IDR subsidy prices.
Compared with Scenario 1, the carbon emissions of the system in Scenario 4 decreased by 2732.34 kg, and the carbon trading cost decreased by USD 235.29. It can be seen that the introduction of P2G and CCS technology can achieve low-carbon operation of the system. At the same time, combined with Figure 4 and Figure 5, it can be seen that CCS technology can capture the carbon emissions of the system and react with P2G to synthesize natural gas, reducing the purchase cost of natural gas by USD 94.63. In addition, after the introduction of P2G and CCS technologies, the system needs to use more electricity to supply P2G and CCS devices, which increases the demand for demand response resources in the system. This leads to an increase of USD 3.36 and USD 8.90 in revenue for LA and users in Scenario 4, respectively, but the increase in revenue is relatively small.
Compared with Scenario 2, the carbon emissions in Scenario 4 decreased by 3345.73 kg, indicating that the ladder-type carbon trading mechanism can effectively reduce carbon dioxide emissions. Combining Figure 4 and Figure 5, it can be concluded that without considering the cost of ladder-type carbon trading, the amount of natural gas purchased in Scenario 2 is significantly higher than in Scenario 4 and burning a large amount of natural gas will lead to a significant increase in carbon emissions. In addition, when the energy supply of the system is mainly provided by CHP units and carbon emission costs are not considered, the demand for demand response resources in the system will decrease, leading to a decrease in the subsidy prices provided by IES, further reducing the user response amount of LA aggregation, resulting in a decrease of USD 19.10 and USD 14.02 in revenue for LA and users in Scenario 2, respectively.
Compared with Scenario 3, IES has the lowest total cost in Scenario 4. It can be seen that compared to a fixed IDR subsidy price, the dynamic game IDR price can better improve the profits of IES, LA, and users. Specifically, although the IDR subsidy cost increased by USD 36.90 after using the Stackelberg game to decide the subsidy price, combined with Figure 4 and Figure 5, it can be seen that the system’s electricity purchase cost, gas purchase cost, and carbon trading cost decreased by USD 52.85, USD 93.00, and USD 44.10, respectively, for a total cost reduction of USD 152.22. At the same time, the benefits for LA and users were also the highest, increasing by USD 54.61 and USD 31.85, respectively. This is because the subsidy price set by IES reflects the time value of DR resources. When the unit subsidy price obtained by LA increases, it can further incentivize LA to aggregate user response, and users can also receive higher subsidy prices, which increases the benefits for LA and users.
In summary, by comparing the total cost of IES and the benefits of LA and users in four scenarios, this paper introduces a ladder-type carbon trading mechanism and low-carbon technologies such as P2G and CCS to effectively reduce the total cost and carbon emissions of IES while using Stackelberg game decision making to subsidize IDR prices. At the same time, it improves the benefits of LA and users, demonstrating the effectiveness of the proposed solution.

6.3. IDR Subsidy Prices and Response Amount

Based on the analysis of Scenario 4 in Section 6.2, in the game between IES and LA, the IDR subsidy prices provided by IES and the aggregated load response of LA are shown in Figure 6. It can be seen that IES incentivizes LA to aggregate load response during peak and low periods by dynamically adjusting subsidy prices. Specifically, the average subsidy prices for electric energy DR, heat energy DR, and natural gas DR during peak hours of 11–13 h and 19–23 h are 1.06 CNY/kWh, 1.01 CNY/kWh, and 0.87 CNY/kWh, respectively. The average subsidy prices for electric energy DR, heat energy DR, and natural gas DR during the low period of 1–7 h and 24 h are 1.01 CNY/kWh, 0.99 CNY/kWh, and 0.95 CNY/kWh, respectively.
In the game between LA and users, LA provides subsidy prices and user response quantities for users to participate in IDR, as shown in Figure 7. Taking electricity as an example, the load reduction provided by users during 6–7 h and 23–24 h is relatively large, and the average subsidy price obtained during this period is USD 0.082. Between 19–21 h, the amount of load transfer provided by users is relatively small, and the average subsidy price obtained during this period is USD 0.072. The subsidy price provided by LA to users for participating in IDR increases with the increase in user response amount.

6.4. Scheduling Results

Based on the analysis of Scenario 4 in Section 6.2, the results of power scheduling optimization are shown in Figure 8. WT, CHP, garbage incineration devices, and electricity purchases are the main energy inputs. In order to absorb WT as much as possible on site, a portion of the daytime electricity demand is transferred to the nighttime. The results of heat energy scheduling optimization are shown in Figure 9, where the CHP unit provides a large amount of heat energy, and under the IDR mechanism, a portion of the heat load demand at night is transferred to the daytime period. In addition, due to the transfer of electricity load demand from daytime to nighttime, the output of CHP can be reduced, and the heat power demand can be supplied by a more efficient GB at this time. The results of natural gas scheduling optimization are shown in Figure 10. The system supplies GT and GB by burning natural gas, while P2G and CCS equipment can convert carbon dioxide into natural gas, reducing the purchase of natural gas in the system. In addition, during nighttime periods, the heat and gas loads of the system are replaced by electricity loads, making the electricity load demand curve as close as possible to the wind power curve. During the scheduling period, through the flexible cooperation of various internal equipment in the system, all wind power is consumed.

6.5. Sensitivity Analysis of Ladder-Type Carbon Trading Parameters

This section focuses on the impact of carbon trading base price and price growth rate on system operation. According to Appendix A Table A2 and Figure 11, it can be seen that as the carbon trading base price increases, the cost of carbon trading gradually increases, leading to an increase in the total system cost. At this time, the system must reduce unit output to reduce its own carbon emissions. Therefore, the system’s electricity purchase cost gradually increases, while the gas purchase cost gradually decreases. When the carbon trading base price is greater than 0.035 USD/kg, the carbon emissions level of the system also tends to stabilize, basically maintaining around 17,000 kg. According to Appendix A Table A3 and Figure 12, it can be seen that as the price growth rate increases, the carbon trading cost also increases. Therefore, the system reduces carbon emissions by increasing the purchase of electricity and IDR response while reducing the purchase of gas. When the price growth rate is greater than 0.4, the changes in equipment output and carbon emissions tend to stabilize, basically maintaining around 17,000 kg. In summary, reasonable adjustment of carbon trading base price and price growth rate can effectively control the total cost and carbon emissions of the system.

7. Conclusions

On the basis of the bilateral IDR trading mechanism, this paper establishes a multi-agent optimization scheduling model that includes IES, LA, and users. The model uses a two-level Stackelberg game to dynamically decide the IDR subsidy price. Meanwhile, a ladder-type carbon trading mechanism and low-carbon technologies such as P2G and CCS have been introduced within IES. The conclusions drawn from several case studies indicate the following:
(1) Compared with a fixed IDR subsidy price, this paper uses the Stackelberg game model to dynamically decide IDR subsidy prices, achieving significant economic benefits. Specifically, IES costs decreased by USD 152.22, while LA and user benefits increased by USD 54.61 and USD 31.85, respectively.
(2) The ladder-type carbon trading mechanism and low-carbon technology have effectively achieved low-carbon operation of the system. Specifically, after the introduction of a ladder-type carbon trading mechanism, IES carbon emissions decreased by 3345.73 kg. After adding CCS and P2G devices to conventional CHP units, carbon emissions decreased by 2732.34 kg and carbon trading costs decreased by USD 207.21.
(3) Considering the ladder-type carbon trading model, the total cost of IES increases with the increase in carbon trading base price and price growth rate, while the carbon emissions decrease with the increase in carbon trading base price and price growth rate and finally tend to a stable value. Under a certain carbon trading base price and price growth rate, a relative balance between carbon emission costs and maximum economic benefits can be achieved.
Overall, the scheduling strategy proposed in this paper can achieve higher economic benefits and provide some reference for the development of IES. This paper only considers trading between a single IES and LA. Further research can focus on energy trading between various IESs and LAs. Furthermore, this paper only considers the uncertainty of renewable energy output. In the future, load uncertainty can be included in research, and more applicable distributed robust optimization can be used to deal with uncertainty problems.

Author Contributions

H.P.: supervision, writing—reviewing and editing, data, and conceptualization; Q.W.: supervision, writing—reviewing and editing, and conceptualization; H.G.: methodology, formal analysis, software, and writing—original draft; J.B.: methodology and software. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by CHN ENERGY Investment Group Co., Ltd., grant number: (2023) 193. And The APC was funded by CHN ENERGY Investment Group Co., Ltd.

Data Availability Statement

Data will be made available on request.

Conflicts of Interest

Author Hua Pan was employed by the company CHN ENERGY Investment Group Co., LTD. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

IDRIntegrated demand response
IESIntegrated energy system
LALoad aggregator
DSODistribution system operator
UAUser aggregators
CCSCarbon capture systems
P2GPower to gas
CHPCombined heat and power
WTWind turbine
KKTKarush–Kuhn–Tucke
WSOWhite Shark Optimization
GBsGas boilers
GTGas turbine
WHBWaste heat boiler
Variables
P e , t G T Generated power via GT (kW)
P g , t G T Natural gas consumption of GT (kg)
P h , t G T Generated heat power via GT (kW)
P g , t G B Natural gas consumption of GB (kg)
P t C C S Electrical power consumption of CCS (kW)
W i , t P 2 G Carbon dioxide required by P2G (kg)
P g , t P 2 G Natural gas generated by P2G
P t P 2 G Electrical power consumption of P2G (kW);
P j , t m Translatable load (kW)
P j , t s Alternative load (kW)
P j , t f Fixed load (kW)
P t W I Generated power via garbage incineration device (kW)
P t α Energy consumption of the flue gas treatment system (kW)
P j , t c h a , P j , t d i s Power of charging and discharging energy (kW)
C I E S Operating cost of IES (USD)
C t C H P Operating cost of CCS-P2G-CHP unit (USD)
C i u t i l i t y External interaction costs (USD)
C t C O 2 ladder-type carbon trading cost (USD)
C t I D R IDR cost (USD)
c j , t I E S DR subsidy price provided by IES to LA (USD)
P j , t L A DR resources aggregated by LA (kW)
F L A Utility function of LA (USD)
C t I D R IDR subsidy cost provided by IES to LA (USD)
c j , t L A Subsidy prices provided by LA to users (USD)
P j , k , t R U DR resources provided by user (kW)
Parameters
η C H P Power generation efficiency of CHP
Q C H 4 Combustion heat value of natural gas
P max G T / P min G T Upper/lower limits of GT power generation (kW).
P min / P max Minimum/maximum power generation via CHP at time t (kW).
h 1 , h 2 Thermoelectric conversion coefficients
h m The linear supply slope of the CHP thermoelectric power
η G B Heat production efficiency
P min C C S / P max C C S Lower/upper limit of CCS power consumption (kW).
P min P 2 G / P max P 2 G Lower/upper limit of P2G power consumption (kW).
γ Energy conversion coefficient for capturing carbon dioxide consumption
α t 1 , α t 2 Flue gas flowing into the reaction tower and storage tank
e α Flue gas generated per unit of electrical energy
w α Energy consumption coefficient of the flue gas treatment system
η j , l o s s Energy loss coefficient
E j , min e / E j , max e Minimum/maximum remaining capacity (kW).
P j , max c h a / P j , max d i s Upper limit of energy power for charging/discharging (kW).
a , b , c Operating cost coefficient of the CCS-P2G-CHP coupling system
m 1 , m 2 Operating and maintenance cost coefficients of P2G and CCS
λ g , t b u y , P g , t b u y Purchase price and amount of natural gas (USD)
λ e , t b u y , P e , t b u y Purchase price and amount of electricity (USD)
W t 0 Carbon emission quota of IES
a c o 2 , b c o 2 , c c o 2 Carbon dioxide emission coefficients of CHP units, GB, and garbage incineration devices
λ Carbon trading base price
l Interval length of carbon emissions
α Price increase rate
P j , m a x L A Upper limits of the DR aggregated by LA
c j , min I E S / c j , max I E S Minimum and maximum DR subsidy prices provided by IES (USD)
P W T l d , P W T u d Maximum allowable deviation of WT
η W T l d , η W T u d Proportional deviation of WT output
Γ t Uncertainty of the model
λ W T t , π W T t + , π W T t Dual variable
π j , t l b , π j , t u b 0–1 variable
Q C H 4 Combustion heat value of natural gas
P max G T / P min G T Upper/lower limits of GT power generation (kW)
P min / P max Minimum/maximum power generation via CHP at time t (kW)
P j , max c h a / P j , max d i s Upper limit of energy power for charging/discharging (kW)
a , b , c Operating cost coefficient of the CCS-P2G-CHP coupling system

Appendix A

Proof of the existence of equilibrium solutions in games:
The two-level Stackelberg game consists of three basic elements: participant L, strategy set Ω , and utility I . In the game process, IES uses subsidy price c j , t I E S , to adjust utility function C I E S , LA uses subsidy price c j , t L A to adjust utility function F L A , and users use load response quantity P j , k , t R U to adjust utility function F R U , that is, G = L ; Ω ; I .
For hierarchical Stackelberg games, the expected results are expressed in the form of Stackelberg equilibrium (SE). When ( c j , t I E S , c j , t L A , P j , k , t R U ) satisfies the following conditions, SE can be obtained, which is as follows:
I R U ( c j , t I E S * , c j , t L A * , P j , k , t R U * ) I R U ( c j , t I E S * , , c j , t L A * , P j , k , t R U ) I L A ( c j , t I E S * , c j , t L A * , P j , k , t R U * ) I L A ( c j , t I E S * , , c j , t L A , P j , k , t R U * ) I I E S ( c j , t I E S * , c j , t L A * , P j , k , t R U * ) I I E S ( c j , t I E S , c j , t L A * , P j , k , t R U * )
where j represents the type of load, while e , h and g represent electricity, heat, and natural gas, respectively. The above equation indicates that when all participants are unable to obtain more benefits through independent strategy adjustments, the layered Stackelberg game can obtain SE.
The equilibrium of the two-level game model proposed in this paper can be divided into the following contents: Stackelberg equilibrium between LA and users and Stackelberg equilibrium between IES and LA. Before finding this equilibrium state, it is necessary to prove its existence.
Theorem A1.
In a Stackelberg game, there exists a unique Stackelberg equilibrium if the following conditions are met: (1) the strategy set of each participant is nonempty, convex, and compact; (2) after the leader’s strategy is given, there exists a unique optimal solution for all followers; (3) after the follower’s strategy is given, there exists a unique optimal solution for the leader.
Proof. 
According to the model established in Section 4, the policy set for each participant is clearly nonempty, convex, and compact.
(1) Firstly, prove the existence of a unique optimal strategy on the user side.
The first derivative of the objective function (41) with respect to P j , k , t R U is expressed as follows:
F R U P j , k , t R U = c j , t L A μ k θ k P j , k , t R U μ k v k
By making Equation (A2) equal to zero, the optimal response of the user can be obtained, i.e.,
P j , k , t R U , * = c j , t L A μ k v k μ k θ k
Secondly, the second derivative of the objective function Equation (41) with respect to P j , k , t R U is expressed as follows:
2 F R U ( P j , k , t R U ) 2 = μ k θ k < 0
Due to the negative value of Equation (A4), this means that the user’s objective function is a convex function, and the user’s response in Equation (A3) is optimal and unique.
(2) Substitute the optimal response of the user (A3) into the objective function (38) of LA to obtain the first-order derivative of c j , t L A :
F L A = t = 1 T k = 1 K c j , t I E S c j , t L A μ k v k μ k θ k t = 1 T k = 1 K c j , t L A c j , t L A μ k v k μ k θ k
F L A c j , t L A = 2 c j , t L A k = 1 K 1 μ k θ k + ( k = 1 K c j , t I E S μ k θ k + v k θ k )
By making Equation (A6) equal to zero, the optimal value of c j , t L A can be obtained, as shown in Equation (7):
c j , t L A , * = 1 2 k = 1 K ( c j , t I E S + v k μ k )
Secondly, the second derivative of the objective functions (A6) with respect to c j , t L A is expressed as follows:
2 F L A ( c j , t L A ) 2 = 2 k = 1 K 1 μ k θ k
Due to the negative values of Equation (A8), this means that the objective function Equation (45) of LA is strictly convex, and it also indicates that c j , t L A , * is optimal and unique. Substitute the value of c j , t L A , * into P j , k , t R U , * .
P j , k , t R U , * = 1 2 ( c j , t I E S + μ k v k ) / μ k v k v k / θ k
Let
1 μ k θ k = α , v k θ k = β
There is
P j , k , t R U , * = c j , t I E S 2 α 1 2 β
Substitute it into the objective function (18) of IES to obtain the first-order derivative of c j , t I E S :
min C I E S = t = 1 T C t C H P + C t u t i l i t y + C t C O 2 + 1 2 ( c j , t I E S ) 2 α 1 2 c j , t I E S β
C I E S c j , t I E S = 2 α c j , t I E S β
Secondly, the second derivative of Equation (12) with respect to c j , t I E S is expressed as follows:
2 C I E S ( c j , t I E S ) 2 = 2 α > 0
If Equation (13) is equal to 0, the optimal subsidy price for IES can be obtained as follows:
c j , t I E S , * = β 2 α = 2 v k / μ k
In summary, the two-level Stackelberg game model proposed in this has a unique equilibrium solution.
Figure A1. Solution flowchart.
Figure A1. Solution flowchart.
Energies 17 05491 g0a1
Figure A2. WT output and multivariate load curve.
Figure A2. WT output and multivariate load curve.
Energies 17 05491 g0a2
Table A1. System operating parameters.
Table A1. System operating parameters.
ParameterValueParameterValue
η G T 0.35 D ( kg/kW ) 0.425
Q C H 4 ( MJ / m 3 ) 35 a c o 2 0.55
P min G T / kW 50 b c o 2 0.65
P min G T / kW 500 c c o 2 18.20
h 1 0.15 λ 0.25
h 2 0.2 l 5
h m 0.85 α 0.25
η G B 0.9 a   ( $ / k W ) 0.013
γ 0.55 b   ( $ / k W ) 0.004
α C 02 ( T / ( M W h ) ) 0.2 c   ( $ / k W ) 0.039
η P 2 G 0.6 z 1 0.15
e α 0.96 z 2 0.2
w α 0.513 m 1   ( $ / k W ) 0.15
η e , l o s s 0.02 m 2   ( $ / k W ) 0.2
η h , l o s s 0.02 k t C   ( $ / t ) 9.8
η 0.95 r C ( t / ( M W h ) ) 0.76
E e , min E S / kW 50 μ k 0.3
E e , max E S / kW 500 θ k 0.02
P e , max c h a / kW 100 ν k 0.9
P e , max d i s / kW 100 P h , max c h a / kW 100
E h , min e / kW 50 P h , max d i s / kW 100
E h , max E S / kW 500 P max R U 150
H g ( MJ / m 3 ) 39
Table A2. System costs under different carbon trading base prices.
Table A2. System costs under different carbon trading base prices.
Carbon Trading Base PriceIES Total CostElectricity Purchase CostGas Purchase CostCarbon Trading Cost
0.13300.92317.471897.33503.47
0.153522.68363.461881.43726.78
0.23735.13473.781846.14903.66
0.253798.30488.271768.651043.01
0.34119.60557.691822.281281.18
0.354326.40579.261817.221478.59
0.404517.19584.361814.561685.03
Table A3. System costs under different carbon price growth rate.
Table A3. System costs under different carbon price growth rate.
Price Growth RateIES Total CostElectricity Purchase CostGas Purchase CostCarbon Trading Cost
0.13705.63393.831877.20886.93
0.153791.90474.071852.38941.87
0.23873.94523.421839.001002.64
0.253809.00489.641773.631045.95
0.44159.84583.291820.581322.42
0.64460.98611.811813.471647.85
0.804775.20659.721804.201945.57

References

  1. Liang, T.; Zhang, X.; Tan, J.; Jing, Y.; Lv, L. Deep reinforcement learning-based optimal scheduling of integrated energy systems for electricity, heat, and hydrogen storage. Electr. Power Syst. Res. 2024, 233, 110480. [Google Scholar] [CrossRef]
  2. Wang, C.; Chen, S.; Zhao, J.; Zhou, Y.; Wei, Z.; Zheng, S. Coordinated scheduling of integrated electricity, heat, and hydrogen systems considering energy storage in heat and hydrogen pipelines. J. Energy Storage 2024, 85, 111034. [Google Scholar] [CrossRef]
  3. Zhao, Z.; Liu, X. Flexible resource optimization allocation of park electric heating integrated energy system considering demand response. Mod. Electr. Power 2023, 1–11. [Google Scholar] [CrossRef]
  4. Mo, J.; Yan, G.; Song, N.; Yuan, M. A review of research on optimization and scheduling of electric heating integrated energy systems based on demand response. Adv. Eng. Sci. 2023, 1–16. [Google Scholar] [CrossRef]
  5. Nawaz, A.; Zhou, M.; Wu, J.; Long, C. A comprehensive review on energy management, demand response, and coordination schemes utilization in multi-microgrids network. Appl. Energy 2022, 323, 119596. [Google Scholar] [CrossRef]
  6. Zhang, J.; Liu, Z. Low carbon economic scheduling model for a park integrated energy system considering integrated demand response, ladder-type carbon trading and fine utilization of hydrogen. Energy 2024, 290, 130311. [Google Scholar] [CrossRef]
  7. Zhang, G.; Niu, Y.; Xie, T.; Zhang, K. Multi-level distributed demand response study for a multi-park integrated energy system. Energy Rep. 2023, 9, 2676–2689. [Google Scholar] [CrossRef]
  8. Zhang, M.; Yang, J.; Yu, P.; Tinajero, G.D.; Guan, Y.; Yan, Q.; Zhang, X.; Guo, H. Dual-Stackelberg game-based trading in community integrated energy system considering uncertain demand response and carbon trading. Sustain. Cities Society 2024, 101, 105088. [Google Scholar] [CrossRef]
  9. Tan, M.; Wang, L.; Jiang, C.; Liu, H.; Wu, L.; Tang, J. A Double Layer Optimization Model for Demand Response Considering the Adjustment Potential of Load Aggregators. Electr. Power 2022, 55, 32–44. [Google Scholar]
  10. Jangid, B.; Mathuria, P.; Gupta, V. A hierarchical scheduling framework for DSO and shiftable load aggregator. Electr. Power Syst. Res. 2023, 225, 109861. [Google Scholar] [CrossRef]
  11. Yan, H.; Hou, H.; Deng, M.; Si, L.; Wang, X.; Hu, E.; Zhou, R. Stackelberg game theory based model to guide users’ energy use behavior, with the consideration of flexible resources and consumer psychology, for an integrated energy system. Energy 2024, 288, 129806. [Google Scholar] [CrossRef]
  12. Zhang, H.; Yang, Y.; Zhao, X.; Xu, N.; Li, C.; Xue, W. Dual layer optimization scheduling strategy for regional integrated energy systems considering demand response. Electr. Power 2021, 54, 141–150. [Google Scholar]
  13. Li, Z.; Liu, Q.; Guo, W. Stackelberg Game Strategy Between Integrated Energy Microgrid Operators and Load Aggregators Considering Users Energy Consumption Behavior. South. Power Syst. Technol. 2022, 16, 35–46. [Google Scholar]
  14. Najafi, A.; Jasiński, M.; Leonowicz, Z. A hybrid distributed framework for optimal coordination of electric vehicle aggregators problem. Energy 2022, 249, 123674. [Google Scholar] [CrossRef]
  15. Wang, X.; Zhao, H.; Tan, Z. Optimization of dual layer master-slave game operation in comprehensive energy systems considering load aggregators. Renew. Energy Resour. 2023, 41, 1554–1562. [Google Scholar]
  16. Li, S.; Zhang, L.; Nie, L.; Wang, J. Trading strategy and benefit optimization of load aggregators in integrated energy systems considering integrated demand response: A hierarchical Stackelberg game. Energy 2022, 249, 123678. [Google Scholar] [CrossRef]
  17. Li, J.; Ai, Q.; Yin, S.; Hao, R. An aggregator-oriented hierarchical market mechanism for multi-type ancillary service provision based on the two-loop Stackelberg game. Appl. Energy 2022, 323, 119644. [Google Scholar] [CrossRef]
  18. Soepyan, F.B.; Habib, M.; Zhang, Z.; Nemetz, L.R.; Haque, M.E.; Esquino, A.M.; Rivero, J.R.; Bhattacharyya, D.; Lipscomb, G.G.; Matuszewski, M.S.; et al. Optimization of a Natural Gas Power Plant with Membrane and Solid Sorbent Carbon Capture Systems. Carbon Capture Sci. Technol. 2024, 10, 100165. [Google Scholar] [CrossRef]
  19. Park, J.; Kang, S.; Kim, S.; Kim, H.; Cho, H.S.; Lee, J.H. Enhancing the economic viability and reliability of renewables based electricity supply through Power-to-Gas-to-Power with green hydrogen. Energy Convers. Manag. 2024, 310, 118485. [Google Scholar] [CrossRef]
  20. Chen, M.; Lu, H.; Chang, X.; Liao, H. An optimization on an integrated energy system of combined heat and power, carbon capture system and power to gas by considering flexible load. Energy 2023, 273, 127203. [Google Scholar] [CrossRef]
  21. Liang, N.; He, X.; Tan, J.; Pan, Z.; Zheng, F. Stackelberg game-based optimal scheduling for multi-community integrated energy systems considering energy interaction and carbon trading. Int. J. Electr. Power Energy Syst. 2023, 153, 109360. [Google Scholar] [CrossRef]
  22. Wang, L.; Zhang, Y.; Qu, Y. Optimization and scheduling of integrated energy systems for electricity to gas and carbon cycling based on a tiered carbon trading mechanism and refinement. Mod. Electr. Power 2023, 1–9, 335–343. [Google Scholar]
  23. Chen, H.; Guo, S.; Song, X.; He, T. Design and evaluation of a municipal solid waste incineration power plant integrating with absorption heat pump. Energy 2024, 294, 131007. [Google Scholar] [CrossRef]
  24. Chen, W.; Liu, Y.; Liu, W.; Zhang, X.; Wang, X. Two stage scheduling strategy for high-speed railway stations considering temperature control load in green electricity trading scenarios. Acta Energiae Solaris Sin. 2024, 1–10. [Google Scholar] [CrossRef]
  25. Chen, Z.; Dong, Y.; Teng, M. Hybrid Generation of wind-solar-pumped storage thermal systems considering wind-solar uncertainties. China Rural Water Hydropower 2024, 08, 208–215. [Google Scholar]
  26. Li, W.; Zou, Y.; Yang, H.; Fu, X.; Li, Z. Two stage stochastic Energy scheduling for multi energy rural microgrids with irrigation systems and biomass fermentation. IEEE Trans. Smart Grid, 2024; early access. [Google Scholar]
  27. Dong, Y.; Zhang, H.; Ma, P.; Wang, C.; Zhou, X. A hybrid robust-interval optimization approach for integrated energy systems planning under uncertainties. Energy 2023, 274, 127267. [Google Scholar] [CrossRef]
  28. Zhou, K.; Fei, Z.; Rong, H. Hybrid robust decentralized optimization of emission-aware multi-energy microgrids considering multiple uncertainties. Energy 2023, 265, 126405. [Google Scholar] [CrossRef]
  29. Chen, Y.; Lu, X.; Zhang, H.; Zhao, C.; Xu, Y. Optimal configuration of integrated energy station using adaptive operation mode of combined heat and power units. Int. J. Electrical Power and Energy Systems 2023, 152, 109171. [Google Scholar] [CrossRef]
  30. Ma, B.; Yang, L.; Chen, C.; Wang, Y.; Wang, B. Collaborative optimization strategy for integrated energy systems considering demand response. Renew. Energy Resour. 2023, 41, 676–684. [Google Scholar]
  31. Wang, N.; Jin, Q.; Wang, S.; Gao, Y. A low-carbon co integration optimization model considering the combined operation of waste incineration power plants and electricity to gas conversion. Chin. J. Electr. Eng. 2023, 1–10. [Google Scholar]
  32. Zheng, W.; Xu, Z.; Shao, Z.; Li, J.; Lei, K.; Li, J. Optimal dispatch of nearly-zero carbon integrated energy system considering waste incineration plant-carbon capture system and market mechanisms. Int. J. Hydrogen Energy 2023, 48, 27013–27031. [Google Scholar] [CrossRef]
  33. Yan, N.; Li, X.; Wu, Z.; Shao, J.; Guerrero, J.M. Low-Carbon economic scheduling with Demand-Side response uncertainty in regional integrated energy system. Int. J. Electr. Power Energy Syst. 2024, 156, 109691. [Google Scholar] [CrossRef]
  34. Luo, Z.; Wang, J.; Wang, H.; Zhao, W.; Yang, L. Optimization scheduling of integrated energy systems considering carbon capture and electricity to gas conversion. Electr. Power Autom. Equip. 2023, 43, 127–134. [Google Scholar]
  35. Wu, Q.; Li, C. Economy-environment-energy benefit analysis for green hydrogen based integrated energy system operation under carbon trading with a robust optimization model. J. Energy Storage 2022, 55, 105560. [Google Scholar] [CrossRef]
  36. Yu, M.; Hong, S.H. Incentive-based demand response considering hierarchical electricity market: A Stackelberg game approach. Appl. Energy 2017, 203, 267–279. [Google Scholar] [CrossRef]
  37. Xu, Y.; Liu, H.; Sun, S.; Mi, L. Double layer optimization scheduling of multi microgrid systems considering demand response and shared energy storage. Electr. Power Autom. Equip. 2023, 43, 18–26. [Google Scholar]
  38. Zhang, Y.; Zhao, H.; Li, B.; Wang, X. Research on dynamic pricing and operation optimization strategy of integrated energy system based on Stackelberg game. Int. J. Electr. Power Energy Syst. 2022, 143, 108446. [Google Scholar] [CrossRef]
  39. Li, H.; Cui, S.; Fan, W. Low carbon economic scheduling of integrated energy systems based on improved white shark algorithm. Electr. Meas. Instrum. 2023, 6, 1–11. [Google Scholar]
  40. Xie, C.; Wang, B.; Zhao, S.; Tan, J.; Huang, J.; Xie, Z. Solving Electricity Market Equilibrium Based on Double Layer Particle Swarm Optimization Algorithm. Power Syst. Technol. 2018, 42, 1170–1177. [Google Scholar]
  41. Chen, J.; Hu, Z.; Chen, J.; Chen, Y.; Gao, M.; Lin, M. Optimization and scheduling of integrated energy systems considering stepped carbon trading and flexible supply-demand dual response. High Volt. Eng. 2021, 47, 3094–3106. [Google Scholar]
  42. Liu, W.; Yao, Q.; Wang, Y.; Chen, L.; Lu, Y. A master-slave game power planning model based on a stepped demand response mechanism for supply and demand. Autom. Electr. Power Syst. 2022, 46, 54–63. [Google Scholar]
Figure 1. IES energy flow.
Figure 1. IES energy flow.
Energies 17 05491 g001
Figure 2. IES transaction architecture considering bilateral IDR.
Figure 2. IES transaction architecture considering bilateral IDR.
Energies 17 05491 g002
Figure 3. Two-level Stackelberg game framework.
Figure 3. Two-level Stackelberg game framework.
Energies 17 05491 g003
Figure 4. Electricity purchase curve under different scenarios.
Figure 4. Electricity purchase curve under different scenarios.
Energies 17 05491 g004
Figure 5. Gas purchase curves under different scenarios.
Figure 5. Gas purchase curves under different scenarios.
Energies 17 05491 g005
Figure 6. IDR subsidy prices and load responses provided by IES.
Figure 6. IDR subsidy prices and load responses provided by IES.
Energies 17 05491 g006aEnergies 17 05491 g006b
Figure 7. IDR subsidy prices and load responses provided by LA.
Figure 7. IDR subsidy prices and load responses provided by LA.
Energies 17 05491 g007aEnergies 17 05491 g007b
Figure 8. Electricity scheduling result.
Figure 8. Electricity scheduling result.
Energies 17 05491 g008
Figure 9. Heat scheduling result.
Figure 9. Heat scheduling result.
Energies 17 05491 g009
Figure 10. Natural gas scheduling result.
Figure 10. Natural gas scheduling result.
Energies 17 05491 g010
Figure 11. Analysis of carbon trading base price.
Figure 11. Analysis of carbon trading base price.
Energies 17 05491 g011
Figure 12. Analysis of price growth rate.
Figure 12. Analysis of price growth rate.
Energies 17 05491 g012
Table 1. Comparison of IES costs and LA and user benefits in different scenarios.
Table 1. Comparison of IES costs and LA and user benefits in different scenarios.
ScenarioTotal
Cost/USD
CHP Cost/USDElectricity Purchase Cost/USDGas Purchase Cost/USDCarbon Trading
Cost/USD
Carbon
Emissions/kg
IDR
Cost/USD
LA Benefits/USDUser Benefits/USD
14118.9128.17500.581863.281278.3020,558.56448.57219.9982.45
24174.5466.26274.751910.74-21,171.95424.10204.2577.32
33950.5221.87541.111861.641087.1117,857.54438.78168.7459.50
43798.3022.70488.271768.651043.0117,826.22475.68223.3591.35
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Pan, H.; Wu, Q.; Guo, H.; Bai, J. Low-Carbon Optimization Scheduling of Integrated Energy Systems Based on Bilateral Demand Response and Two-Level Stackelberg Game. Energies 2024, 17, 5491. https://doi.org/10.3390/en17215491

AMA Style

Pan H, Wu Q, Guo H, Bai J. Low-Carbon Optimization Scheduling of Integrated Energy Systems Based on Bilateral Demand Response and Two-Level Stackelberg Game. Energies. 2024; 17(21):5491. https://doi.org/10.3390/en17215491

Chicago/Turabian Style

Pan, Hua, Qunli Wu, Huiling Guo, and Jiayi Bai. 2024. "Low-Carbon Optimization Scheduling of Integrated Energy Systems Based on Bilateral Demand Response and Two-Level Stackelberg Game" Energies 17, no. 21: 5491. https://doi.org/10.3390/en17215491

APA Style

Pan, H., Wu, Q., Guo, H., & Bai, J. (2024). Low-Carbon Optimization Scheduling of Integrated Energy Systems Based on Bilateral Demand Response and Two-Level Stackelberg Game. Energies, 17(21), 5491. https://doi.org/10.3390/en17215491

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop