1. Introduction
A microgrid (MG) is a networked power system composed of various inverter-based distributed energy resources (DER), an energy storage system (ESS), and the load [
1]. With the increase in DER, MG systems have become increasingly complex, in terms of overall operation and control [
2]. As interactions between the power generation source, load, and power network of the MG system occur frequently, stably controlling various DERs, as well as economical operation plans, are key issues [
3,
4,
5]. MG systems generally contain both dispatchable and non-dispatchable agents. Thus, economic dispatch (ED) is used to perform optimal management for controlling the power output of all DERs. In a distributed control strategy used to resolve the economic dispatch problem (EDP), all devices are involved in solving the generation cost optimization, reducing the computational burden on the controller, and improving the reliability of the control system. Since each device exchanges information through communication with neighboring devices, a plug-and-play function is possible, which has easy scalability. An intelligent MG system can be used to efficiently solve the optimization problem through a distributed communication network [
6]. A multiagent system (MAS) strategy is usually adopted for the integrated operation of various distributed power sources. MAS performs information exchange through peer-to-peer (P2P) communication, by regarding each distributed generation source as an agent [
7,
8,
9].
Recently, various distributed optimization strategies have been proposed to resolve the EDP in a MG system. A distributed consensus and innovation framework strategy for the EDP of power systems is proposed in [
10]. In [
11,
12,
13,
14], a distributed incremental cost consensus (ICC) algorithm was proposed, based on the Lagrange multiplier method, which is mainly used for centralized systems. The incremental cost value of the quadratic cost function was computed according to the output power of each DER. The consensus algorithm converges variables to the same point through iterative computations based on a communication network with neighboring agents. A performance verification of the ICC algorithm was performed with various communication topologies in [
15,
16,
17,
18]. The convergence rate of the consensus algorithm was determined by the communication network and the number of agents, and this affects the control performance of the MG system. The diffusion strategy was adopted to improve the convergence speed of the distributed optimization algorithm [
19,
20,
21]. The diffusion algorithm is an effective strategy for solving the deterministic optimization, by considering a set of interacting agent networks [
22]. These strategies typically require a load prediction technique to satisfy power balancing constraints and optimize operations in load uncertainty. The load prediction step requires an additional control layer, with increasing complexity and additional cost for the MG system. In [
23], a two-step diffusion strategy was proposed, to determine the total load of the MG system, and solve the EDP optimization. A distributed control strategy, including an economic dispatch algorithm and frequency deviation optimization, was proposed to avoid the load prediction step in [
24]. These studies only focused on the EDP optimization and frequency regulation, while the distributed communication failure of the MG system was not considered.
The optimal operation of the distributed system is affected by to the stability of the secondary communication system between agents. When a communication system fails, the information exchanged with other agents becomes corrupted and the optimal operation to address EDP fails. Thus, it is important to handle failures in the communication link by ensuring that a reliable bidirectional flow of data is transmitted to the secondary controller of each agent. Recently, various papers on cyber-attacks and line failures in communication systems have been proposed for distributed control systems [
25,
26,
27,
28,
29]. In [
25], the effect of communication failure on a distributed control system was analyzed and a MG modeling architecture was proposed to improve the system stability during communication degradation. In [
26], a distributed robust ED method was proposed, to solve energy management. This paper implemented a fully distributed system that was robust against various collusive and non-collusive attacks. The impact of various types of cyber-attack on communication auxiliary controllers with potential vulnerabilities was analyzed, and a framework for ensuring system stability when a communication link was subjected to such attacks was proposed in [
27]. An event-based distributed consensus frequency control strategy for inverter-interfaced distributed generators under a harsh communication system was proposed in [
28]. The paper integrated event-based data and communication topology update mechanisms to improve the adaptability of control strategies in unreliable system conditions. In [
29], a resilient distributed control strategy was proposed that allows each participant in a distributed control system to detect and isolate compromised links and controllers. These control strategies were designed to satisfy the operational goal, by isolating the line in which the communication error is detected. When an error occurs in the communication module of a single agent, the communication lines with the neighboring agent are isolated. However, an agent isolated due to a communication failure can no longer exchange information with other agents, which adversely affects the optimal operating solution of the MG system operation. Thus, the isolation strategy of the agent whose communication failure is detected has limitations, in terms of optimizing the generation cost.
To overcome these limitations, this paper proposes a multiagent-based distributed optimization strategy, including compensation for frequency deviation according to the incremental cost. Since the total demand power and the output of all agents are correlated with the system frequency, it is possible to estimate the output power required for an isolated agent [
30]. Thus, this paper performs the re-optimization process by deriving the incremental cost using the frequency deviation, as much as the output of the isolated agent. Compared to the conventional strategy, the proposed strategy consistently maintains the economic operation and demand load balance of the MG system, even in the event of a communication failure. The simulation results for verifying the controller performance when considering the proposed communication failure were compared with the conventional consensus-based distributed optimization strategy. Furthermore, real-time experimental results were obtained on a hardware-in-the-loop (HIL) test platform, where the MAS communication network system was implemented. The main contributions of this study are listed as follows:
- ▪
A multiagent-based distributed control strategy is proposed to optimally manage the MG system, even with communication failure;
- ▪
The proposed strategy does not require a load forecasting model to optimize the microgrid operation, due to the involvement of a secondary frequency regulator in the optimization process;
- ▪
A controller hardware-in-the-loop simulation platform was developed to validate the operating performance of the proposed multiagent control system.
The rest of this paper is organized as follows:
Section 2 represents the hierarchical control structure of the proposed strategy, including the incremental cost diffusion algorithm. The proposed distributed multiagent system based on the diffusion algorithm is described in
Section 3. The simulation results and comparison results are provided in
Section 4. The experiment of the distributed communication system is presented in
Section 5. Finally, the main conclusion of this study is summarized in
Section 6.
3. Proposed Distributed Control Strategy
In this paper, the DER of the MG system has five agents, composed of three DGs and two ESSs. Each agent device is implemented as an inverter-based power source, to improve control performance. The overall control diagram of the distributed generation agent based on the hierarchical control scheme is shown in
Figure 3. The control system is implemented as a separate module of the primary controller and the secondary controller. A droop controller is applied at the primary control layer, for power sharing between DGs. In the secondary controller, a diffusion-based distributed controller is implemented for economic optimization and incremental cost-based frequency regulation, considering a communication failure.
Figure 4 presents the information-sharing flow chart of the proposed secondary control layer in this study. In the first step, each agent receives information from its neighbors to update the number of agents and weight matrix. In the second step, the demand net power (
) is computed by the diffusion algorithm, and the incremental cost (
λi) of each agent is computed based on the current output. Diffusion-based distributed cost optimization is performed to maintain the rated frequency in the third step. Through the rated frequency compensation process, demand net power and output are matched, without additional load forecasting. The communication connection status with the neighbors is checked in the fourth step. When a communication line failure is detected, a re-optimization process, including an incremental cost adjustment term considering frequency deviation, is performed for continuous cost optimization. In the fifth step, the power reference (
) is determined based on the converged incremental cost and sent to the primary controller. Finally, the output power of the agent is measured and sent to the adjacent agents.
3.1. Primary Control
The primary controller is responsible for the power demand balance and maintenance of power quality in islanded operations. In this study, a voltage control mode (VCM) based converter was used to generate voltage by itself. The inner current and voltage control loop of the VCM converter are shown in
Figure 5b. A proportional-integral (PI) regulator is utilized to adjust the current and voltage of the converter. The current control loop is based on the decoupling of the
dq-reference frame, as given by (7) and (8).
where
and
are the output voltage reference;
and
are PI coefficients of the inner controller of
d axes;
and
are PI coefficients of the inner controller of
q axes; and
and
are the current reference of the measured currents
and
of
d and
q axes.
The outer controller is based on a droop control scheme for power sharing among multiagent systems, as shown in
Figure 5a. The droop controller calculates a reference value for angular frequency and deviation of the amplitude voltage of the inner controller, as given by (9) and (10). The system angular frequency is correlated with the active power, and the difference of the system voltage amplitude is affected by the reactive power.
where
ω and
are the angular frequency and deviation of amplitude voltage, respectively;
and
are the droop control coefficients;
and
are the deviation of active power and reactive power reference, respectively; and
P and
Q are the measurements. The deviation of power reference value for the power controller is received from the secondary control layer.
3.2. Proposed Diffusion-Based Distributed Secondary Control
The diffusion algorithm is applied for a fast convergence speed in the distributed control system. The operating cost of the MG system can be minimized if the incremental cost of all agents converges to the same value. Thus, the purpose of the diffusion algorithm is to implement an updated rule, which converges the shared information state of all agents to the same value. The agent can be considered one of the nodes in the communication network system that performs updates through the exchange of local information with adjacent nodes. Graph theory was used to describe the communication network of the diffusion-based distributed secondary controller. The communication topology can be represented as an undirected graph
with the set of nodes
and the set of edges
ε N2, in which
n represents the number of agents and the edges set
represents the communication network established between these agents. The adjacency matrix for an undirected graph
G is denoted by
, as given by (11).
The Laplacian matrix
, which is a matrix form of an undirected graph
G, is given by (12).
The diffusion strategy proceeds in two steps, which are information sharing and cost optimization, as shown in Algorithm 1. The first step is to calculate the total demand load of the MG system, based on the shared information between the neighboring agents. The diffusion algorithm derives the average power demand, which can calculate the total net power demand. The second step is to compute the reference power of the agent, to minimize the generation cost based on the diffusion algorithm. In this step, if a communication failure is detected, the frequency control coefficient according to the incremental cost is adjusted to maintain economic operation. Finally, the outputs of all agents are updated to the demanded net power, which is obtained in step 1.
The global dynamic combine-then-adapt (CTA) diffusion method is applied to local information sharing, to achieve an agreement on the demand load required for the MG system from dispatchable agents, as given by (13).
where
is the intermediate variable for
i at time
k; X
k= [
x1,k;
x2,k; …;
xN,k;] is the state of agent unit
i at time
k;
μ denotes the non-negative update parameter of each agent;
is constant edge weight; and
is the stochastic gradient of variable
for unit
i of the intermediate value at time
k.
The stochastic gradient of a diffusion strategy is simply computed as the difference between one iteration and another. Thus, the agent tracks the gradient and periodically updates the combination of its neighbor agents. The CTA diffusion was applied to the optimization of distributed operation, by adopting the gradient term of the agent incremental cost, as given by (14).
where λ[
k] = [λ
1[
k]; λ
2[
k]; …; λ
N−1[
k]; λ
N[
k]] are the incremental costs of agent unit
i at time
k;
ηc is the frequency coefficient; Δ
f is the deviation of system frequency.
If the Laplacian matrix
lii has a value of 0, this means that the agent is isolated from the communication network. Since the agent cannot receive information from other agents, the incremental cost cannot fully converge. Thus, the agent that detects a communication failure adjusts the frequency coefficient to reach the average incremental cost of the other agents. The frequency coefficient of an isolated agent is proportional to its incremental cost of per unit (PU), as given by (15) and (16).
where
λiPU is the incremental cost per unit of generation.
Algorithm 1: Proposed diffusion Strategy for Secondary Controller |
![Energies 15 03736 i001]() |
As a results, the proposed secondary controller regulates the frequency, while maintaining optimal operation during the communication failure. The optimal power references of DG and ESS agents are determined by the converged incremental cost value, as given by (17) and (18).
where
[
k + 1] and
[
k + 1] are the distributed output references of
DG and
ESS agents, respectively.
The power reference of the secondary controller based on the diffusion algorithm is sent to the droop controller of the primary control layer of each agent.
4. Simulation Results
In this study, the tested five-node MG system depicted in
Figure 6 was implemented in the MATLAB/Simulink environment. The distributed MAS consists of two ESS, three DGs, and three load agents. Detailed system parameters are shown in
Table 1. The converter parameters, including the sampling time of control layer, are shown in
Table 2. The cost parameters for the agent type corresponding to (1) and (4) are shown in
Table 3. The five agents are connected in the form of a ring communication topology, as shown in
Figure 7a. In this study, two case studies are conducted to demonstrate the effectiveness of the proposed strategy during communication failure. The first case considers the isolation of
DG3 due to communication failure, as shown in
Figure 7b. In this case, the communication lines between
ESS1-
DG3 and
DG2-
DG3 are disconnected at
t = 15 s and
t = 25 s, respectively. The second case considers the isolation of
ESS1 due to communication failure, as shown in
Figure 7c. In this case, the communication lines between
ESS1-
ESS2 and
ESS1-
DG3 are disconnected at
t = 15 s and
t = 25 s, respectively. It is assumed that the initial loads (
Load1 and
Load2) are a total of 5kW and an additional load (
Load3) of 4 kW is inserted into the MG system at
t = 35 s.
4.1. Case 1: DG3 Agent Isolation According to a Communication Failure
In this case, the communication lines between
ESS1-
DG3 and
DG2-
DG3 are disconnected at 15 s and 25 s due to communication failure. The incremental cost of each agent is shown in
Figure 8. As the communication line between
ESS1-
DG3 is isolated at 15 s, the communication system is converted from a ring topology to a line topology, and the re-optimization process is performed. The conventional strategy takes about 7 s for the incremental cost to converge, whereas the proposed strategy takes about 4 s. The communication line between
DG2-
DG3 fails and
DG3 is isolated at 25 s. As
DG3 is an isolated state due to the communication failure, it cannot exchange information between agents. In the conventional consensus strategy in [
26], the secondary controller of the isolated agent is deactivated and the droop controller operates. Thus, the incremental cost does not converge, as shown in
Figure 8a. However, the proposed diffusion strategy responds to the communication failures through a frequency regulation process based on the incremental cost information. The incremental cost of all agents converges even if
DG3 is isolated at 25 s, as shown in
Figure 8b. The load inserted at 35 s results in a transient output power. The incremental costs always converge to maintain optimal operation.
Figure 9 shows the outputs of all agents. The steady-state output of each agent is consistent with the Lagrange multiplier method. The proposed strategy determines the generation power reference and satisfies the demand load balance by sending it to each agent.
4.2. Case 2: ESS1 Agent Isolation According to the Communication Failure
In this case, the communication lines between
ESS1-
ESS2 and
ESS1-
DG3 are disconnected at 15 s and 25 s, due to communication failure. The incremental cost of each agent is shown in
Figure 10. As the communication line between
ESS1-
ESS2 is isolated at 15 s, the re-optimization process is performed to maintain optimal operation. Since the weight matrix is adjusted according to the communication connection state, the incremental cost of both control schemes converges. The communication line between
ESS1-
DG3 fails, and
ESS1 is isolated at 25 s. In the case of the conventional consensus strategy, the incremental cost convergence point of the remaining agents increases, as the
ESS1 with a low incremental cost is isolated, as shown in
Figure 10a. Thus, the incremental cost of the agents does not converge, and optimal operation fails. On the other hand, the proposed diffusion strategy maintains optimal operation by deriving the incremental cost of the isolated agent through a frequency-based error adjustment process. Even if
ESS1 is disconnected from the system due to a communication line failure, the incremental costs of all agents always converge, as shown in
Figure 10b. As the additional load of 4 kW is inserted at 35 s, the incremental cost variance of the conventional consensus strategy increases. The proposed diffusion strategy always converges the incremental costs between agents, even when the load increases during communication failure. It can be seen that the distributed system maintains cost optimization.
The converged incremental cost affects the response of the outputs, as shown in
Figure 11. The proposed control strategy has a fast response to the generation power of the agent, due to a fast convergence speed, and can respond immediately to communication failures or load changes.
5. Experimental Results
To demonstrate the feasibility of the proposed diffusion strategy, the hardware-in-the-loop (HIL) test platform for a multiagent system was implemented using the real-time simulator OPAL-RT, as shown in
Figure 12.
The tested microgrid system was implemented using RT-Lab on the host computer, then it was compiled and run in the real-time simulator OP5600. Five computers were utilized as distributed controllers of the secondary layer, and the communication topology consisted of a line connection, as shown in
Figure 13. These agents used a Modbus-based Ethernet hub to communicate with the OP5600 and control PC. The diffusion-based distributed controllers received the measured active power and battery DOD information from the real-time simulator. An optimal control operation that minimized the generation cost was performed, and the power reference was sent to the real-time simulator. The communication line disconnection between agents was implemented using a port switch in the Ethernet hub. The total test time was 240 s, and one interval was assumed to be 10 s. The unit on the x-axis was the number of hours in a day, with 24 intervals.
A communication failure between
DG2 and
DG3 occurred for 15 intervals, from interval 6 to 21. According to the communication failure, the
DG3 was isolated from the communication network system.
Figure 14 presents the incremental cost of each agent. The conventional consensus strategy has limitations in obtaining information from an isolated agent, so the incremental costs could not converge during communication failure, as shown in
Figure 14a. Thus, there was a problem in optimizing distributed operation. However, the proposed diffusion strategy always converged the incremental cost, as shown in
Figure 14b.
Figure 15 shows the agent output power according to the converged incremental cost information. The proposed strategy sent the generation power reference to each agent.
The frequencies under the conventional and proposed diffusion strategy are shown in
Figure 16. In the case of the conventional consensus strategy, the system frequency dropped below the nominal frequency as the load changed. This means that there was a mismatch between the system demand power and the agent supply power. However, the proposed strategy could maintain the frequency at the nominal value, without a load forecasting step in the event of load change or communication line failure.
The comparison results of the cost optimization were compared to the conventional strategy, as shown in
Figure 17. The proposed strategy maintained optimal operations during the communication failure.
Table 4 shows the aggregated generation costs over 24-intervals for both control systems. The total operating costs of the conventional control strategy and the proposed control strategy were 1558.4 and 1532.5 dollars, respectively, and a cost reduction effect of about 1.69% was verified.
6. Conclusions
This paper proposed a distributed control strategy for a MG system. The proposed strategy performs frequency regulation and economic dispatch. The frequency coefficient is regulated based on the incremental cost rate. Thus, the proposed controller can maintain economic operation during a communication failure. The proposed strategy was simulated in two test scenarios and compared with the conventional strategy. It could minimize the generation cost, while maintaining the power balance and system frequency. A controller hardware-in-the-loop simulation was developed to validate the feasibility of the proposed diffusion strategy for practical applications. The real-time simulation results showed the superior operating performance of the proposed control strategy, in terms of cost optimization under a communication failure. Two limitations were identified in the proposed strategy. First, the number of agents separated due to communication line failure is limited. Incremental cost convergence fails, due to an error in the frequency deviation based on the number of isolated agents. Therefore, an additional compensation process for incremental cost is required, by grouping agents according to the communication connection state. The second limitation appears when communication lines are subjected to cyberattacks. Depending on the scale and type of cyber-attack, information exchanged between agents may be inaccurate or lost. In these cyber-attacks, all secondary controllers for optimal operation are disabled, and control is performed using only the primary droop controller. In the future, we will aim to overcome the two limitations of this paper.