1. Introduction
In recent years, with the continuous increase in air traffic flow, the contradiction between limited airspace resources and growing shipping demand has become increasingly prominent. The congested airspace leads to an increased possibility of flight conflicts, and flight conflicts are an essential cause of flight accidents. Therefore, effectively avoiding flight conflicts, especially in a complex environment with crowded airspace and a large number of potential flight conflicts, provides controllers with effective and feasible conflict resolution solutions, which has become an urgent problem to be solved.
At present, common conflict resolution methods include: the geometric method, artificial potential field method, swarm intelligence algorithm, optimal control method, game theory, complex network method, etc. Durand et al. apply the velocity obstacle method in the field of robot obstacle avoidance to the study of aircraft collision avoidance, and derives an optimal obstacle avoidance strategy for two-aircraft conflict resolution at the same altitude level [
1]. Zhang et al. derive a collaborative aircraft conflict resolution scheme in air crash rescue [
2]. Wu et al. build a geometric optimization model to solve the flight conflicts at the same altitude level [
3]. Fan et al. apply the artificial potential field method to plan the optimal path of an underwater vehicle, and the underwater vehicle can avoid obstacles according to its own state and the movement of obstacles [
4]. Tomlin et al. applied the artificial potential field method to the field of flight conflict resolution, but it requires the aircraft to maneuver continuously at a large angle, which will result in an “unrealistic” solution [
5]. Based on ADS-B surveillance data, Tang et al. propose an airborne UAV conflict detection and deconfliction method based on a linear extrapolation method to provide early warning for possible conflicts [
6]. Cai et al. resolved the flight conflict by adjusting the aircraft speed and altitude, and transformed the conflict resolution problem into a non-linear programming problem [
7]. Hong et al. introduce flow measurement constraints and conflict separation constraints into the objective function together, and use the particle swarm algorithm to solve the problem, which not only achieves conflict resolution, but also conducts flow management [
8]. For the conflict resolution problem of several aircraft under fixed airway, Han et al. propose a flight strategy to change the heading and compare the optimal conflict resolution model under free flight and fixed airway [
9]. Based on an optimized static single heading angle or ground speed adjustment strategy, Tang et al. propose an optimized dynamic hybrid conflict resolution strategy based on backward horizon control that takes into account the possibility of single aircraft ground speed variation [
10]. Xiang et al. derive four-dimensional flight prediction by building a flight performance prediction model, extracting flight plan data, and calculating the time for an aircraft to pass a specified waypoint [
11].
The advantage of game theory is that it can balance the resource allocation of the solution [
12]. In the study of applying game theory to solve the flight conflict resolution problem, Tomlin et al. and Teo et al. combine game theory to deconflict a two-aircraft flight conflict [
13,
14]. Archibald et al. established a conflict resolution model based on satisfactory game theory, and resolved multi-aircraft conflicts at the same altitude by adjusting the heading [
15]. Based on conditional probability, Guan et al. establish a “social relationship” for aircraft, and the release decision of each aircraft will be affected by the priority, which controls the economic cost while ensuring flight safety [
16]. Kim et al. [
17] proposed a cooperative collision avoidance method for UAVs based on satisfaction game theory, in which UAVs coordinately resolve conflicts by adjusting the heading after weighing the overall and individual satisfaction levels. Chen et al. studied the collision avoidance performance of a multi-aircraft scenario and innovatively proposed a cooperative optimization method for a collision avoidance system based on aircraft state prediction [
18]. Sislak et al. propose two collaborative conflict resolution methods, an iterative peer-to-peer algorithm and multi-party algorithm, and the aircraft needs to make maneuver decisions in combination with the flight plan [
19]. Jiang et al. proposed a cooperative game-based flight conflict resolution model, which uses the alliance utility function to balance the interests of the participants, and this model improves the fairness of understanding while ensuring the overall benefits of the alliance [
20]. Sun et al. obtain the optimal flight conflict resolution scheme by determining the benefits balance point when the alliance benefits are maximized [
21].
Complex network theory has the advantages of macroscopic and small world theory [
22]. In recent years, complex network theory has been used in the study of some complex problems in the aviation field, such as airspace complexity analysis [
23,
24], key node identification [
25,
26], macro conflict deployment [
27], optimization of air traffic systems [
28], flight situation forecast [
29], and flight conflict detection [
30]. In the area of conflict resolution, Zhang et al. help improve air traffic safety by coordinating route conflicts for specific areas and times of the day based on the route network [
31]. Chen et al. established a network structure for automatic conflict detection and resolution based on the air transportation system [
32]. Huang et al. applied complex network theory to UAV conflict resolution. After screening key UAV nodes, it resolved conflicts toward least robustness [
33]. Wan et al. propose a UAV conflict resolution algorithm based on key node selection and policy coordination, which coordinates the UAV’s strategy combination according to the principle of maximum robustness [
34].
Some studies [
1,
2,
3,
4,
5,
6,
7,
8,
9,
10,
11] focus on the research status of geometric methods, artificial potential field methods, swarm intelligence methods, and optimal control methods. The geometric method is the most widely used. In [
1,
2,
3], authors use the geometric method to predict the trajectory through linear derivation and keep the aircraft at a safe distance. When the number of flight conflicts is small, it has a good relief effect, but in the multi-aircraft conflict scenario, it is difficult to obtain the optimal conflict resolution strategy. From [
4,
5], we can see that the artificial potential field method has the advantages of short response time and adaptability to complex environments, but it requires the aircraft to maneuver continuously at a large angle, which will result in an “unrealistic” solution. In [
6,
7,
8], the heuristic algorithm improves the accuracy of the escape strategy. However, due to the large solution space, the computation time for applying the heuristic algorithm to deconflict the flight is often long. In [
9,
10,
11], the optimal control method is used to resolve flight conflicts on the flight path route, but the resolution time will increase with the extension of the flight path.
The studies [
12,
13,
14,
15,
16,
17,
18,
19,
20,
21] are the studies related to the application of game theory to deconfliction of flight conflicts. Initially, it was used in the study of two-aircraft conflict resolution [
13,
14]. In recent years, game theory has been gradually applied to the study of multi-aircraft conflict resolution. Research on the application of game theory to multi-aircraft conflict resolution can be broadly divided into two categories: satisfactory game theory and cooperative game theory. From [
15,
16,
17], we can see that the main idea of satisfaction game theory is that decision makers gradually form their own maneuvering preferences based on other aircraft preferences, which improves the ability of aircraft to collaboratively resolve flight conflicts. However, planes often have to pay attention to the impact of all other aircraft actions before maneuvering, which prolongs the aircraft’s decision-making time. Compared with satisfaction game theory, cooperative game theory pays more attention to the benefits balance between alliance welfare and individual interests. In [
18,
19,
20,
21], the authors use cooperative games to solve the multi-machine conflict problem. Applying game theory to the study of flight conflict relief optimizes the resource allocation of relief strategies and improves the fairness of understanding. However, these methods often have a problem: in resolving conflicts, they only focus on a few aircraft in conflict. They do not consider the overall situation, possibly leading to secondary flight conflicts.
Some studies [
22,
23,
24,
25,
26,
27,
28,
29,
30,
31,
32,
33,
34] describe the research content and status of research on complex networks in the field of aviation. From the analysis of the above literature, it is clear that complex network theory has a macroscopic nature, and it can find a suitable solution from the entire network when dealing with the problem of flight conflict resolution. Undirected complex networks are macroscopic and symmetric, and flight conflicts are generated by two aircraft in pairs. In dealing with multiple aircraft conflicts, it can consider the overall situation, extract the network topology index to reflect the overall relief effect of multiple aircraft conflicts, and abstract the aircraft without flight conflicts in the airspace as isolated nodes, so as to avoid the secondary conflict between the isolated aircraft nodes and the aircraft with conflicts. In the study of flight conflict resolution, the following areas can be improved: (1) the dimension of conflict resolution is limited to the two-dimensional horizontal plane, and it is difficult to resolve flight conflicts at different altitudes effectively. (2) Neglecting the influence of aircraft without flight conflicts or potential flight conflicts on conflict resolution in the airspace, which is likely to cause secondary conflicts. (3) There is the problem of unfair individual cost in the process of liberation. In this way, although the search time of the algorithm is shortened, a feasible solution is often obtained rather than an optimal fair solution.
In view of the above problems, this paper combines the advantages of complex network theory and game theory. It proposes a multi-machine conflict resolution model based on cooperative games to obtain a conflict resolution solution that combines three-dimensional conflict resolution capabilities and individual fairness. In the first part of this paper, we establish a flight conflict network model, which is an undirected symmetric network, and it can reflect the number and urgency of flight conflicts in the airspace through the network edge and edge weight. In the second part, we establish a cooperative game conflict resolution model and extract a comprehensive network index that can evaluate the conflict resolution scheme’s overall effect in the network to reflect the alliance’s overall welfare. Then, based on the concept of “nucleolar solution”, we propose the alliance cost function to balance the benefits of the network alliance and each participant and demonstrate it. In the third part, we put forward three conflict resolution methods of heading, speed, and compounding, combined with the NSGA-II algorithm to specify the conflict resolution process and shorten the calculation time by injecting the initial value of the resolution into the initial population. In the fourth part, we conduct simulation experiments to compare the release effects of the three release methods and verify the algorithm’s timeliness and the release strategy’s fairness.
2. Flight Conflict Network Model
The flight conflict network refers to an undirected weighted graph composed of aircraft as nodes and the conflict relationship between aircraft pairs as edges. stands for the set of nodes in the network, and the nodes correspond one-to-one with the aircraft in the airspace. is a collection of network edges, edge weights reflect the urgency of flight conflicts or potential conflicts in the flight conflict network.
2.1. Determine Network Edges
In the traditional aircraft state network model [
23], the innermost airspace wrapped around the aircraft is a cylindrical flight protection zone. However, due to the limitation of numerical calculation of the cylindrical flight protection zone, the conflict relationship between aircraft pairs is often determined based on the positional relationship at the same altitude, and the method for judging this conflict relationship is limited. As shown in
Figure 1, three aircraft are flying in airspace with different courses. When their positions are the same, the position-based aircraft state network cannot distinguish the convergence situation in
Figure 1a and the separation situation in
Figure 1b. However, the threats to flight safety from these two situations are quite different, resulting in the unnecessary allocation of controller energy. Therefore, we adopt an ellipsoid-shaped flight protection zone (in
Figure 2), which is more practical and easier for collision detection, to overcome the non-steerable feature of the plane junction of the cylinder. To comply with the ATC standard, we define the long focal length of the ellipsoid as
and the short focal length as
[
35].
In order to further reflect the conflict relationship between aircraft in the airspace, we derive the three-dimensional speed obstacle method to determine potential flight conflicts. Then, we build a flight conflict network based on the conflict relationship between the aircraft. In the flight conflict network, heading and speed are also important factors for forming the network edge. When a pair of aircraft nodes in the network form a conflict relationship, the two nodes form an edge.
The speed obstacle method essentially divides the speed space between two aircraft into a collision area and a non-collision area. When the relative speed falls into the collision area, it is regarded as a conflict or potential conflict between the two aircraft [
36]. This idea is simple and easy to implement. In the following, we introduce the principle of the two-dimensional velocity obstacle model and then build a conflict detection model based on the three-dimensional velocity obstacle method. This method detects the flight conflict between nodes in the flight conflict network and builds the network edge.
Figure 3 shows the principle of the two-dimensional conflict detection model based on the speed obstacle method. Aircrafts
and
are flying at the same altitude, and the speeds are
and
, respectively, and the speed of
relative to
is
. Since the two planes are at the same level, the section of the flight protection area of
at this level is
with point
as the center and
as the radius.
According to the description of the velocity obstacle method above, we can know that there exists a collision cone between two aircraft, and a potential flight conflict occurs when the relative velocity falls in this region. When the initial attitude information of two aircraft is certain, the range of relative velocities that will lead to flight conflict is also determined. In this paper, we define the set of relative velocities that would lead to an aircraft collision as the relative collision cone, and denote it as
. The
in
Figure 3 is the area surrounded by vertex
and the tangents between
and
. When there is an intersection of the extension cord of the relative speed
and
, it is considered that there is a conflict between two aircraft on the same level.
The above detection method can only detect potential flight conflicts at the same altitude, and it is difficult to judge the conflict relationship between aircraft pairs at different altitudes. Therefore, we combine the ellipsoid flight protection zone and the speed obstacle method to build a three-dimensional conflict detection model. The specific steps are as follows.
The ellipsoid flight protection area around the aircraft is denoted as
:
is the coordinates of the target aircraft at the center of the ellipsoid, is the coordinates of the potential conflict aircraft.
As shown in
Figure 4, nodes
and
are flying forward at speeds
and
, respectively. In the speed obstacle model, the conflict is only related to the aircraft’s relative position and current flight status. Taking
as the reference point,
makes relative motion, and the relative speed is
, and
is the extension line of the direction vector
.
is the set of relative velocities at which collisions occur.
In
Figure 4, it is evident that when
,
and
have 2 intersection points. If the extension line
of
is combined with the ellipsoid surface equation, the intersection point of
and the ellipsoid satisfies the following equation system:
The 2 equations in Equation System (3) are in the same coordinate system, which has
as the origin point, and
is the coordinate of
.
are the components of the direction vector of
on the
,
,
axes.
Let
be the number of intersections between
and
, let
be the edge connection discriminant of nodes
and
.
where,
,
,
are the coefficients of
,
, and
in the polynomial Equation (4), respectively.
Therefore, we can make the following judgments: when , , , the relative speed leaves the relative collision cone; when , , the relative speed does not leave the relative collision cone.
However, there is a problem: when , the relative speed deviating from is also considered to have a conflict risk, and it is necessary to make a supplementary judgment based on Equation (5).
Figure 5 shows the top view of the conflict detection model (in
Figure 4).
is the projection of the line between nodes
and
on the horizontal plane
.
is a circle with
as the center and
as the radius.
and
are the included angles between
and the tangent and
, respectively, then when
, the relative speed
will not deviate from
.
Where
and
are given by:
is the horizontal distance between nodes
and
.
Through the above analysis, for the flight conflict network, the following judgment can be made: when the two conditions of and are satisfied at the same time, the relative speed will fall within , and there is a risk of conflict between nodes and . At this time, , and nodes and form a connecting edge. Otherwise, , there is no conflict risk between nodes and , and no connecting edge is formed.
2.2. Determine the Edge Weight
The edge weight of network nodes is an indicator used to indicate whether the relationship between nodes at both ends of the edge is vital. In the flight conflict network, the edge weight needs to reflect the urgency of the conflict between the aircraft nodes, and the estimated conflict time can intuitively reflect the intensity of the conflict urgency. When the estimated conflict time is shorter, the conflict urgency is stronger, and this relationship is non-linear. This paper defines the edge weight of a node as:
is the estimated conflict time, which is measured in minutes, and is the edge weight between nodes and .
It can be seen from Equation (8) that the value range of
is
.
has the opposite trend to
, when
is smaller,
is larger; when there is no edge between nodes
and
,
; when a flight conflict has occurred between nodes
and
,
. This is assuming that the flight protection zone for all aircraft is the ellipsoidal protection zone in
Figure 2, and that
and
. Since the flight conflict network is undirected, it can be obtained that
.
Figure 6 shows the positional relationship and conflict relationship of six aircraft in the flight conflict network at the same altitude and within a 30 km × 30 km airspace. In the flight conflict network, the horizontal safety interval is the long radius of the ellipsoidal flight protection zone of 9.26 km. As shown in
Figure 6, we can see that the interval between nodes 2 and 6 is less than the horizontal safety interval, and a flight conflict has occurred. There is a potential flight conflict between nodes 1 and 4, 2 and 5, 3 and 5, respectively. As shown in the matrix (9), in the flight conflict network, the edge weight matrix is a symmetric matrix, that is,
. The elements not 0 in the matrix represent the flight conflict formed by a pair of aircraft. The larger the element value is, the more urgent the flight conflict is.
3. Conflict Resolution Theory Based on “Nucleolar Solution” of Cooperative Game
In the above, we have established a flight conflict network, and the edges and edge weights between nodes in the network can reflect the number and urgency of flight conflicts in the airspace. When the flight status of aircraft nodes in the network changes, the network changes accordingly. Therefore, the change in some indicators in the network before and after conflict resolution can reflect the overall release effect of the resolution strategy. Network efficiency is an indicator to measure the ability of network information communication [
37]. When the number of edges in the network is less, and the network efficiency is lower, the strategy has a better resolution effect. In the process of conflict resolution, the entire flight conflict network will pursue the best overall resolution efficiency in order to achieve the purpose of resolving multi-aircraft flight conflicts but ignore the issues of individual fairness and priority. To solve this problem, we introduce the idea of “nucleolar solution” of the cooperative game to realize the benefits balance between the whole network and each aircraft node.
Schmeidler [
38] first proposed the concept of nucleolar solution. Its essence is to minimize the degree of dissatisfaction of the alliance while ensuring the optimal welfare of the alliance, so as to achieve a balance between the overall and individual interests [
21]. In this paper, all nodes in the entire network are participants in the alliance
, and different conflict resolution strategies that satisfy the optimal welfare of the alliance form a strategy set
. Let
be the alliance cost function, which can reflect the overall satisfaction of the alliance. The smaller
is, the higher the overall satisfaction of the alliance. In the process of the game, on the one hand, from the perspective of individuals, they all hope that their avoidance costs are low; on the other hand, from the perspective of the alliance as a whole, it is hoped that the adjusted network conflict will have the best effect. The pursuit of optimal alliance welfare and minimum dissatisfaction among players is consistent with the “nucleolus solution”, taking into account the group’s and individuals’ rationality.
3.1. Network Evaluation Index for Conflict Resolution Performance
In the flight conflict network alliance composed of aircraft nodes, the alliance welfare is related to the overall effect of the conflict resolution strategy. The better the overall conflict resolution effect, the higher the alliance welfare. Therefore, defining an evaluation index that can reflect the overall conflict resolution effect is necessary.
In the study of multi-aircraft conflict resolution, people often take the length of the interval between aircraft pairs as the standard to test the effectiveness of the resolution strategy. They determine that a flight conflict will occur when either the horizontal or vertical interval of the aircraft is less than the safe separation in a future period. However, the network edge can directly reflect the conflict relationship between a pair of aircraft nodes in the flight conflict network. When there is no edge between the two nodes, there is no conflict with the aircraft. Therefore, for the flight conflict network, the following judgment can be made: when the number of edges in the network decreases, the conflict resolution strategy in this scenario is effective. However, there is a problem: although the number of network edges can reflect the number of flight conflicts in the network, it cannot reflect the conflict urgency in the whole network. As shown in
Figure 7, both flight conflict networks in
Figure 7a,b have 22 edges, but the average edge weight in
Figure 7a is 0.3542 and the average edge weight in
Figure 7b is 0.3960. In the same flight conflict network, even if the number of edges is the same, the urgency of flight conflicts in the network is different. Taking the number of connected edges of the network as the objective function of conflict resolution lacks gradient.
In response to the above problems, we extract the comprehensive network index () composed of robustness (), network efficiency (), and clustering coefficient ().
- 1.
Robustness (R)
In the flight conflict network, the edge weight represents the potential conflict strength of the aircraft nodes at both ends of the edge. The sum of the network’s edge weights can reflect the airspace’s overall flight conflict situation. The definition of robustness is the ability of the system to maintain a normal working state after an error or attack occurs.
is the number of nodes in the network and is the number of nodes that are removed. We did not move nodes out of the network after conflict resolution, and took 0 when performing static analysis on network robustness. The lower the robustness, the less responsive the network is to external disturbances. The node strength is the sum of edge weights of edges connected to a node. In the flight conflict network, the smaller the number of edges and the strength of nodes, the easier it is to resolve them. Therefore, robustness is essential for resolving conflict networks and is the most important relative to the other two indicators.
- 2.
Network Efficiency (NE)
Network efficiency refers to the structural form of information channels in the communication process and is an indicator to measure the ability of network information communication. The efficiency of information communication between nodes is negatively related to their consumption in the communication channel. In the undirected weighted graph, the closer the relationship between the node pairs is, the greater the edge weight is, so the formula of its network efficiency is:
is the number of connected edges on the shortest path between nodes and , and is the sum of the weights of all edges on the shortest path. In the flight conflict network, the network efficiency reflects the number and intensity of cascading conflicts between aircraft. The higher the , the higher the network complexity, which is the second most important indicator.
- 3.
Clustering Coefficient (CC)
The agglomeration coefficient is an indicator that reflects the completeness of the connection of small groups of nodes in the network. In an unweighted network, the clustering coefficient can reflect the proportion of node triangles in the network to node triples. For weighted networks with different edge weights, the clustering coefficient of the node can be expressed as:
Equation (12) was proposed by Barthelemy et al. in 2005 [
39], where
is the clustering coefficient of the node
,
is the degree of node
, and
denotes the strength of node
.
represents the connection between node pairs
and
. When they form a connected edge,
, otherwise
. The definition of
and
is similar to that of
.
The agglomeration coefficient of a weighted network is the average value of the agglomeration coefficients of each node in the network, and its formula is:
is the aggregation coefficient value of the i-th node in the network. The agglomeration coefficient in the flight conflict network reflects the proportion of multi-aircraft conflicts in all conflicts. The decrease in its value indicates that the complexity of network conflicts has decreased. Compared with the first two indicators, the importance of the agglomeration coefficient is relatively lower.
In order to determine the weight of each index in
, we apply the analytic hierarchy process (AHP) to calculate the weight coefficients of
,
, and
in
. The weight vector of robustness, network efficiency, and clustering coefficient is calculated as: [0.5396 0.2970 0.1634], obtaining
CI = 0.0046 and
simultaneously, and passes the consistency test. Therefore,
can be expressed as:
comprehensively considers the number of edges, strength, and node aggregation degree in the flight conflict network. It has both the gradient and the ability to reflect the effect of conflict resolution. It can play an essential role in the process of conflict resolution and help quickly resolve the flight conflict network. When is the smallest, the alliance benefit is the largest.
3.2. Alliance Cost Function
A good conflict resolution strategy should make the resolution cost as small as possible on the premise of ensuring security. In the flight conflict network, the number of participants in the alliance is the number of nodes
, nodes in the alliance plays games with each other by adjusting their flight status, and the satisfaction of each aircraft under different escape strategies is different. In this paper, according to the characteristics of the aircraft itself, the cost function is divided into speed cost
and heading cost
:
is the initial flight speed of node ; and are, respectively, the speed increment and horizontal track inclination of under a certain release strategy; the value ranges of and are both [0, 1].
Then, the alliance cost function
can be expressed as:
and are the weight coefficients of the speed term and the angle term in the cost function . The choice of and is a matter of preference selection. For the aircraft itself, compared with increasing or decreasing the speed value, adjusting the heading will make the aircraft deviate from the original trajectory and cause the waste of airspace, and will also involve the problem of trajectory recovery. Therefore, when the conditions are the same, adjusting the heading cost is higher than adjusting the speed. In this paper, we let be 0.7 and let be 0.3.
3.3. Node Priority
In the flight conflict network, some aircraft nodes play a key role in the network, and the priority to release these key nodes will quickly reduce the complexity of the airspace. The edge weight
is a network index reflecting the impending effect of node
and node
, and the node strength is the sum of edge weights of edges connected to a node, which can further reflect the urgency of node conflict. Based on this, we arrange the point strength of each node in descending order. The higher the point strength of the node, the higher its release priority. The point strength of node
is:
In the flight conflict network alliance, to make the release strategy fast and reliable, the nodes with high release priority should bear less release cost. That is, the higher the release priority of a node, the higher the cost weight coefficient of the node. We define the cost coefficient of the network node
in the alliance as:
According to the definition, the nucleolar solution () of the network alliance after the cooperative game is:
3.4. Consistency of Resolution Strategy Fairness and Optimal Alliance Satisfaction
According to the above description, the basic idea of the “nucleolus solution” is to design a fair solution, which promotes the participants to have higher individual satisfaction without compromising the welfare of the alliance. In
Section 3.2, we establish an alliance cost function
to reflect the overall satisfaction of the alliance, where the smaller
is, the higher the alliance satisfaction. However, there is a problem: if the cost function
decreases, the overall satisfaction of the alliance increases, but the individual satisfaction decreases, then the reduction of the alliance cost function
will not improve the fairness of the conflict resolution strategy. In order to prove the effectiveness of cost function
, we combined the speed obstacle method for mathematical derivation and designed experiments to verify the relationship between cost function
and strategy fairness. Specific steps are as follows.
As shown in
Figure 8, two aircrafts
and
at the same altitude fly forward at speeds
and
, respectively. According to the flight conflict criteria in
Section 2, it is obvious that there is a potential flight conflict between the two aircraft in this scenario. According to the definition of the alliance cost function
(Equation (17)), the consistency proof of strategy fairness and optimal alliance satisfaction should include: course cost consistency and speed cost consistency.
3.4.1. Validation of the Heading Cost Function Consistency
Figure 9a shows the principle of conflict resolution by adjusting the course of
.
Figure 9b shows the principle of conflict resolution by adjusting the course of
.
Figure 9c shows the principle of conflict resolution by adjusting the course of
and
. When the relative speed vectors of the two aircraft coincide with the boundary of
after flight state adjustment, the resolution is considered successful.
The important parameters in the disengagement process are defined as follows: let and be the priority coefficients of and . In the first two resolution modes, let and be their resolution costs, respectively, and let and be the resolution track inclination of and . When and cooperate for course resolution, and are the track inclination of and , respectively, and the cost is .
We first solve for
and
. As shown in
Figure 9a, let
and
be the initial heading angles of
and
, respectively,
is the angle between
and the
axis,
is the angle between
and
,
is the angle between
and
,
is the angle between
and
,
is the velocity vector of
after the course is released, then the heading angle of
is
after the conflict is resolved.
In the vector triangle
, according to the sine theorem, we have:
According to the geometric relationship in
Figure 9a, we substitute
and
into Equation (21). The simplified
is:
Next, we substitute Equation (21) into Equation (17) of the cost function. Then, when
adjusts the heading independently to resolve the conflict,
can be expressed as:
Next, we solve for
and
. As shown in
Figure 9b, the process of
independent heading resolution is similar to that of
. Let the velocity vector of
be
and the track inclination of
to be
after resolution.
According to the geometric relationship in
Figure 9a, we have:
By simplifying the above formulas, we can obtain:
In the vector triangle
, according to the sine theorem, we have:
Next, we substitute Equation (27) into Equation (17) of the cost function. When
adjusts the heading independently to resolve the conflict,
can be expressed as:
Finally, we solve for
,
, and
. As shown in
Figure 9c, when
and
resolve the conflict by cooperatively adjusting their headings,
and
adjust their respective track inclinations
and
, so that the relative velocity vector
is deflected by angles
and
(
).
According to the geometric relationship in
Figure 9c, we have:
In the vector triangle
, according to the sine theorem, we have:
We substitute
and
into Equation (30) and simplify:
Similarly, in the vector triangle
, according to the sine theorem, we have:
We substitute Equations (31) and (33) into Equation (17) of the cost function. When
and
cooperate to adjust the course to resolve the flight conflict,
can be expressed as:
In the above, we have derived the alliance cost function of aircraft independent heading conflict resolution and cooperative heading conflict resolution, respectively. In the following, we will design a conflict scenario to verify the consistency of resolution strategy fairness and optimal alliance satisfaction.
As shown in
Table 1, we design a conflict scenario. Let us first analyze the relationship between the change in each quantity when the two aircraft cooperate to solve the conflict.
is the minimum angle at which the relative speed needs to be deflected when the two aircraft are free from conflict.
is the angle at which the relative speed is deflected by adjusting the heading of
, and
is the angle at which the relative speed is deflected by adjusting the heading of
. The units of measurement for
,
, and
are degrees. When two aircraft cooperate to resolve a flight conflict, the total mission can be considered as making the relative velocity deflection of the angle
. When
is assigned the task of deflecting the relative velocity vector by the angle
, then
is assigned the task of deflecting the relative velocity vector by the angle
. The total task volume
is certain, and when the heading deflection angle of
gradually increases,
increases, and
gradually decreases, that is, the task volume undertaken by
gradually decreases, and the heading deflection angle of
gradually decreases; conversely, when the heading deflection angle of
gradually decreases, the task volume
undertaken by
decreases, and the task volume
undertaken by
increases, then the heading deflection angle of
gradually increases. When
, it is considered that the two aircraft have cooperated.
Figure 10 records the change relationship of
,
, and
with
on the premise that the aircraft can only adjust the course. The domain of
is
. It can be seen from
Figure 10 that as
increases, the two aircraft gradually deepen their cooperation in course release. When they cooperate to resolve the flight conflict,
gradually decreases. When
is
, that is, when aircraft
undertakes the task of deflecting the relative velocity vector
, the alliance disengagement cost is the smallest, and the
is 0.01591; When
,
, that is, the alliance resolution cost when the two aircraft cooperate to resolve the flight conflict is lower than the alliance release cost when either aircraft
or
resolves the conflict alone.
To sum up, as the degree of cooperation between aircraft pairs in heading and flight conflict resolution gradually deepens, the alliance cost gradually decreases and the alliance satisfaction increases. Therefore, when a pair of aircraft cooperates to adjust the course to resolve the flight conflict, the fairness of the strategy is reflected, the alliance cost is reduced, and the satisfaction is increased. For the heading cost in the alliance cost function , its strategy fairness is consistent with the changing trend of the optimal alliance satisfaction.
3.4.2. Validation of the Speed Cost Function Consistency
Figure 11a shows the principle of conflict resolution by adjusting the speed of
.
Figure 11b shows the principle of conflict resolution by adjusting the speed of
.
Figure 11c shows the principle of conflict resolution by adjusting the speed of
and
. In the process of the first two conditions, let
and
be the resolution costs of the two scenarios, respectively, and let
and
be the speed increments of
and
, respectively. When
and
cooperate to resolve the flight conflict by adjusting the speed,
and
are the speed increments of
and
, respectively, and the cost is
.
In the vector triangle
of
Figure 11a, according to the sine theorem, we have:
We substitute
into Equation (35) and simplify to obtain:
Next, we substitute the above equation into Equation (17). Then, when
adjusts the speed independently to resolve the conflict,
can be expressed as:
In the vector triangle
of
Figure 11b, according to the sine theorem, we have:
We substitute
into Equation (38) and simplify to obtain:
can be expressed as:
In the vector triangle
of
Figure 11c, according to the sine theorem, we have:
We substitute
into the above equation and simplify to obtain:
In the vector triangle
of
Figure 11c, according to the sine theorem, we have:
Next, we simplify the above equation:
We substitute Equations (42) and (44) into Equation (17) of the cost function. When
and
cooperate to adjust the speed to resolve the flight conflict,
can be expressed as:
In the consistency test of speed cost function, we still conduct experiments based on the scenarios in
Table 1.
Figure 12 records the change relationship of
,
, and
with
on the premise that the aircraft can only adjust the speed.
It can be seen from
Figure 12 that as
increases, the two aircrafts gradually deepen the cooperation in speed resolution, and the alliance cost
under cooperation resolution gradually decreases. When
is
,
reaches the minimum value, and then
continues to increase, and the degree of cooperation between the two aircraft gradually decreases. When
,
, and the speed cost of the two aircrafts cooperating to resolve the conflict is lower than the speed cost of either aircraft
or
to resolve the conflict alone.
To sum up, with the gradual deepening of the degree of cooperation in speed resolution among the aircraft, the fairness of the resolution strategy is reflected, and the individual satisfaction increases. At the same time, the overall resolution cost of the alliance gradually decreases, and the satisfaction of the alliance increases. Therefore, for speed cost and course cost in alliance cost function , the trend of strategic fairness and alliance satisfaction is consistent. In the process of conflict resolution, if the alliance cost function decreases, the alliance satisfaction increases and the fairness of the resolution strategy improves.
4. Network Conflict Resolution Based on NSGA-II Algorithm
In this paper, we adopt three ways of conflict resolution: course maneuver, speed maneuver, and course–speed compound maneuver. In the process of flight conflict resolution, the smaller the aircraft’s payment cost, the higher the economic benefit and feasibility of the resolution strategy.
In
Section 3, we define the alliance cost function and node priority, and the aircraft nodes play games against each other. According to the concept of the nucleolar solution, participants should ensure the maximum overall welfare of the alliance while minimizing the dissatisfaction of the alliance, but the solutions under these two goals are in conflict with each other. In the flight conflict network, adjusting the “key nodes” in the network is the most effective way to resolve the network, but the “key node” has a heavy weight in the alliance cost function, so it is difficult to achieve the optimal value of the two objectives at the same time.
To solve this problem, we introduce the NSGA-II algorithm to solve the solution set of the compromise between two target values, namely the Pareto optimal set. Compared with other multi-objective optimization algorithms, the NSGA-II algorithm not only ensures convergence, but also has potential parallelism. Therefore, its Pareto optimal set can be evenly and widely distributed, ensuring the calculation accuracy and shortening the search time.
4.1. Optimization Objective Function
The optimization objective function is the key to solving the multi-objective optimization problem. In order to make the Pareto optimal set contain the “kernel solution”, the optimization objective function should include and .
Objective function
: the comprehensive network index
can intuitively reflect the effect of the conflict resolution strategy in the flight conflict network. The smaller the
, the better the conflict resolution effect of the resolution strategy. When
is equal to 0, there is no flight conflict or potential flight conflict in the network, so taking
as one of the objective functions,
, can be expressed as:
and are the speed increment and track inclination of the i-th aircraft under the resolution strategy.
Objective function
: in the network alliance composed of aircraft nodes, each node needs to pay different costs under different conflict resolution strategies. The lower the resolution cost, the higher the satisfaction of aircraft nodes, and the better the effect of resolution strategies. The alliance cost function
can intuitively reflect the total cost of the alliance under a specific disengagement strategy. In
Section 3, we proved the consistency between the strategy’s fairness and the alliance’s optimal satisfaction.
can give consideration to both group rationality and individual rationality. Therefore, we take
as one of the target functions.
is the priority of the i-th aircraft; and are the weight coefficient of the speed item and the angle item in the cost function, respectively.
4.2. Constraints and Coding Methods
4.2.1. Constraints
In reality, the speed variation range of civil aircraft is limited [
40]. In order to ensure flight safety and operability in actual work, we make the following assumptions when simulating the flight environment:
- (1)
We stipulate that the speed variation range of the aircraft during flight is 600–900 km/h.
- (2)
During the flight conflict resolution process, the flight track inclination angle of a single aircraft should satisfy .
4.2.2. Coding Methods
Combined with the characteristics of genetic algorithms and different conflict resolution methods, we encode the chromosomes of course, speed, and compound maneuver.
Figure 13 shows the chromosomes under three conflict resolution methods, and let the number of nodes to be adjusted be
q.
Figure 13a is the chromosome under course resolution, and the first
q bits of the sequence represent the track inclination of each node to be adjusted;
Figure 13b is the chromosome under speed resolution, and the first
q bits of the sequence represent the speed of q nodes to be adjusted;
Figure 13c is the chromosome after compound release, its length is 2
q, where the first
q bits of the sequence are the heading bit, which records the track inclination angle of the node during the conflict resolution process, the
qth bit up to the 2
qth bit are the speed bits, which record the resolution speed of each node.
4.3. Initialize Population
The shorter the calculation time of a resolution strategy, the better the real-time performance of the strategy. In order to shorten the calculation time of the strategy, we derive the initial scheme under different conflict resolution methods, and inject it into the initial population to shorten the distance between the initial solution and the nucleolar solution, so as to improve the real-time performance of the method.
Figure 14 shows the principle of multi-aircraft conflict resolution based on the speed obstacle method. According to the flight conflict judgment criteria in
Section 2, when the relative speed vector is within the
, the two aircraft form a flight conflict relationship. Therefore, an effective conflict resolution strategy should keep the relative velocity vector out of the
. Combining with the definition of the nucleolar solution, we can infer that an effective initial solution strategy should satisfy two conditions: (1) the initial value solution is close to the feasible region of the resolution strategy; (2) the cost of conflict resolution should be as low as possible.
In the flight conflict network, let the degree of node be , then the neighbors of are , …, , so that the corresponding weights are , …, . Let , then is the node with the largest edge weight with node . We only change the flight state of node , combined with the speed obstacle method, to relieve the flight conflict between nodes and in three ways.
Next, we define some key variables in the conflict resolution process. When adjusting the heading to resolve the conflict, let the minimum horizontal track inclination of node be (when , adjusts the heading clockwise; when , adjusts the heading counterclockwise). When adjusting the speed of the aircraft to get rid of the flight conflict, let the minimum speed increment of node be (when , accelerates; when , decelerates). When we resolve the flight conflict through the compound release method, the horizontal track inclination of node is and the speed increment is . Then, for any node in the flight conflict network, its initial value of heading resolution is , and its initial value of speed resolution is , and its initial value of compound resolution is and . Then, we derive the initial scheme under the three conflict resolution methods, and the specific steps are as follows.
4.3.1. Initial Value of Course Resolution
As shown in
Figure 15, the speeds of the two aircraft nodes
and
with potential flight conflicts are
and
, respectively, and the flight conflicts are resolved by adjusting the heading of
. In this process, the speed of
is not changed, that is,
, and only the heading of
is adjusted, so that the new relative speed
is separated from
.
Figure 16 shows the principle of resolving the conflict by adjusting the heading on the section plane
. Let
be the section plane of
at the level of
, and let
and
be the projections of
and
on
, respectively. After adjusting the course of
, the relative speed disengages from
, and the included angle
between
and
is the horizontal track inclination of
in the course release strategy. Let
be the included angle between
and
, and let
be the included angle between
and
, and
is the included angle between
and
.
In the vector triangle
, according to the sine theorem and the geometric relationship in
Figure 16, we can obtain:
We substitute
into Equation (48) and simplify it, then the initial value of the course resolution of node
can be expressed as:
4.3.2. Initial Value of Speed Resolution
Similar to the principle of course resolution, in the process of speed resolution, we keep the original course of unchanged, and only adjust the speed of to make the new relative speed detach from .
As shown in
Figure 17, there is a flight conflict between
and
, and
is the minimum speed increment of
in the speed resolution. Let
be the projection of
on
, and the symbolic definitions of other variables are consistent with those in course resolution.
In the vector triangle
, according to the sine theorem and the geometric relationship in
Figure 17, we can obtain:
Then, the initial value in the speed resolution of node
can be expressed as:
is the pitch angle of node . When , the node is climbing; when , the node is descending; when , the node is in level flight.
4.3.3. Initial Value of Compound Resolution
In addition to the above two methods, adjusting the aircraft’s heading and speed simultaneously can also avoid flight conflicts. In the process of conflict resolution, the adjustable range of aircraft heading and speed is limited. Compared with heading resolution and speed resolution, the compound resolution method is more applicable and can deal with more flight conflict scenarios.
During the compound disengagement process, the heading and velocity values of are adjusted simultaneously to make the new relative velocity disengage from . In order to facilitate the derivation and analysis, we analyze the adjustment process of the course and speed separately, then the course maneuver and the speed maneuver undertake the task of deflecting the initial relative speed by angles and , respectively ().
As shown in
Figure 18,
is the node with the largest edge weight with
. We analyze the course maneuver and speed maneuver independently, assuming that
adjusts the speed first and then adjusts the course. Let
be the projection of the relative velocity vector on
after
adjusts the speed, and let
be the projection of the relative velocity vector on
after
adjusts the course.
In
Figure 18, there is the following angular relationship:
In the vector triangle
, according to the sine theorem in
Figure 18, we can obtain:
We simplify Equation (53) to obtain:
Then, the velocity increment of
during compound resolution can be expressed as:
In the vector triangle
, according to the sine theorem, we can obtain:
Simplifying Equation (56), then the horizontal track inclination of
in the compound solution can be expressed as:
To sum up, we have obtained the initial scheme of node under different resolution methods:
In this section, we derive the initial resolution scheme of any node in the network under three resolution methods. Next, we define the initial population. First, we rank the priority of aircraft nodes in the conflict network from high to low according to Equation (18). Then, we determine the node number to be adjusted according to the priority order. Finally, according to Equation (58), we formulate the corresponding initial resolution scheme and inject it into the initial population. According to the speed range and track inclination range of the nodes in the constraints above, we limit the initial scheme beyond the boundary: when , ; when , ; when , .
4.4. Conflict Resolution Process
As shown in
Figure 19, we combine the NSGA-II algorithm to divide the network conflict resolution into the following eight steps.
Step 1: Build the initial network. Based on the flight situation information in the airspace, we construct an initial flight conflict network and calculate the network weight matrix .
Step 2: Node priority sorting. According to Equation (18), the nodes are sorted from high priority to low priority.
Step 3: Determine the resolution method and the number of aircraft nodes that need to be adjusted according to the actual control needs.
Step 4: Initialize the population. The initial resolution scheme is formulated according to Equation (58), and the initial population is generated.
Step 5: Selection, crossover, and mutation. Calculate the value of the objective function and perform non-dominated sorting, according to the genetic operator operation of crossover and mutation, to generate the offspring population .
Step 6: Parent and child merge. Merge and to form a new species group with the scale of . Perform the non-dominated relation sorting operation again to screen out the new initial population with the scale of .
Step 7: Selection, crossover, and variation. The new initial population performs crossover and mutation genetic operators to generate a new offspring population and update the network weight matrix .
Step 8: Repeat steps 6–7 until the maximum number of iterations of the algorithm is reached. The chromosome with the smallest in the Pareto optimal set is the nucleolar solution (), which is the optimal conflict resolution solution.