Next Article in Journal
Online Task Switching and Scheduling Method for Attitude–Orbit–Shape-Distributed Control of Large Space Ring Structures
Next Article in Special Issue
Feasibility of Conflict Prediction of Drone Trajectories by Means of Machine Learning Techniques
Previous Article in Journal
A Novel Magnetic Integration High-Efficiency Converter with Low Ripple and High Dynamic Response for the Hybrid Power Supply Systems of All-Electric Aircraft
Previous Article in Special Issue
Flight-Based Control Allocation: Towards Human–Autonomy Teaming in Air Traffic Control
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks

1
Electronic Information School, Wuhan University, Wuhan 430072, China
2
College of Air Traffic Management, Civil Aviation University of China, Tianjin 300300, China
3
School of Civil Aviation, Northwestern Polytechnical University, Xi’an 710072, China
*
Author to whom correspondence should be addressed.
Aerospace 2024, 11(12), 966; https://doi.org/10.3390/aerospace11120966
Submission received: 18 October 2024 / Revised: 17 November 2024 / Accepted: 22 November 2024 / Published: 25 November 2024
(This article belongs to the Special Issue Future Airspace and Air Traffic Management Design)

Abstract

:
Over the past forty years, air traffic flow management (ATFM) has garnered significant attention since the initial approach was introduced to address single-airport ground delay issues. Traditional methods for solving both single- and multi-airport ground delay problems primarily rely on operations research techniques and are typically formulated as mixed-integer problems (MIPs), with solvers employed to approximate optimal solutions. Despite their effectiveness in smaller-scale problems, these approaches struggle with the complexity and scalability required for large-scale, multi-sector ATFM, leading to suboptimal performance in real-time scenarios. To overcome these limitations, we propose a novel neural network-based demand and capacity balancing (NN-DCB) method that leverages neural branching and neural diving to efficiently solve the ATFM problem. Using data from 15,927 flight trajectories across 287 airspace sectors on a typical day in February 2024, our method re-allocates trajectory entry and exit times in each sector. The results demonstrate that large-scale ATFM problems can be solved within 15 min, offering a significant performance improvement over the state-of-the-art methods. This study confirms that neural network-based approaches are more effective for large-scale ATFM problem-solving.

1. Introduction

Air traffic flow management (ATFM) aims to optimize air traffic flow through ground delay programs or rerouting strategies [1,2,3]. In recent years, many countries have progressively established central-distributed ATFM centers based on the evolved multi-airport ground delay theory [4,5]. In China, distributed ATFM systems have transitioned to centralized management systems that implement flow management strategies using uniform algorithms since 2021. However, from an engineering perspective, these systems face challenges such as low predictive accuracy, long computation times, and inefficiencies. These limitations hinder the effective implementation of ATFM in China. Furthermore, organizations such as the International Civil Aviation Organization (ICAO), Civil Aviation Administration of China (CAAC), Eurocontrol, Single European Sky ATM Research (SESAR), Federal Aviation Administration (FAA), and Civil Air Navigation Services Organisation (CANSO) have published future visions and roadmaps to guide air transportation towards higher safety, efficiency, and lower carbon emissions. With the increasing use of Artificial Intelligence (AI) techniques, the civil aviation industry, especially ATFM, is encouraged to adopt innovative methods [6].
The capacity-demand balancing problem is central to ATFM systems, where demand must not exceed capacity at any stage for all sectors. Multi-airport ground delay programs and demand-capacity balancing (DCB) in ATFM typically constitute mixed-integer problems (MIPs) [1,7]. Historically, the consensus was to apply operations research techniques and solvers such as CPLEX [8] or Gurobi [9], and other popular solvers like CBC [10] or Xpress [11] to approximate optimal solutions. However, these solvers [8,9,10,11] often yield suboptimal solutions and are inefficient in some cases. To address these issues, this study develops a customized neural network designed to find optimal solutions within the national airspace. Recently, DeepMind [12] demonstrated success in rapidly solving MIP problems using neural networks, which manage the upper and lower bounds of traditional optimization problems. This motivates us to explore whether such techniques can be applied to solve DCB problems. The DCB method was first proposed by Xu et al. [13], who later developed a series of variant models [14,15]. Many scholars have adopted this approach to tackle ATFM challenges [16,17]. More recently, some researchers have proposed reinforcement learning-based methods, such as Q-learning, TD-learning, DQN, and A3C, to address the DCB problem [18]. These studies typically focus on using ground delay programs (GDPs) to control flight operations, with real-world scenarios ranging from 400 to 12,000 flights. Additionally, some studies consider sector-opening schemes. Kravaris et al. [19] explore how multiagent reinforcement learning can address and mitigate imbalances between demand and capacity in air traffic management. Spatharis et al. [20] investigate collaborative multiagent reinforcement learning frameworks aimed at improving coordination and efficiency in air traffic management. Spatharis and Bastas et al. [21] propose hierarchical multiagent reinforcement learning strategies to optimize decision-making and management processes in complex air traffic scenarios. Mas-Pujol et al. [22] explore how image-based multi-agent reinforcement learning techniques can be applied to balance demand and capacity in complex systems like air traffic management. In summary, while existing methods [15,16,23,24,25,26,27] have alleviated the demand and capacity imbalances in ATFM to some extent, they still face challenges, such as low efficiency, poor scalability, and insufficient real-time processing capabilities, when dealing with large-scale, dynamically changing, complex airspace environments. To address these shortcomings, this study proposes a novel neural network-based demand and capacity balancing method (NN-DCB), which aims to provide a more efficient, flexible, and scalable solution by utilizing neural branching and neural diving techniques. The NN-DCB is the first to propose a customized neural network based on DeepMind’s work, demonstrating that deep learning can be applied to solve MIP-based ATFM problems. Our primary contributions are as follows:
  • We successfully developed a deep neural network to obtain optimal solutions for large-scale ATFM problems, which addresses demand-and-capacity balancing within the ATFM framework;
  • Our experiments focus on the complexity of real-world operational scenarios. We sourced data from Variflight and other reliable platforms, using large-scale flight trajectory data to train the model and ensure robust outcomes;
  • Simulation results demonstrate that our method achieves the shortest solution time for real-time ATFM problems. The algorithms can determine the optimal delay times for each aircraft within 15 min, which holds significant practical value for real-world applications.
The structure of this paper is as follows. Section 1 introduces the background, methodology, and key contributions. Section 2 presents the deep learning and neural network methods employed. Section 3 outlines our proposed NN-DCB model, incorporating neural network theory, with a focus on the model’s objectives and constraints. Section 4 includes a case study based on our data and experimental results, along with a comparative analysis of traditional methods. Finally, the conclusion summarizes our findings and suggests directions for future research.

2. Related Work

2.1. Mixed-Integer Problems Based on Deep Learning

Recently, the joint research team of DeepMind and Google published their work on designing a heuristic algorithm to solve large-scale mixed-integer programming (MIP) problems using shared structures from large datasets. Their heuristic algorithm generates high-quality joint variable assignments, targeting the two core sub-problems of MIP [28]. This method reduces the gap between variable values and optimal values. Neural diving and neural branching, based on neural networks, are integrated with MIP solvers such as SCIP [29]. Specifically, neural diving trains a deep neural network to generate values for integer variables, while SCIP is used to handle the remaining variables for smaller MIPs, leading to high-quality joint variable assignments [30]. Neural branching, on the other hand, trains a deep neural network to select branching strategies in the branch-and-bound process. This approach, combined with techniques like Full Strong Branching, reduces the gap between the target and optimal values by constructing smaller decision trees and generating new variables.
The research team evaluated the neural networks on multiple real-world datasets, including MIPLIB and Google’s production datasets. After pre-solving, solutions were found for most cases involving between 103 and 106 variables and constraints, which is significantly larger than previous learning-based methods. They announced that their approach marks the first major advancement over existing methods and MIPLIB benchmarks.

2.2. Mixed-Integer Problems Based on Neural Network

Mixed-integer programming (MIP) is an NP-hard optimization problem widely encountered in domains such as supply chain management, production scheduling, and energy systems. In recent years, neural network-based approaches [12,31] have emerged as promising tools for solving MIP problems more efficiently by leveraging machine learning techniques. Traditional methods for solving MIP problems, such as branch-and-bound or cutting planes, often struggle with the exponential growth in complexity as problem sizes increase. Neural networks, particularly deep learning models, have been applied to either enhance existing solvers or provide entirely new frameworks for tackling MIP problems. By learning from past problem instances, neural networks can predict optimal or near-optimal solutions, accelerate branching strategies, and improve variable selection in solvers, thereby significantly reducing computation time. These methods have been explored in various applications, including air traffic flow management, where MIP formulations are prevalent due to complex capacity and routing constraints. The integration of neural networks into MIP-solving pipelines has demonstrated considerable potential in improving both the speed and scalability of solving large-scale, real-world optimization problems.
To address these, we present a solver enhanced with neural heuristics, which learns from training datasets and adapts to the problem domain. Additionally, the solver can output a new timetable while adhering to capacity and operational constraints. Our approach integrates two neural network-based components in the MIP solver: neural diving and neural branching. Neural diving primarily addresses binary variable problems, while neural branching is more suited to complex constraint interaction problems. In this study, we employ both techniques in the MIP solver, combining them to produce a customized neural solver for the demand-capacity balancing (DCB) problem. Further details can be found in Figure 1 and Figure 2.

3. Methodology

3.1. Overview

Building on the use of neural networks to solve MIP problems, we introduce our demand and capacity balancing method, based on neural branching and neural diving (NN-DCB). The NN-DCB model is an extension of the DCB model, an optimization framework for demand-and-capacity balancing. The primary goal of this problem is to minimize flight delays while adhering to capacity and other operational constraints. The DCB model was first introduced in Xu’s paper [13], with further models presented in subsequent works [14,15]. The initial model focused solely on flight delays and classic ATFM constraints. In later works, additional strategies and objectives were introduced under various scenarios. The C-DCB variant incorporates rerouting strategies and fuel consumption across different air routes, while SC-DCB1 [13] and SC-DCB2 [15] add more operational constraints, making the model more suitable for real-world scenarios. To evaluate the methods more intuitively, we compare several representative methods in Table 1. A summary of current related studies is included in the last row.
However, none of these works have yet addressed large-scale air traffic flow management problems using novel neural networks. In this chapter, we present the NN-DCB model to make the theory more applicable to large-scale ATFM problems. The descriptions of some notations are listed in Table 2.

3.2. NN-DCB

min f F j = J f t T f j t r f j x f , t j x f , t 1 j D e l a y
x f , t j = 1 , if   flight   f   enter   elementary   sector   j   by   time   t   0 , otherwise
Although most ATFM models account for both ground and airborne delays, this paper focuses solely on ground delay to simplify the problem. The objective function represents the total deviation in time for flights passing through all airspace sectors. In Formula (1), c denotes the actual flight time for each sector, which is the target of our optimization model, while r represents the scheduled time for flight f passing through sector j . Thus, t r captures the time deviation or ground delay. The assignment decision variable is denoted by x , as shown in Formula (2).
Constraint for operational limitations: We define the time window as the variable T in this paper, representing the maximum allowable delay for a flight, which enables us to assign delays accordingly. For example, if T is set to 360 min, the maximum delay for flight   f is 360 min. Formula (3) represents the location constraint for flight f . In this context, t + 1 indicates that the flight has moved to a different location or sector. Formula (4) ensures that only one flight occupies a given sector at any time. Formula (5) guarantees that only one trajectory is selected.
Constraint for airspace capacity: We define airspace capacity as c . Therefore, at any given time, the number of flights cannot exceed this airspace capacity, as expressed in Formula (6). In China, airspace capacity is determined within a 15 min time window. Every 15 min, the CAAC authorities announce the updated capacity for each sector. We use τ to represent the constraint that flight flow cannot exceed capacity during each 15 min interval. It is worth noting that this differs slightly from the approach in the other DCB model, where the capacity in France is updated every 60 min. Compared to the 15 min window, this results in longer time intervals. For the case study in this paper, τ is set to 15 min.
s . t .   °   x f , T f j 1 j = 0 , x f , T f j j = 1   °   f F , j J f
x f , t j x f , t 1 j 0   °   f F , j J f , t T f j
x f , t + t ^ f j j j x f , t j = 0   °   f F , t T f j , j = J f i , j = J f i + 1 : i 1 , n f
f F j = J f τ t T f j Υ τ x f , t j x f , t 1 j c l τ   °   l L τ , τ Υ
x f , t j { 0,1 }   °   f F , j J f , t T f j
Constraint on airspace capacity: Finally, the model must satisfy the binary constraint, where the decision variable is defined as either 0 or 1, as shown in Formula (7).

3.3. Training Details

3.3.1. Training Algorithm

To convert the classic model described in Section 2.1 into a neural network-based solution, we propose a novel neural network approach. As outlined earlier, our method applies machine learning to address two key subtasks of the MIP solver: (a) outputting variable assignments that satisfy the constraints (if such assignments exist); and (b) determining the range of the target value gap between the variable assignment and the optimal solution. These two tasks define the core components of our approach, namely neural diving and neural branching. Further details can be found in Figure 2.
Neural diving: This component focuses on finding high-quality joint variable assignments.
Neural branching: This component is used to reduce the gap between the best assignment and the target value of the optimal solution.
Specifically, the neural diving model predicts continuous delay values for each flight, while the neural branching model makes binary decisions for minor adjustments. The optimization process combines both models to efficiently explore the solution space. Next, the method must satisfy the airspace capacity constraint. The constraint component ensures that the modified schedule adheres to time-varying sector capacities. The DCB learning algorithm is summarized in Algorithm 1. The first step involves constructing the neural diving model, followed by the construction of the neural branching model. After building the neural network architecture, the optimization process proceeds, aiming to solve the DCB problem by determining the optimal holding time for each flight and the appropriate takeoff time. The neural network architectures for both neural diving and branching consist of fully connected layers, designed specifically for mixed-integer programming (MIP) optimization. The neural diving network uses 3 layers with ReLU activation in the hidden layers, with dropout (rate 0.3) applied for improved generalization and stability. The neural branching network has 3 layers with similar activations and a dropout rate. Both networks use Xavier initialization for weight initialization to prevent gradient issues. These design choices enable the networks to effectively explore and narrow the solution space for large-scale optimization in Air Traffic Flow Management. The Binary Cross-Entropy (BCE) loss for neural diving is defined as Formula 8. The BCE loss function is well-suited for binary decision-making tasks in mixed-integer programming optimization, where the goal is to assign values of 0 or 1 to variables. While alternatives such as Huber loss were considered, they are more appropriate for regression tasks and mixed-variable problems, which would introduce unnecessary complexity in this binary context. For optimization, we employed the Adam optimizer, which is known for its adaptive learning rate and efficient handling of sparse gradients, using default parameters (β1 = 0.9, β2 = 0.999). Training adjustments included learning rate decay, starting at 1 × 10−4 and halving every 10 epochs if the validation loss plateaued, and early stopping to prevent overfitting by halting training after 20 epochs without improvement.
B C E y predict , y true = 1 n i y true i log y predict i + 1 y true i log 1 y predict i
Neural diving and branching methods distinguish themselves from traditional deep learning techniques by being specifically designed to solve mixed-integer programming optimization problems, rather than general prediction or classification tasks. While traditional deep learning models are suited for sequential decision-making, they tend to be computationally expensive in large-scale optimization settings. Neural diving and branching methods focus on efficiently exploring and narrowing the solution space. Their direct integration with MIP solvers enhances solution quality and reduces computation time, making them highly effective for real-time optimization. In the context of Air Traffic Flow Management, which typically involves large-scale, dynamic problems with both discrete and continuous variables, neural diving and branching offer superior efficiency for handling extensive datasets. These methods are better suited for dynamic environments and can quickly adapt to changes, such as weather disruptions or fluctuating traffic. Consequently, they provide a powerful tool for optimizing demand and capacity balancing in ATFM, delivering faster and higher-quality solutions compared to traditional deep learning approaches.
Algorithm 1 Learning to solve DCB problems
1: Initialize best schedule S * = D
2: Initialize best delay d * =
3: for  i = 1 to L  do:
4:    S c u r r e n t = D
5:   // Neural Diving Phase
6:   for  e a c h   f in F  do:
7:     delay_prediction = ND ( f ,   t f i n ,   t f o u t ,   r f ,   θ N D )
8:     Explore delay: delay = α · delay_prediction + (1- α ) · random_delay()
9:     Apply delay: S c u r r e n t f = S c u r r e n t f + delay
10:   end for
11:   // Neural Branching Phase
12:   for e a c h   f in F  do:
13:     branch_decision = NB ( f ,   t f i n ,   t f o u t ,   r f ,   θ N B )
14:     if branch_decision [0] > 0.5 then
15:        S c u r r e n t f = S c u r r e n t f small_delay
16:     end if
17:     if branch_decision [1] > 0.5 then
18:        S c u r r e n t f = S c u r r e n t f + small_delay
19:     end if
20:   end for
21:   // Constraint Check and Best Schedule Update
22:   if check_constraints ( S c u r r e n t , C) then
23:      d c u r r e n t = calculate_average_delay( S c u r r e n t , D)
24:     if d c u r r e n t < d *  then
25:        S * = S c u r r e n t
26:        d * = d c u r r e n t
27:     end if
28:   end if
29:   Update α based on optimization performance
30: end for
31: Output: Optimized schedule S * and best average delay d *

3.3.2. Training Scenarios

The scenario data for this paper consists of nominal airspace capacity and flight information. We utilize real-world data from Chinese airspace, as shown in Figure 3. This image, provided by Variflight (www.Variflight.com, accessed on 5 February 2024.), illustrates the distribution of flights across Chinese national airspace. The dense clustering of aircraft highlights high-traffic areas, predominantly in the eastern and southern regions of China, while the western regions see significantly fewer flights. A total of 15,927 flights were selected for training, using the sector opening scheme for that day within China’s national airspace. Two hundred and eighty-seven sectors were considered, including airport terminal areas and en-route sectors. Based on the aforementioned real-world data, each training scenario includes a set of flight information and other essential details for the specific day.

4. Experimental

4.1. Data Preprocessing

We retrieved the flight information dataset from Variflight. The original dataset contains 19,014,071 rows of data, including flight number, origin airport, destination airport, registration number, flight type, scheduled departure and arrival times, actual departure and arrival times, flight time, speed, angle, altitude, and longitude and latitude. The data were then cleaned, and relevant information was extracted from the Variflight dataset. Ultimately, 15,927 flights and their trajectories through 287 sectors were selected from the original dataset. The data in Table 3 represents a typical day (5 February 2024), summarizing the operations of 15,927 flights in Chinese national airspace.
We then retrieved the airspace information dataset from the Aeronautical Information Publication (AIP) provided by the Civil Aviation Administration of China (CAAC), which contains data on 287 sectors in Chinese national airspace. However, due to confidentiality issues, height information is only available for 285 sectors. The dataset includes details on altitude, longitude, and latitude, allowing us to model the airspace using ArcGIS software (v.10.8.2). After inputting the flight trajectories and airspace data, the software generated information on the air traffic situation. As shown in Figure 4, we simulated the complete operational scenario for China on 5 February 2024. The 15,927 trajectories traversed 287 sectors, as visualized in the ArcGIS maps. Figure 5 provides a close-up view, highlighting the large number of trajectories over 27 sectors within the Chengdu Shuangliu International Airport (IATA: CTU, ICAO: ZUUU).
Finally, we used the calculation function in ArcGIS to obtain the entry and exit times for all trajectories across 287 sectors. The processed dataset, consisting of 167,473 data points, provides detailed insight into the operational situation on that day. Using these entry and exit times, the optimal time can be calculated with our NN-DCB model and proposed algorithm.

4.2. Experimental Results

The neural networks were constructed using the PyTorch library in a Python environment (3.13.0) and trained on an Apple MacBook Air (Cupertino, CA, USA) equipped with an M2 chip, featuring a CPU, GPU, and 8 GB of RAM. The total computation time was 15 min and 50 s to find the optimal solution. Given that our simulation operates at the national level, this computational efficiency is highly acceptable and faster than RL-based or traditional optimization methods.
The training results are displayed in Figure 6. The left side of the figure shows the training loss, which measures the gap between the model’s predictions and the actual values during training. Training loss is directly related to the optimization direction and the performance improvement of the model. The green curve represents the neural branching training loss, while the blue curve represents the combined neural branching and neural diving training loss. The trend of these curves is nearly identical: after a brief period of fluctuation, the loss rises sharply, stabilizes, and eventually converges. Both neural networks achieve minimal loss around 60 epochs. The right side of Figure 6 illustrates training accuracy, which refers to the model’s accuracy on the training dataset. The trend of all three curves is similar, with training accuracy stabilizing around 100 epochs. In terms of performance, the results demonstrate that the combination of neural branching and neural diving achieves outstanding training performance.

4.3. Flight Delays Distribution

Our approach aims to maximize computational efficiency while minimizing total delay time, leading to the generation of a new flight schedule. We obtained the flight delay distribution for 15,927 flights, as shown in Figure 7. The maximum delay time was approximately 18,365 s for flight HO1283, and the minimum delay was 17 s for flight CZ6044 on that day. A total of 2428 flights were delayed in the simulation, accounting for about 15% of all flights. Additionally, the average delay time was 23 min, which is slightly higher than that achieved by Tang’s [15] and Huang’s [27] methods. We attribute this difference to the larger sample size used in our study. Our experimental results confirm that the proposed method achieves better demand and capacity balancing while satisfying the GDP strategy. As shown in Figure 8, before the simulation, demand in some sectors exceeded capacity. In certain circumstances, a large number of flights appeared in the same sector within a short period, severely impacting flight safety. After the simulation, most sectors achieved demand and capacity balance, with all demand curves falling below the capacity limit. These results are consistent with our previous work, with the key difference being the application of the neural network method to large-scale, complex operational scenarios, demonstrating higher computational efficiency and more reliable solutions.

4.4. Comparison with State-of-Art RL-Based and Traditional DCB Methods

This test aims to compare the proposed method with existing RL-based and traditional DCB methods. Specifically, we compare our method with those proposed by Chen and Xu. In Chen’s study [16], he introduces a MARL (Multi-Agent Reinforcement Learning) method that considers the sector opening scheme. His study designs a multi-iteration mechanism within the DCB decision-making framework to address issues arising from non-stationarity in MARL and to ensure the elimination of all hotspots. In Xu’s study [14], two variant models are proposed to manage the sector opening scheme, using a traditional optimization method to find the optimal solution. In this section, we use “Xu-SC-DCB” to refer to Xu’s work and “Chen” to refer to Chen’s work.
As shown in Figure 9, NN-DCB refers to the method proposed in this work. While the state-of-the-art RL-based methods solve the DCB problem faster than the traditional DCB methods used in Xu’s paper, our approach finds the optimal solution in just 15 min, outperforming even the RL-based methods. Furthermore, our simulation considers 15,927 flights, significantly larger than the datasets used in Xu’s and Chen’s studies. Specifically, our flight scale is approximately 178% and 132% larger than those in Xu’s and Chen’s works, respectively. Despite the larger flight scale, our computing time is reduced to 53.6%, 29.4%, and 42.6% of the computing times in Xu’s, Chen’s, and RL-based methods, respectively. These results demonstrate that the proposed method outperforms both state-of-the-art RL-based and traditional methods. In terms of the decision-making framework, all methods are similar in that they consider synchronous demand-capacity balancing in collaborative air traffic flow management. Moreover, we have conducted an additional analysis of the model’s performance metrics. As shown in Figure 10, we analyzed some typical performance indicators such as MSE, RMSE, MAE, accuracy, precision, recall, and F1-Score, which shows a good accuracy of our proposed NN-DCB model. In addition, the proposed NN-DCB is highly scalable, based on a standard framework design, and can be efficiently deployed on industry-standard computational hardware, including high-performance servers, GPUs, and cloud-based systems. This enables fine-grained, real-time air traffic flow management and trajectory coordination, even in large-scale, dynamic environments typical in ATFM systems. At present, we are offering our experimental results to a related research institution, which is building the national ATFM systems of China in 2021. They will integrate the NN-DCB model into existing ATFM industry systems for real-time decision-making.

5. Conclusions

In this study, we present a novel neural network approach to solve large-scale demand and capacity balancing within a collaborative ATFM framework. This method, based on deep learning, combines neural diving and neural branching to enhance solution quality. Neural diving is primarily used to find high-quality joint variable assignments, while neural branching narrows the gap between the best assignment and the target value of the optimal solution. Within our neural network method, traditional problems are treated as mixed-integer programming (MIP) problems, with solvers used to find approximate optimal solutions. We tested our method in a real-world complex operational scenario, focusing on Chinese national airspace. Compared to previous experiments, our approach uses a larger flight scale to identify the best GDP strategy. In the same collaborative ATFM framework, our method outperforms state-of-the-art RL-based and traditional DCB methods. Using 15,927 flight trajectories from a typical day in February 2024, spread across 287 airspace sectors with nominal capacity, we reallocated the entry and exit times of trajectories within each sector. The results show that large-scale ATFM problems can be optimally solved in just 15 min.
While this work demonstrates the potential of deep learning to solve real-world ATFM problems, it has limitations, notably the exclusion of airborne delays, uncertainty factors, sector opening schemes, and fairness considerations. Future research will explore how to enhance the model to include airborne delays, enabling a more comprehensive solution for air traffic flow management that accounts for delays across both ground and airborne phases of flight. Additionally, we plan to explore the use of cloud or edge computing to further improve scalability and performance, as well as predictive analytics and machine learning techniques to facilitate proactive adjustments to flight schedules.

Author Contributions

Conceptualization, Y.Z.; Methodology, Y.C.; Software, Y.C.; Validation, Y.C.; Data curation, F.F. and H.Y.; Writing—original draft, Y.C.; Supervision, Y.Z.; Project administration, Y.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by China Scholarship Council, grant number 202206270123.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chen, Y.; Zhao, Y.; Wu, Y. Recent progress in air traffic flow management: A review. J. Air Transp. Manag. 2024, 116, 102573. [Google Scholar] [CrossRef]
  2. International Civil Aviation Organization. Global Air Navigation Plan for CNS/ATM Systems; ICAO: Montreal, QC, Canada, 2002. [Google Scholar]
  3. International Civil Aviation Organization. Global Air Traffic Management Operational Concept; ICAO: Montreal, QC, Canada, 2005. [Google Scholar]
  4. International Civil Aviation Organization. The Aviation System Block Upgrades, The Framework for Global Harmonization; ICAO: Montreal, QC, Canada, 2016. [Google Scholar]
  5. SESAR Joint Undertaking. European ATM Master Plan-The Roadmap for Sustainable Air Traffic Management; SESAR Joint Undertaking: Brussels, Belgium, 2012. [Google Scholar]
  6. Degas, A.; Islam, M.R.; Hurter, C.; Barua, S.; Rahman, H.; Poudel, M.; Ruscio, D.; Ahmed, M.U.; Begum, S.; Rahman, M.A.; et al. A survey on artificial intelligence (AI) and explainable AI in air traffic management: Current trends and development with future research trajectory. Appl. Sci. 2022, 12, 1295. [Google Scholar] [CrossRef]
  7. Yang, H.; Alphones, A.; Xiong, Z.; Niyato, D.; Zhao, J.; Wu, K. Artificial-intelligence-enabled intelligent 6G networks. IEEE Netw. 2020, 34, 272–280. [Google Scholar] [CrossRef]
  8. IBM ILOG CPLEX Optimization Studio, Version 12.10.0, IBM Corp. Available online: https://www.ibm.com/docs/en/icos/12.10.0 (accessed on 1 November 2024).
  9. Gurobi Optimizer. Gurobi 12.0 Documentation. Available online: https://docs.gurobi.com/current/ (accessed on 1 November 2024).
  10. Forrest, J.; Lougee-Heimer, R. CBC user guide. In Emerging Theory, Methods, and Applications; INFORMS: Catonsville, MD, USA, 2005; pp. 257–277. [Google Scholar]
  11. Holmström, K.; Göran, A.O.; Edvall, M.M. USER’S GUIDE FOR TOMLAB/Xpress R2004; Tomlab Optimization Inc.: San Diego, CA, USA, 2007. [Google Scholar]
  12. Nair, V.; Bartunov, S.; Gimeno, F.; Von Glehn, I.; Lichocki, P.; Lobov, I.; O’Donoghue, B.; Sonnerat, N.; Tjandraatmadja, C.; Wang, P.; et al. Solving mixed integer programs using neural networks. arXiv 2020, arXiv:2012.13349. [Google Scholar]
  13. Xu, Y.; Dalmau, R.; Melgosa, M.; Montlaur, A.; Prats, X. A framework for collaborative air traffic flow management minimizing costs for airspace users: Enabling trajectory options and flexible pre-tactical delay management. Transp. Res. Part B Methodol. 2020, 134, 229–255. [Google Scholar] [CrossRef]
  14. Xu, Y.; Prats, X.; Delahaye, D. Synchronised demand-capacity balancing in collaborative air traffic flow management. Transp. Res. Part C Emerg. Technol. 2020, 114, 359–376. [Google Scholar] [CrossRef]
  15. Tang, Y.; Xu, Y. Multi-agent deep reinforcement learning for solving large-scale air traffic flow management problem: A time-step sequential decision approach. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–10. [Google Scholar]
  16. Chen, Y.; Xu, Y.; Hu, M.; Yang, L. Demand and capacity balancing technology based on multi-agent reinforcement learning. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–9. [Google Scholar]
  17. Yutong, C.; Minghua, H.; Yan, X.; Lei, Y. Locally generalised multi-agent reinforcement learning for demand and capacity balancing with customised neural networks. Chin. J. Aeronaut. 2023, 36, 338–353. [Google Scholar]
  18. Crespo, A.M.F.; Weigang, L.; de Barros, A.G. Reinforcement learning agents to tactical air traffic flow management. Int. J. Aviat. Manag. 2012, 1, 145–161. [Google Scholar] [CrossRef]
  19. Kravaris, T.; Spatharis, C.; Blekas, K.; Vouros, G.A.; Garcia, J.M.C. Multiagent reinforcement learning methods for resolving demand-capacity imbalances. In Proceedings of the 2018 IEEE/AIAA 37th Digital Avionics Systems Conference (DASC), London, UK, 23–27 September 2018; pp. 1–10. [Google Scholar]
  20. Spatharis, C.; Blekas, K.; Bastas, A.; Kravaris, T.; Vouros, G.A. Collaborative multiagent reinforcement learning schemes for air traffic management. In Proceedings of the 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA), Patras, Greece, 15–17 July 2019; pp. 1–8. [Google Scholar]
  21. Spatharis, C.; Bastas, A.; Kravaris, T.; Blekas, K.; Vouros, G.A.; Cordero, J.M. Hierarchical multiagent reinforcement learning schemes for air traffic management. Neural Comput. Appl. 2023, 35, 147–159. [Google Scholar] [CrossRef]
  22. Mas-Pujol, S.; Salamí, E.; Pastor, E. Image-based multi-agent reinforcement learning for demand–capacity balancing. Aerospace 2022, 9, 599. [Google Scholar] [CrossRef]
  23. Agogino, A.K.; Tumer, K. A multiagent approach to managing air traffic flow. Auton. Agents Multi-Agent Syst. 2012, 24, 1–25. [Google Scholar] [CrossRef]
  24. Kravaris, T.; Vouros, G.A.; Spatharis, C.; Blekas, K.; Chalkiadakis, G.; Garcia, J.M.C. Learning policies for resolving demand- capacity imbalances during pre-tactical air traffic management. In Proceedings of the Multiagent System Technologies: 15th German Conference, MATES 2017, Leipzig, Germany, 23–26 August 2017; Proceedings 15. Springer: Cham, Switzerland, 2017; pp. 238–255. [Google Scholar]
  25. Spatharis, C.; Kravaris, T.; Vouros, G.A.; Blekas, K.; Chalkiadakis, G.; Garcia, J.M.C.; Fernandez, E.C. Multiagent reinforcement learning methods to resolve demand capacity balance problems. In Proceedings of the 10th Hellenic Conference on Artificial Intelligence, Patras, Greece, 9–12 July 2018; pp. 1–9. [Google Scholar]
  26. Duong, T.; Todi, K.K.; Chaudhary, U.; Truong, H.L. Decentralizing air traffic flow management with blockchain-based reinforcement learning. In Proceedings of the 2019 IEEE 17th International Conference on Industrial Informatics (INDIN), Helsinki, Finland, 22–25 July 2019; Volume 1, pp. 1795–1800. [Google Scholar]
  27. Huang, C.; Xu, Y. Integrated frameworks of unsupervised, supervised and reinforcement learning for solving air traffic flow management problem. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–10. [Google Scholar]
  28. Bengio, Y.; Lodi, A.; Prouvost, A. Machine learning for combinatorial optimization: A methodological tour d’horizon. Eur. J. Oper. Res. 2021, 290, 405–421. [Google Scholar] [CrossRef]
  29. Achterberg, T. SCIP: Solving constraint integer programs. Math. Program. Comput. 2009, 1, 1–41. [Google Scholar] [CrossRef]
  30. Khalil, E.; Le Bodic, P.; Song, L.; Nemhauser, G.; Dilkina, B. Learning to branch in mixed integer programming. Proc. AAAI Conf. Artif. Intelligence 2016, 30, 1. [Google Scholar] [CrossRef]
  31. Fischetti, M.; Jo, J. Deep neural networks and mixed integer linear optimization. Constraints 2018, 23, 296–309. [Google Scholar] [CrossRef]
Figure 1. A hybrid neural approach for MIP optimization in ATFM. Our approach integrates neural diving and neural branching within a customized neural MIP solver to address demand and capacity balancing in air traffic management. By combining generative modeling and imitation learning, the framework efficiently handles complex real-world MIP scenarios, ensuring optimal solution assignments for high-demand airspace sectors.
Figure 1. A hybrid neural approach for MIP optimization in ATFM. Our approach integrates neural diving and neural branching within a customized neural MIP solver to address demand and capacity balancing in air traffic management. By combining generative modeling and imitation learning, the framework efficiently handles complex real-world MIP scenarios, ensuring optimal solution assignments for high-demand airspace sectors.
Aerospace 11 00966 g001
Figure 2. Bipartite graph representation for neural network-based MIP solving. This image illustrates a bipartite graph representation of a mixed-integer programming (MIP) problem used as input for a neural network.
Figure 2. Bipartite graph representation for neural network-based MIP solving. This image illustrates a bipartite graph representation of a mixed-integer programming (MIP) problem used as input for a neural network.
Aerospace 11 00966 g002
Figure 3. Flight distribution across Chinese national airspace.
Figure 3. Flight distribution across Chinese national airspace.
Aerospace 11 00966 g003
Figure 4. Real-time air traffic trajectories and sector distribution on 5 February 2024 in Chinese national airspace. The red lines represent flight trajectories, while the shaded regions indicate different airspace sectors, with altitude levels denoted by color gradients.
Figure 4. Real-time air traffic trajectories and sector distribution on 5 February 2024 in Chinese national airspace. The red lines represent flight trajectories, while the shaded regions indicate different airspace sectors, with altitude levels denoted by color gradients.
Aerospace 11 00966 g004
Figure 5. Zoomed view of terminal area air traffic flow and sectors. This image provides a zoomed-in view of the terminal area air traffic flow and sector distribution in Chengdu on 5 February 2024. The red trajectories represent individual flight paths, while the colored regions denote different airspace sectors in the Chengdu ACC (ZUUU).
Figure 5. Zoomed view of terminal area air traffic flow and sectors. This image provides a zoomed-in view of the terminal area air traffic flow and sector distribution in Chengdu on 5 February 2024. The red trajectories represent individual flight paths, while the colored regions denote different airspace sectors in the Chengdu ACC (ZUUU).
Aerospace 11 00966 g005
Figure 6. Comparison of training loss and accuracy. The left graph shows the training loss over 100 epochs, with all methods converging after initial fluctuations, achieving a low loss value. The right graph illustrates training accuracy, where all methods demonstrate a similar upward trend, stabilizing around 100 epochs with accuracy nearing 1.0.
Figure 6. Comparison of training loss and accuracy. The left graph shows the training loss over 100 epochs, with all methods converging after initial fluctuations, achieving a low loss value. The right graph illustrates training accuracy, where all methods demonstrate a similar upward trend, stabilizing around 100 epochs with accuracy nearing 1.0.
Aerospace 11 00966 g006
Figure 7. Number of delayed flights and average delay time. The y-axis represents the delay time in seconds, and the x-axis corresponds to individual flight numbers. Each blue bar indicates the delay duration of a specific flight, with a red dashed line marking the average delay of 1386.56 s.
Figure 7. Number of delayed flights and average delay time. The y-axis represents the delay time in seconds, and the x-axis corresponds to individual flight numbers. Each blue bar indicates the delay duration of a specific flight, with a red dashed line marking the average delay of 1386.56 s.
Aerospace 11 00966 g007
Figure 8. Demand and capacity balancing within NN-DCB. The top graph shows the initial state, where the blue bars represent demand and the red line indicates sector capacity. Significant demand spikes can be observed. The bottom graph illustrates the optimized state, where demand has been adjusted to remain consistently below capacity across all sectors.
Figure 8. Demand and capacity balancing within NN-DCB. The top graph shows the initial state, where the blue bars represent demand and the red line indicates sector capacity. Significant demand spikes can be observed. The bottom graph illustrates the optimized state, where demand has been adjusted to remain consistently below capacity across all sectors.
Aerospace 11 00966 g008
Figure 9. Computing time and flight scale comparison of various demand-capacity balancing methods.
Figure 9. Computing time and flight scale comparison of various demand-capacity balancing methods.
Aerospace 11 00966 g009
Figure 10. The NN-DCB model’s performance metrics.
Figure 10. The NN-DCB model’s performance metrics.
Aerospace 11 00966 g010
Table 1. Comparison of DCB methods incorporating deep learning and reinforcement learning methods.
Table 1. Comparison of DCB methods incorporating deep learning and reinforcement learning methods.
MethodsRL MethodDeep LearningATFM MethodSector Opening SchemeUncertaintyFairnessExperimental ScenarioFlight Scale (103)Sector Scale
Real WorldHotspots
Kravaris [24]Q-learning/GDPs××××N/A116
Duong [26]Q-learning/GDPs×××N/A0.4N/A
Agogino [23]DQN/GDPs××××54316
Huang [27]A3C/GDPs×××318.2356
Agogino [23]TD-learning/MIT×××N/A1.3N/A
Spatharis [25]Q-learning/GDPs××536169
Tang [15]PPO/GDPs×××318.2356
Chen [16]DQN/GDPs××18612396
Ours/SCIPGDPs×××12015.9287
Current related studies summary.Most studies adopt reinforcement learning (RL) methods and ground delay program (GDP) strategies. However, many of these studies do not consider the effects of fairness and uncertainty. Additionally, the majority of research focuses on small-scale flight operations, with experimental scenarios that are typically far removed from real-world conditions.
Table 2. Notations used in this paper and their descriptions.
Table 2. Notations used in this paper and their descriptions.
No.NotationsDescriptions
1 f F set of flights
2 j J set of elementary sectors
3 t T set of time moments
4 τ Y set of time periods
5 l L set of operating sectors
6 J f subset of elementary sectors flight f traverses
7 T f j subset of time feasible for flight f entering elementary sector j
8 T τ subset of time moments subject to time period τ
9 L τ subset of operating sectors opened in time period τ
10 L j subset of operating sectors constructed by elementary sector j
11 J f , t τ 1st elementary sector for flight f that functions in operating
sector l in time period τ
12 J f i ith elementary sector for flight f
13 t ^ f j j scheduled flight time of segment j j for flight f
14 c l τ capacity of operating sector l during time period τ
Table 3. Exhibition of data structure from Variflight.
Table 3. Exhibition of data structure from Variflight.
CategoryData
Flight NumberZH9087
Origin AirportSZX
Destination AirportHAN
Aircraft NumberB8079
Flight typeA320-200
Scheduled Departure5 February 2024 0:05
Scheduled Arrival5 February 2024 1:00
Actual Departure5 February 2024 0:23
Actual Arrival5 February 2024 1:00
Flight Time5 February 2024 0:13
Speed12.96399975
Vertical speed−64
Angle331
Height0
Longitude113.8068924
Latitude22.64029503
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, Y.; Zhao, Y.; Fei, F.; Yang, H. Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks. Aerospace 2024, 11, 966. https://doi.org/10.3390/aerospace11120966

AMA Style

Chen Y, Zhao Y, Fei F, Yang H. Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks. Aerospace. 2024; 11(12):966. https://doi.org/10.3390/aerospace11120966

Chicago/Turabian Style

Chen, Yunxiang, Yifei Zhao, Fan Fei, and Haibo Yang. 2024. "Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks" Aerospace 11, no. 12: 966. https://doi.org/10.3390/aerospace11120966

APA Style

Chen, Y., Zhao, Y., Fei, F., & Yang, H. (2024). Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks. Aerospace, 11(12), 966. https://doi.org/10.3390/aerospace11120966

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop