Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks
Abstract
:1. Introduction
- We successfully developed a deep neural network to obtain optimal solutions for large-scale ATFM problems, which addresses demand-and-capacity balancing within the ATFM framework;
- Our experiments focus on the complexity of real-world operational scenarios. We sourced data from Variflight and other reliable platforms, using large-scale flight trajectory data to train the model and ensure robust outcomes;
- Simulation results demonstrate that our method achieves the shortest solution time for real-time ATFM problems. The algorithms can determine the optimal delay times for each aircraft within 15 min, which holds significant practical value for real-world applications.
2. Related Work
2.1. Mixed-Integer Problems Based on Deep Learning
2.2. Mixed-Integer Problems Based on Neural Network
3. Methodology
3.1. Overview
3.2. NN-DCB
3.3. Training Details
3.3.1. Training Algorithm
Algorithm 1 Learning to solve DCB problems |
1: Initialize best schedule 2: Initialize best delay 3: for = 1 to do: 4: 5: // Neural Diving Phase 6: for in do: 7: delay_prediction = ND () 8: Explore delay: delay = delay_prediction + (1-) random_delay() 9: Apply delay: delay 10: end for 11: // Neural Branching Phase 12: for in do: 13: branch_decision = NB () 14: if branch_decision [0] > 0.5 then 15: = small_delay 16: end if 17: if branch_decision [1] > 0.5 then 18: = small_delay 19: end if 20: end for 21: // Constraint Check and Best Schedule Update 22: if check_constraints (, C) then 23: calculate_average_delay(, D) 24: if then 25: 26: 27: end if 28: end if 29: Update based on optimization performance 30: end for 31: Output: Optimized schedule and best average delay |
3.3.2. Training Scenarios
4. Experimental
4.1. Data Preprocessing
4.2. Experimental Results
4.3. Flight Delays Distribution
4.4. Comparison with State-of-Art RL-Based and Traditional DCB Methods
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Chen, Y.; Zhao, Y.; Wu, Y. Recent progress in air traffic flow management: A review. J. Air Transp. Manag. 2024, 116, 102573. [Google Scholar] [CrossRef]
- International Civil Aviation Organization. Global Air Navigation Plan for CNS/ATM Systems; ICAO: Montreal, QC, Canada, 2002. [Google Scholar]
- International Civil Aviation Organization. Global Air Traffic Management Operational Concept; ICAO: Montreal, QC, Canada, 2005. [Google Scholar]
- International Civil Aviation Organization. The Aviation System Block Upgrades, The Framework for Global Harmonization; ICAO: Montreal, QC, Canada, 2016. [Google Scholar]
- SESAR Joint Undertaking. European ATM Master Plan-The Roadmap for Sustainable Air Traffic Management; SESAR Joint Undertaking: Brussels, Belgium, 2012. [Google Scholar]
- Degas, A.; Islam, M.R.; Hurter, C.; Barua, S.; Rahman, H.; Poudel, M.; Ruscio, D.; Ahmed, M.U.; Begum, S.; Rahman, M.A.; et al. A survey on artificial intelligence (AI) and explainable AI in air traffic management: Current trends and development with future research trajectory. Appl. Sci. 2022, 12, 1295. [Google Scholar] [CrossRef]
- Yang, H.; Alphones, A.; Xiong, Z.; Niyato, D.; Zhao, J.; Wu, K. Artificial-intelligence-enabled intelligent 6G networks. IEEE Netw. 2020, 34, 272–280. [Google Scholar] [CrossRef]
- IBM ILOG CPLEX Optimization Studio, Version 12.10.0, IBM Corp. Available online: https://www.ibm.com/docs/en/icos/12.10.0 (accessed on 1 November 2024).
- Gurobi Optimizer. Gurobi 12.0 Documentation. Available online: https://docs.gurobi.com/current/ (accessed on 1 November 2024).
- Forrest, J.; Lougee-Heimer, R. CBC user guide. In Emerging Theory, Methods, and Applications; INFORMS: Catonsville, MD, USA, 2005; pp. 257–277. [Google Scholar]
- Holmström, K.; Göran, A.O.; Edvall, M.M. USER’S GUIDE FOR TOMLAB/Xpress R2004; Tomlab Optimization Inc.: San Diego, CA, USA, 2007. [Google Scholar]
- Nair, V.; Bartunov, S.; Gimeno, F.; Von Glehn, I.; Lichocki, P.; Lobov, I.; O’Donoghue, B.; Sonnerat, N.; Tjandraatmadja, C.; Wang, P.; et al. Solving mixed integer programs using neural networks. arXiv 2020, arXiv:2012.13349. [Google Scholar]
- Xu, Y.; Dalmau, R.; Melgosa, M.; Montlaur, A.; Prats, X. A framework for collaborative air traffic flow management minimizing costs for airspace users: Enabling trajectory options and flexible pre-tactical delay management. Transp. Res. Part B Methodol. 2020, 134, 229–255. [Google Scholar] [CrossRef]
- Xu, Y.; Prats, X.; Delahaye, D. Synchronised demand-capacity balancing in collaborative air traffic flow management. Transp. Res. Part C Emerg. Technol. 2020, 114, 359–376. [Google Scholar] [CrossRef]
- Tang, Y.; Xu, Y. Multi-agent deep reinforcement learning for solving large-scale air traffic flow management problem: A time-step sequential decision approach. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–10. [Google Scholar]
- Chen, Y.; Xu, Y.; Hu, M.; Yang, L. Demand and capacity balancing technology based on multi-agent reinforcement learning. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–9. [Google Scholar]
- Yutong, C.; Minghua, H.; Yan, X.; Lei, Y. Locally generalised multi-agent reinforcement learning for demand and capacity balancing with customised neural networks. Chin. J. Aeronaut. 2023, 36, 338–353. [Google Scholar]
- Crespo, A.M.F.; Weigang, L.; de Barros, A.G. Reinforcement learning agents to tactical air traffic flow management. Int. J. Aviat. Manag. 2012, 1, 145–161. [Google Scholar] [CrossRef]
- Kravaris, T.; Spatharis, C.; Blekas, K.; Vouros, G.A.; Garcia, J.M.C. Multiagent reinforcement learning methods for resolving demand-capacity imbalances. In Proceedings of the 2018 IEEE/AIAA 37th Digital Avionics Systems Conference (DASC), London, UK, 23–27 September 2018; pp. 1–10. [Google Scholar]
- Spatharis, C.; Blekas, K.; Bastas, A.; Kravaris, T.; Vouros, G.A. Collaborative multiagent reinforcement learning schemes for air traffic management. In Proceedings of the 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA), Patras, Greece, 15–17 July 2019; pp. 1–8. [Google Scholar]
- Spatharis, C.; Bastas, A.; Kravaris, T.; Blekas, K.; Vouros, G.A.; Cordero, J.M. Hierarchical multiagent reinforcement learning schemes for air traffic management. Neural Comput. Appl. 2023, 35, 147–159. [Google Scholar] [CrossRef]
- Mas-Pujol, S.; Salamí, E.; Pastor, E. Image-based multi-agent reinforcement learning for demand–capacity balancing. Aerospace 2022, 9, 599. [Google Scholar] [CrossRef]
- Agogino, A.K.; Tumer, K. A multiagent approach to managing air traffic flow. Auton. Agents Multi-Agent Syst. 2012, 24, 1–25. [Google Scholar] [CrossRef]
- Kravaris, T.; Vouros, G.A.; Spatharis, C.; Blekas, K.; Chalkiadakis, G.; Garcia, J.M.C. Learning policies for resolving demand- capacity imbalances during pre-tactical air traffic management. In Proceedings of the Multiagent System Technologies: 15th German Conference, MATES 2017, Leipzig, Germany, 23–26 August 2017; Proceedings 15. Springer: Cham, Switzerland, 2017; pp. 238–255. [Google Scholar]
- Spatharis, C.; Kravaris, T.; Vouros, G.A.; Blekas, K.; Chalkiadakis, G.; Garcia, J.M.C.; Fernandez, E.C. Multiagent reinforcement learning methods to resolve demand capacity balance problems. In Proceedings of the 10th Hellenic Conference on Artificial Intelligence, Patras, Greece, 9–12 July 2018; pp. 1–9. [Google Scholar]
- Duong, T.; Todi, K.K.; Chaudhary, U.; Truong, H.L. Decentralizing air traffic flow management with blockchain-based reinforcement learning. In Proceedings of the 2019 IEEE 17th International Conference on Industrial Informatics (INDIN), Helsinki, Finland, 22–25 July 2019; Volume 1, pp. 1795–1800. [Google Scholar]
- Huang, C.; Xu, Y. Integrated frameworks of unsupervised, supervised and reinforcement learning for solving air traffic flow management problem. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–10. [Google Scholar]
- Bengio, Y.; Lodi, A.; Prouvost, A. Machine learning for combinatorial optimization: A methodological tour d’horizon. Eur. J. Oper. Res. 2021, 290, 405–421. [Google Scholar] [CrossRef]
- Achterberg, T. SCIP: Solving constraint integer programs. Math. Program. Comput. 2009, 1, 1–41. [Google Scholar] [CrossRef]
- Khalil, E.; Le Bodic, P.; Song, L.; Nemhauser, G.; Dilkina, B. Learning to branch in mixed integer programming. Proc. AAAI Conf. Artif. Intelligence 2016, 30, 1. [Google Scholar] [CrossRef]
- Fischetti, M.; Jo, J. Deep neural networks and mixed integer linear optimization. Constraints 2018, 23, 296–309. [Google Scholar] [CrossRef]
Methods | RL Method | Deep Learning | ATFM Method | Sector Opening Scheme | Uncertainty | Fairness | Experimental Scenario | Flight Scale (103) | Sector Scale | |
---|---|---|---|---|---|---|---|---|---|---|
Real World | Hotspots | |||||||||
Kravaris [24] | Q-learning | / | GDPs | × | × | × | × | N/A | 1 | 16 |
Duong [26] | Q-learning | / | GDPs | × | × | × | ✓ | N/A | 0.4 | N/A |
Agogino [23] | DQN | / | GDPs | × | × | × | × | 54 | 3 | 16 |
Huang [27] | A3C | / | GDPs | × | × | × | ✓ | 31 | 8.2 | 356 |
Agogino [23] | TD-learning | / | MIT | × | × | × | ✓ | N/A | 1.3 | N/A |
Spatharis [25] | Q-learning | / | GDPs | ✓ | × | × | ✓ | 53 | 6 | 169 |
Tang [15] | PPO | / | GDPs | × | × | × | ✓ | 31 | 8.2 | 356 |
Chen [16] | DQN | / | GDPs | ✓ | × | × | ✓ | 186 | 12 | 396 |
Ours | / | SCIP | GDPs | × | × | × | ✓ | 120 | 15.9 | 287 |
Current related studies summary. | Most studies adopt reinforcement learning (RL) methods and ground delay program (GDP) strategies. However, many of these studies do not consider the effects of fairness and uncertainty. Additionally, the majority of research focuses on small-scale flight operations, with experimental scenarios that are typically far removed from real-world conditions. |
No. | Notations | Descriptions |
---|---|---|
1 | set of flights | |
2 | set of elementary sectors | |
3 | set of time moments | |
4 | set of time periods | |
5 | set of operating sectors | |
6 | subset of elementary sectors flight traverses | |
7 | subset of time feasible for flight entering elementary sector | |
8 | subset of time moments subject to time period | |
9 | subset of operating sectors opened in time period | |
10 | subset of operating sectors constructed by elementary sector | |
11 | 1st elementary sector for flight that functions in operating sector in time period | |
12 | ith elementary sector for flight | |
13 | scheduled flight time of segment for flight | |
14 | capacity of operating sector during time period |
Category | Data |
---|---|
Flight Number | ZH9087 |
Origin Airport | SZX |
Destination Airport | HAN |
Aircraft Number | B8079 |
Flight type | A320-200 |
Scheduled Departure | 5 February 2024 0:05 |
Scheduled Arrival | 5 February 2024 1:00 |
Actual Departure | 5 February 2024 0:23 |
Actual Arrival | 5 February 2024 1:00 |
Flight Time | 5 February 2024 0:13 |
Speed | 12.96399975 |
Vertical speed | −64 |
Angle | 331 |
Height | 0 |
Longitude | 113.8068924 |
Latitude | 22.64029503 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Chen, Y.; Zhao, Y.; Fei, F.; Yang, H. Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks. Aerospace 2024, 11, 966. https://doi.org/10.3390/aerospace11120966
Chen Y, Zhao Y, Fei F, Yang H. Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks. Aerospace. 2024; 11(12):966. https://doi.org/10.3390/aerospace11120966
Chicago/Turabian StyleChen, Yunxiang, Yifei Zhao, Fan Fei, and Haibo Yang. 2024. "Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks" Aerospace 11, no. 12: 966. https://doi.org/10.3390/aerospace11120966
APA StyleChen, Y., Zhao, Y., Fei, F., & Yang, H. (2024). Optimizing Large-Scale Demand and Capacity Balancing in Air Traffic Flow Management Using Deep Neural Networks. Aerospace, 11(12), 966. https://doi.org/10.3390/aerospace11120966