Previous Article in Journal
Fly-around-the-World Near-Space Picosatellite for Cost-Effective School Space Projects
Previous Article in Special Issue
Data-Driven-Method-Based Guidance Law for Impact Time and Angle Constraints
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

Deep Reinforcement Learning-Based Differential Game Guidance Law against Maneuvering Evaders

School of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an 710049, China
*
Author to whom correspondence should be addressed.
Aerospace 2024, 11(7), 558; https://doi.org/10.3390/aerospace11070558 (registering DOI)
Submission received: 8 May 2024 / Revised: 28 June 2024 / Accepted: 4 July 2024 / Published: 6 July 2024
(This article belongs to the Special Issue Dynamics, Guidance and Control of Aerospace Vehicles)

Abstract

To achieve the intelligent interception of different types of maneuvering evaders, based on deep reinforcement learning, a novel intelligent differential game guidance law is proposed in the continuous action domain. Different from traditional guidance laws, the proposed guidance law can avoid tedious manual settings and save cost efforts. First, the interception problem is transformed into the pursuit–evasion game problem, which is solved by zero-sum differential game theory. Next, the Nash equilibrium strategy is obtained through the Markov game process. To implement the proposed intelligent differential game guidance law, an actor–critic neural network based on deep deterministic policy gradient is constructed to calculate the saddle point of the differential game guidance problem. Then, a reward function is designed, which includes the tradeoffs among guidance accuracy, energy consumption, and interception time. Finally, compared with traditional methods, the interception accuracy of the proposed intelligent differential game guidance law is 99.2%, energy consumption is reduced by 47%, and simulation time is shortened by 1.58 s. All results reveal that the proposed intelligent differential game guidance law has better intelligent decision-making ability.
Keywords: differential game guidance law; deep reinforcement learning; pursuit–evasion game; deep deterministic policy gradient differential game guidance law; deep reinforcement learning; pursuit–evasion game; deep deterministic policy gradient

Share and Cite

MDPI and ACS Style

Xi, A.; Cai, Y. Deep Reinforcement Learning-Based Differential Game Guidance Law against Maneuvering Evaders. Aerospace 2024, 11, 558. https://doi.org/10.3390/aerospace11070558

AMA Style

Xi A, Cai Y. Deep Reinforcement Learning-Based Differential Game Guidance Law against Maneuvering Evaders. Aerospace. 2024; 11(7):558. https://doi.org/10.3390/aerospace11070558

Chicago/Turabian Style

Xi, Axing, and Yuanli Cai. 2024. "Deep Reinforcement Learning-Based Differential Game Guidance Law against Maneuvering Evaders" Aerospace 11, no. 7: 558. https://doi.org/10.3390/aerospace11070558

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop