Two-stage pursuit strategy for incomplete-information impulsive space pursuit-evasion mission using reinforcement learning

Yang, Bin and Liu, Pengxuan and Feng, Jinglang and Li, Shuang (2021) Two-stage pursuit strategy for incomplete-information impulsive space pursuit-evasion mission using reinforcement learning. Aerospace, 8 (10). 299. ISSN 2226-4310 (https://doi.org/10.3390/aerospace8100299)

[thumbnail of Yang-etal-Aerospace-2021-Two-stage-pursuit-strategy-for-incomplete-information-impulsive-space-pursuit-evasion-mission]
Preview
 Text. Filename: Yang_etal_Aerospace_2021_Two_stage_pursuit_strategy_for_incomplete_information_impulsive_space_pursuit_evasion_mission.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (2MB)| Preview

Abstract

This paper presents a novel and robust two-stage pursuit strategy for the incomplete-information impulsive space pursuit-evasion missions considering the J2 perturbation. The strategy firstly models the impulsive pursuit-evasion game problem into a far-distance rendezvous stage and a close-distance game stage according to the perception range of the evader. For the far-distance rendezvous stage, it is transformed into a rendezvous trajectory optimization problem and a new objective function is proposed to obtain the pursuit trajectory with the optimal terminal pursuit capability. For the close-distance game stage, a closed-loop pursuit approach is proposed using one of the reinforcement learning algorithms, i.e. the deep deterministic policy gradient algorithm, to solve and update the pursuit trajectory for the incomplete-information impulsive pursuit-evasion missions. The feasibility of this novel strategy and its robustness to different initial states of the pursuer and evader and to the evasion strategies are demonstrated for the sun-synchronous orbit pursuit-evasion game scenarios. The results of the Monte Carlo tests show that the successful pursuit ratio of the proposed method is over 91% for all the given scenarios

ORCID iDs

Yang, Bin, Liu, Pengxuan, Feng, Jinglang ORCID logoORCID: https://orcid.org/0000-0003-0376-886X and Li, Shuang;
CORE (COnnecting REpositories)