Publications
Sort:
Open Access Issue
A review of reinforcement learning approaches for pursuit-evasion games
Chinese Journal of Aeronautics 2026, 39(6)
Published: 11 November 2025
Abstract Collect

As a special type of dynamic game, Pursuit-Evasion Games (PEGs) have expanded their application range from initial military confrontations to areas such as navigation control and aerospace, demonstrating broad applicability and significant value in addressing a wide array of modern complex decision-making problems. Traditional optimal control methods based on differential game theory are classic approaches to solve PEG problems. However, these methods often struggle to perform well in complex environments, nonlinear systems, and situations involving highly uncertain participant behaviors. In recent years, rapidly developing Reinforcement Learning (RL) techniques has provided new avenues for PEG research. RL is capable of adapting to environmental changes through efficient online computation and feedback-driven learning, exhibiting strong generalization capabilities. Therefore, this survey presents a detailed and systematic review of PEG research based on RL methods. First, it classifies and discusses key RL algorithms and theoretical foundations in PEGs according to different forms of strategy learning. Then, it summarizes typical application scenarios, including tactical combat, unmanned systems control, and spacecraft interception, demonstrating the potential and effectiveness of RL in addressing real-world challenges. Finally, the survey explores current challenges and future opportunities in applying RL to PEGs, with the aim of promoting further research on more effective and practical solutions.

Open Access Review Paper Issue
A Review on the Truck and Drone Cooperative Delivery Problem
Unmanned Systems 2024, 12(5): 823-847
Published: 13 March 2023
Abstract Collect

As an emerging delivery style in logistics, the cooperation between trucks and drones can significantly improve the efficiency of parcel delivery, especially in some typical scenes, such as mountainous areas, high buildings, or post-disaster material delivery. In recent years, the truck and drone cooperative delivery problem (TDCDP) has attracted more and more attention from logistic research and commercial sectors. This paper proposes a taxonomy for TDCDP and systematically summarizes the related research. First, the impacts of changes in customers and environments on truck and drone delivery modes are analyzed in detail. Second, by using the proposed taxonomy, the delivery modes in TDCDP are classified into four types: parallel delivery, mixed delivery, drone delivery with truck-assisting, and truck delivery with drone-assisting. The roles of trucks and drones are analyzed in different scenes. Then, for different delivery modes, this paper summarizes the TDCDP models and analyzes the common assumptions, constraints, and objective functions. This paper also combs the exact algorithms, heuristic algorithms, and hybrid algorithms used to solve different kinds of TDCDP. Finally, the current research status and future research trends are discussed, and the challenges of TDCDP are highlighted.

Total 2