通过意图-上下文协同机制,让无人机在对抗环境中更智能地规划路径并减少暴露。
Intent-Context Synergy Reinforcement Learning for Autonomous UAV Decision-Making in Air Combat
- 用LSTM预测敌方轨迹,将反应式躲避转为前瞻性规划
- 分层级任务管理,任务成功率88%,每回合暴露0.24次
- 自适应切换策略,适合高动态空战场景的自主决策
自主无人机在动态对抗环境中的渗透仍面临挑战,主要源于威胁的不完全可观测性以及任务效率与生存性的冲突。传统强化学习方法常出现短视决策,难以实时平衡二者。为此,本文提出意图-上下文协同强化学习(ICS-RL)框架。核心创新包括:(1) 基于LSTM的意图预测模块,预估敌方单位未来轨迹,通过状态增强实现从被动规避到主动规划的范式转变;(2) 上下文分析协同机制,将任务分解为安全巡航、隐秘规划和敌方突破三类子任务。设计异构集成的双头DQN代理,各针对特定战术场景;基于最大优势值的动态切换控制器,无需硬编码规则即可无缝集成,实现策略自适应选择。大量仿真表明,ICS-RL显著优于基线方法(标准DDQN)及传统方法(PSO、博弈论)。该方法达成88%的任务成功率,平均每回合暴露频率降至0.24次,验证了其在高动态场景下保障稳健且隐蔽渗透的优越性。
原文摘要 · Abstract (English)
Autonomous UAV infiltration in dynamic contested environments remains a significant challenge due to the partially observable nature of threats and the conflicting objectives of mission efficiency versus survivability. Traditional Reinforcement Learning (RL) approaches often suffer from myopic decision-making and struggle to balance these trade-offs in real-time. To address these limitations, this paper proposes an Intent-Context Synergy Reinforcement Learning (ICS-RL) framework. The framework introduces two core innovations: (1) An LSTM-based Intent Prediction Module that forecasts the future trajectories of hostile units, transforming the decision paradigm from reactive avoidance to proactive planning via state augmentation; (2) A Context-Analysis Synergy Mechanism that decomposes the mission into hierarchical sub-tasks (safe cruise, stealth planning, and hostile breakthrough). We design a heterogeneous ensemble of Dueling DQN agents, each specialized in a specific tactical context. A dynamic switching controller based on Max-Advantage values seamlessly integrates these agents, allowing the UAV to adaptively select the optimal policy without hard-coded rules. Extensive simulations demonstrate that ICS-RL significantly outperforms baselines (Standard DDQN) and traditional methods (PSO, Game Theory). The proposed method achieves a mission success rate of 88\% and reduces the average exposure frequency to 0.24 per episode, validating its superiority in ensuring robust and stealthy penetration in high-dynamic scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。