让无人机在传感器被攻击时仍能安全飞行,靠的是学习抗干扰的状态表示。
ARMOR: Robust Reinforcement Learning-based Control for UAVs under Physical Attacks
- 用两阶段训练学出抗攻击的无人机状态表示,不依赖原始传感器数据。
- 在真实攻击下飞行成功率超传统方法,且对未知攻击有更好泛化能力。
- 无需反复对抗训练,降低训练成本,适合实际部署。
无人飞行器(UAV)依赖机载传感器进行感知、导航和控制,但这些传感器易受物理攻击(如GPS欺骗),导致状态估计错误并引发不安全行为。尽管强化学习(RL)具备自适应控制能力,现有安全强化学习方法在面对此类攻击时表现不佳。本文提出ARMOR(Adaptive Robust Manipulation-Optimized State Representations),一种基于模型无关的攻击鲁棒强化学习控制器,可在传感器遭恶意操控时保障无人机稳定运行。该方法不直接使用原始传感器观测,而是通过两阶段训练框架学习鲁棒的潜在状态表示:第一阶段由带特权攻击信息的教师编码器生成攻击感知的潜在状态,用于策略训练;第二阶段通过监督学习训练学生编码器,仅利用历史传感器数据逼近教师输出,实现无需特权信息的真实部署。实验表明,ARMOR显著优于传统方法,在多种攻击场景下均保障了飞行安全,并提升了对未见攻击的泛化能力,同时避免了迭代式对抗训练,大幅降低训练成本。
原文摘要 · Abstract (English)
Unmanned Aerial Vehicles (UAVs) depend on onboard sensors for perception, navigation, and control. However, these sensors are susceptible to physical attacks, such as GPS spoofing, that can corrupt state estimates and lead to unsafe behavior. While reinforcement learning (RL) offers adaptive control capabilities, existing safe RL methods are ineffective against such attacks. We present ARMOR (Adaptive Robust Manipulation-Optimized State Representations), an attack-resilient, model-free RL controller that enables robust UAV operation under adversarial sensor manipulation. Instead of relying on raw sensor observations, ARMOR learns a robust latent representation of the UAV's physical state via a two-stage training framework. In the first stage, a teacher encoder, trained with privileged attack information, generates attack-aware latent states for RL policy training. In the second stage, a student encoder is trained via supervised learning to approximate the teacher's latent states using only historical sensor data, enabling real-world deployment without privileged information. Our experiments show that ARMOR outperforms conventional methods, ensuring UAV safety. Additionally, ARMOR improves generalization to unseen attacks and reduces training cost by eliminating the need for iterative adversarial training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。