AERIS让多架无人机在离线数据中学习协同感知与通信,避免试飞风险且性能提升超29%。
AERIS: Offline Policy Improvement for Multi-UAV Integrated Sensing and Communication

- 基于离线日志训练,中央学全局信息,各无人机本地执行决策。
- 相比最强基线,任务回报提升29.3%,碰撞风险下降54.2%。
- 适合需要安全高效无人机协同控制的6G系统研发者。
无人机赋能的通感一体化(ISAC)是6G的重要方向,但动态多无人机协同控制需在随机移动下兼顾通信质量、感知可靠性和飞行安全。现有优化方法常需反复求解全局非凸问题,而在线强化学习依赖高风险试飞,易引发感知丢失或碰撞。本文提出AERIS,一种面向多无人机通感一体化的离线策略改进框架。AERIS在集中训练、分散执行模式下从固定飞行日志中学习,各无人机依据本地历史决策,训练时利用日志中的全局信息评估团队效果。进一步设计了STAR-CRDT算法,实现支持感知的局部动作修正,并仅将可信改进注入分布式执行器。理论上证明了离线支持下的策略改进保证。实验表明,STAR-CRDT相较最强基线,主目标回报提升29.3%;通信总速率提升3.4%,感知通过率提升4.8%,感知裕度提升69.1%,碰撞风险事件减少54.2%。在基于OpenStreetMap构建的未见真实道路地图上,仍取得最优回报。
原文摘要 · Abstract (English)
Unmanned aerial vehicle (UAV)-enabled integrated sensing and communication (ISAC) is a promising 6G paradigm, but dynamic multi-UAV ISAC control must jointly balance communication quality, sensing reliability, and flight safety under stochastic mobility. Existing optimization methods often require repeated global non-convex solving, while online reinforcement learning (RL) depends on risky trial-and-error flights that may cause sensing loss or collision-risk events. This paper proposes AERIS, an offline policy improvement framework for multi-UAV ISAC. AERIS learns from fixed flight logs under centralized training and decentralized execution, so each UAV acts from local histories while training uses logged global information to assess team-level effects. We further design STAR-CRDT, an offline multi-agent RL algorithm that performs support-aware local action rectification and distills only trusted improvements into the decentralized actor. We prove an offline-support policy improvement guarantee. Experiments show that STAR-CRDT improves the main ISAC objective return by 29.3% over the strongest baseline. It further improves communication sum rate, sensing pass rate, and sensing margin by 3.4%, 4.8%, and 69.1%, while reducing collision-risk events by 54.2%. On unseen real-road maps built from OpenStreetMap data, STAR-CRDT still obtains the best return.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。