用强化学习让无人机群自适应抗干扰,通信更稳。
Coordinated Anti-Jamming Resilience in Swarm Networks via Multi-Agent Reinforcement Learning
- 多智能体强化学习协同选频调功率,动态应对干扰者。
- 仿真中吞吐量更高,干扰发生率比基线低近一半。
- 适合研究无人机编队、对抗环境下的通信安全。
主动干扰者通过检测总功率并针对性地破坏无人机群间的通信,严重威胁编队完整性和任务成功率。传统固定功率控制或静态跳频方法对此类自适应攻击无效。本文提出基于QMIX算法的多智能体强化学习框架,提升蜂群在主动干扰下的通信韧性。考虑多个收发对共享信道,干扰者具有马尔可夫阈值动态特性,能感知聚合功率并作出响应。各智能体联合选择发射频率(信道)与功率,QMIX学习一个中心化但可分解的动作价值函数,实现协同决策与去中心化执行。在无信道复用场景下,以理想最优策略为基准;在支持信道复用的通用衰落环境下,对比局部上置信界(UCB)和无状态反应策略。仿真结果表明,QMIX能快速收敛至接近理想边界的合作策略,在吞吐量和抗干扰能力上显著优于基线,验证了多智能体强化学习在对抗环境中保障自主蜂群通信的有效性。
原文摘要 · Abstract (English)
Reactive jammers pose a severe security threat to robotic-swarm networks by selectively disrupting inter-agent communications and undermining formation integrity and mission success. Conventional countermeasures such as fixed power control or static channel hopping are largely ineffective against such adaptive adversaries. This paper presents a multi-agent reinforcement learning (MARL) framework based on the QMIX algorithm to improve the resilience of swarm communications under reactive jamming. We consider a network of multiple transmitter-receiver pairs sharing channels while a reactive jammer with Markovian threshold dynamics senses aggregate power and reacts accordingly. Each agent jointly selects transmit frequency (channel) and power, and QMIX learns a centralized but factorizable action-value function that enables coordinated yet decentralized execution. We benchmark QMIX against a genie-aided optimal policy in a no-channel-reuse setting, and against local Upper Confidence Bound (UCB) and a stateless reactive policy in a more general fading regime with channel reuse enabled. Simulation results show that QMIX rapidly converges to cooperative policies that nearly match the genie-aided bound, while achieving higher throughput and lower jamming incidence than the baselines, thereby demonstrating MARL's effectiveness for securing autonomous swarms in contested environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。