用并行强化学习实现隐蔽通信与智能抗干扰,对抗移动追踪干扰机。
Achieving Hiding and Smart Anti-Jamming Communication: A Parallel DRL Approach against Moving Reactive Jammer
- 设计并行DRL架构分解复杂动作空间,提升决策效率。
- 仿真显示吞吐量较基准提升近90%。
- 适合研究动态干扰环境下智能通信系统的学者。
本文针对移动反应式干扰场景下的抗干扰问题提出解决方案。移动反应式干扰机在侦测到传输信号时启动高功率追踪干扰,无法检测信号时则采用无差别干扰。这带来双重挑战:既要保持隐蔽以避免被侦测,又要规避无差别干扰。扩频技术可降低发射功率以隐藏自身,但难以应对无差别干扰;而频率切换虽能避开无差别干扰,却使通信易受追踪干扰攻击。现有方法因联合动作空间庞大且干扰机动态变化,难以同时优化这两项需求。为此,本文提出一种并行深度强化学习策略,采用并行网络架构分解动作空间,并引入并行探索-利用选择机制替代ε-贪婪机制,加速收敛。仿真结果表明,系统归一化吞吐量提升了近90%。
原文摘要 · Abstract (English)
This paper addresses the challenge of anti-jamming in moving reactive jamming scenarios. The moving reactive jammer initiates high-power tracking jamming upon detecting any transmission activity, and when unable to detect a signal, resorts to indiscriminate jamming. This presents dual imperatives: maintaining hiding to avoid the jammer's detection and simultaneously evading indiscriminate jamming. Spread spectrum techniques effectively reduce transmitting power to elude detection but fall short in countering indiscriminate jamming. Conversely, changing communication frequencies can help evade indiscriminate jamming but makes the transmission vulnerable to tracking jamming without spread spectrum techniques to remain hidden. Current methodologies struggle with the complexity of simultaneously optimizing these two requirements due to the expansive joint action spaces and the dynamics of moving reactive jammers. To address these challenges, we propose a parallelized deep reinforcement learning (DRL) strategy. The approach includes a parallelized network architecture designed to decompose the action space. A parallel exploration-exploitation selection mechanism replaces the $\varepsilon $-greedy mechanism, accelerating convergence. Simulations demonstrate a nearly 90\% increase in normalized throughput.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。