arXiv:2502.04963cs.LGcs.AI2025-02中稿 · IEEE Transactions …被引 2

用粗粒度频谱预测加速智能抗干扰,训练效率提升70%

Fast Adaptive Anti-Jamming Channel Access via Deep Q Learning and Coarse-Grained Spectrum Prediction

  • 引入粗粒度频谱预测作为辅助任务,加速DQN学习
  • 训练次数减少70%,吞吐量比纳什均衡策略高10%
  • 适合动态干扰环境下的快速自适应频段接入场景

本文研究复杂未知干扰环境下抗干扰信道接入问题,面对可动态调整策略的干扰者,传统固定跳频方法失效。尽管基于深度强化学习(DRL)的动态接入方法能在快速变化的干扰下达到纳什均衡(NE),但需大量训练周期。为此,提出一种“比干扰者学得更快”的快速自适应抗干扰接入方法,利用同步更新的粗粒度频谱预测作为深度Q网络(DQN)的辅助任务,帮助模型更快收敛至更优Q函数,显著减少训练轮次。数值结果表明,该方法将模型训练收敛速度大幅提升,训练周期最多减少70%;同时,在吞吐量上相较NE策略提升10%,得益于有效利用粗粒度频谱预测。

原文摘要 · Abstract (English)

This paper investigates the anti-jamming channel access problem in complex and unknown jamming environments, where the jammer could dynamically adjust its strategies to target different channels. Traditional channel hopping anti-jamming approaches using fixed patterns are ineffective against such dynamic jamming attacks. Although the emerging deep reinforcement learning (DRL) based dynamic channel access approach could achieve the Nash equilibrium (NE) under fast-changing jamming attacks, it requires extensive training episodes. To address this issue, we propose a fast adaptive anti-jamming channel access approach guided by the intuition of ``learning faster than the jammer", where a synchronously updated coarse-grained spectrum prediction serves as an auxiliary task for the deep Q network (DQN) based anti-jamming model. This helps the model identify a superior Q-function compared to standard DRL while significantly reducing the number of training episodes. Numerical results indicate that the proposed approach significantly accelerates the rate of convergence in model training, reducing the required training episodes by up to 70\% compared to standard DRL. Additionally, it also achieves a 10\% improvement in throughput over NE strategies, owing to the effective use of coarse-grained spectrum prediction.

抗干扰强化学习频谱预测DQN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。