arXiv:2508.02742eess.SPcs.AI2025-08中稿 · presentation at th…

用基础模型提升频谱认知,通用性更强更准确

SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling

  • 设计新型编码器融合卷积与自注意力,捕捉频谱细节和全局关系
  • 预训练任务提升泛化能力,下游任务检测率最高提升30%
  • 适配多种场景,特别适合频谱感知、异常检测等实际应用

提升频谱利用效率与安全性关键在于频谱认知。现有方法在不同环境与任务中泛化能力差、精度不足。为此,我们提出频谱基础模型SpectrumFM,开创频谱认知新范式。创新设计频谱编码器,结合卷积神经网络与多头自注意力机制,有效捕捉频谱数据的细粒度局部结构与高层全局依赖。为增强适应性,引入掩码重建与下一时隙信号预测两项自监督学习任务进行预训练,使模型学习到丰富且可迁移的表征。进一步采用低秩适配(LoRA)参数高效微调,实现SpectrumFM对多种下游任务的无缝适配,包括频谱感知(SS)、异常检测(AD)和无线技术分类(WTC)。大量实验表明,SpectrumFM显著优于现有先进方法:在-4 dB信噪比下,SS任务检测概率提升30%;AD任务AUC提升超10%;WTC准确率提高9.6%。

原文摘要 · Abstract (English)

The enhancement of spectrum efficiency and the realization of secure spectrum utilization are critically dependent on spectrum cognition. However, existing spectrum cognition methods often exhibit limited generalization and suboptimal accuracy when deployed across diverse spectrum environments and tasks. To overcome these challenges, we propose a spectrum foundation model, termed SpectrumFM, which provides a new paradigm for spectrum cognition. An innovative spectrum encoder that exploits the convolutional neural networks and the multi-head self attention mechanisms is proposed to effectively capture both fine-grained local signal structures and high-level global dependencies in the spectrum data. To enhance its adaptability, two novel self-supervised learning tasks, namely masked reconstruction and next-slot signal prediction, are developed for pre-training SpectrumFM, enabling the model to learn rich and transferable representations. Furthermore, low-rank adaptation (LoRA) parameter-efficient fine-tuning is exploited to enable SpectrumFM to seamlessly adapt to various downstream spectrum cognition tasks, including spectrum sensing (SS), anomaly detection (AD), and wireless technology classification (WTC). Extensive experiments demonstrate the superiority of SpectrumFM over state-of-the-art methods. Specifically, it improves detection probability in the SS task by 30% at -4 dB signal-to-noise ratio (SNR), boosts the area under the curve (AUC) in the AD task by over 10%, and enhances WTC accuracy by 9.6%.

频谱认知基础模型自监督学习信号处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。