用脉冲神经网络提升无线模型抗噪能力,实现更可靠的信道预测。
SpikeWFM: Spiking-Aided Wireless Foundation Model for Robust Channel Prediction

- 融合脉冲神经网络与Transformer,利用事件驱动机制增强抗干扰性。
- 在预训练收敛速度和信道预测精度上均优于传统ANN模型。
- 适合需要高鲁棒性的无线通信与感知系统应用。
本文提出SpikeWFM,一种将脉冲神经网络(SNN)与基于Transformer的通用无线模型(WFM)相结合的新型混合架构。受人脑噪声鲁棒且能效高的信息处理机制启发,SpikeWFM旨在提升WFM在复杂无线环境中的抗噪与抗干扰能力,同时保持对多样化场景的强大泛化性能。借鉴大语言模型的成功经验,WFM通过大规模跨环境数据集进行自监督预训练,学习统一嵌入表示,支持信道预测、信道估计、波束预测、定位等下游任务,显著优于专用模型并具备更强的未见条件适应能力。然而,现有WFM在真实无线系统中仍易受噪声和干扰影响。为此,本文将脉冲神经元引入Transformer架构,并提供简要理论分析,说明该混合结构如何通过时间稀疏性和事件驱动机制有效抑制噪声与干扰。实验结果表明,SpikeWFM在预训练收敛速度和信道预测精度方面均持续优于传统基于ANN的WFM。通信与感知任务的附加结果将在完整期刊版本中展示。
原文摘要 · Abstract (English)
This paper proposes SpikeWFM, a novel hybrid architecture that integrates spiking neural networks (SNNs) with conventional artificial neural network (ANN)-based transformers for wireless foundation models (WFMs). Inspired by the noise-robust and energy-efficient information processing in the human brain, SpikeWFM aims to enhance the resilience of WFMs against noise and interference while maintaining strong generalization capabilities across diverse wireless scenarios. Drawing from the success of large language models, WFMs leverage self-supervised pre-training on large-scale datasets spanning various wireless environments to learn a unified embedding that supports a wide range of downstream tasks, including channel prediction, channel estimation, beam predition, positioning and etc. Such models typically outperform task-specific designs and exhibit superior adaptability to unseen conditions. However, existing WFMs remain vulnerable to realistic noise and interference in practical wireless systems. To address this limitation, we incorporate spiking neurons into the transformer-based WFM architecture. We provide a brief theoretical analysis demonstrating how the SNN-ANN hybrid effectively mitigates noise and interference through temporal sparsity and event-driven processing. Experimental results show that SpikeWFM consistently outperforms conventional ANN-based WFMs in both pre-training convergence and channel prediction accuracy. Additional results on communication and sensing tasks will be presented in the full journal version of this work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。