arXiv:2504.14100eess.SPcs.AI2025-04被引 30

6G无线基础模型WavesFM统一处理通信、感知与定位,80%参数共享仍保持高性能。

6G WavesFM: A Foundation Model for Sensing, Communication, and Localization

  • 用ViT+MLP架构结合LoRA,实现多任务参数共享,降低计算开销。
  • 在5G定位、信道估计等4项任务中,性能优于独立训练模型。
  • 预训练提升收敛速度,最多缩短5倍训练时间,适合6G系统研发者。

本文提出WavesFM,一种新型无线基础模型(WFM)框架,可支持通信、感知与定位等多种任务。该架构采用共享的视觉变换器(ViT)主干网络,搭配任务特定的多层感知机(MLP)头,并引入低秩适配(LoRA)实现参数高效微调,显著降低计算与内存开销而不牺牲性能。模型处理图像类无线模态,如频谱图、信道状态信息(CSI)以及以正交频分复用(OFDM)资源网格形式排列的同相/正交(IQ)信号。通过在四个下游任务上的广泛实验验证其强泛化能力:第五代新空口(5G NR)定位、多输入多输出OFDM(MIMO-OFDM)信道估计、人体活动感知和射频(RF)信号分类。相比单独训练的监督基线模型,本方法在跨任务共享80%参数的同时,仍取得更优性能。此外,基于领域相关数据预训练不仅提升性能,还加速收敛,训练时间最多减少5倍。结果表明,该统一的无线基础模型能有效支持多样化任务,在性能与效率上均有显著提升,彰显基础模型在下一代6G网络中驱动智能化范式变革的巨大潜力。

原文摘要 · Abstract (English)

This paper introduces WavesFM, a novel Wireless Foundation Model (WFM) framework, capable of supporting a wide array of communication, sensing, and localization tasks. Our proposed architecture combines a shared Vision Transformer (ViT) backbone with task-specific multi-layer perceptron (MLP) heads and incorporates Low-Rank Adaptation (LoRA) for parameter-efficient fine-tuning. This design promotes full parameter sharing across tasks, significantly reducing the computational and memory footprint without sacrificing performance. The model processes both image-like wireless modalities, such as spectrograms and channel state information (CSI), and in-phase and quadrature (IQ) signals arranged as orthogonal frequency-division multiplexing (OFDM) resource grids. We demonstrate the strong generalization capabilities of WavesFM through extensive experiments on four downstream tasks: Fifth Generation New Radio (5G NR) positioning; multiple-input multiple-output OFDM (MIMO-OFDM) channel estimation; human activity sensing; and radio-frequency (RF) signal classification. Compared to supervised baselines trained individually, our approach achieves superior performance while sharing 80% of its parameters across tasks. Furthermore, we show that pretraining on domain-relevant data not only boosts performance but also accelerates convergence, reducing training time by up to 5x. These results demonstrate that our unified WFM can support diverse tasks and deliver significant gains in both performance and efficiency, highlighting the transformative potential of foundation models to drive AI-native paradigms in future sixth-generation (6G) networks.

6G基础模型无线感知参数共享

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。