用噪声导频直接训练,实现低延迟无线信道表征学习
PilotWiMAE: Pilot-Native Representation Learning for Wireless Channels

- 直接处理噪声导频,通过时频分离注意力机制建模信道物理特性
- 99%掩码率下仍保持强表征能力,跨频段性能优于监督基线
- 适合通信系统中资源受限场景的高效信道建模与预训练
现有信道基础模型依赖完整信道状态信息(CSI),但实际部署中难以满足。本文提出PilotWiMAE,一种自监督框架,其编码器直接输入含噪导频观测,注意力机制沿时间与空频联合处理轴分解,体现问题物理先验。导频输入将观测空间缩小两个数量级,避免全量CSI假设,同时降低延迟。分块设计利用信道可分结构,支持高达99%的预训练掩码率。采用补丁归一化重建捕捉小尺度衰落,辅以辅助尺度损失恢复大尺度衰落特征,并通过AWGN课程学习匹配训练与部署时的导频噪声。仅在3.5 GHz预训练,评估于28 GHz下的分布内与分布外场景,其跨频段波束选择与信道表征优于监督基线。为解耦解码器容量与表征质量,进一步提出解码器中心预训练阶段,使模型在不牺牲表征能力的前提下,实现有竞争力的信道估计。我们开源了PilotWiMAE预训练权重、训练流程,以及基于Sionna的射线追踪工具CSIGen和本研究使用的信道数据集。
原文摘要 · Abstract (English)
Channel foundation models assume access to fully observed channels, an assumption that fails in deployment. We introduce PilotWiMAE, a self-supervised framework whose encoder ingests noisy pilot observations directly and whose attention factorizes along the axis separating temporal from joint space-frequency processing, an inductive bias inspired by the physics of the problem. Pilot input shrinks the observation space by up to two orders of magnitude and also removes the unrealistic assumption of full-CSI availability while incurring lower latency. The factorized design generates robust representations by exploiting the separable channel structure and allows a pretraining mask ratio of $99\%$. We pair patch-normalized reconstruction, which captures small-scale fading structure, with an auxiliary scale loss that recovers the large-scale fading features, and use an AWGN curriculum to match pilot noise at pretraining and deployment. Pretrained solely on $3.5$\,GHz and evaluated at $28$\,GHz across in-distribution and out-of-distribution settings, PilotWiMAE's cross-frequency beam selection and channel characterization beat supervised baselines despite operating on a smaller observation space. To weaken the coupling between decoder capacity and representation quality, we further propose a decoder-centric pretraining stage following the encoder-decoder joint pretraining, which allows PilotWiMAE to demonstrate competitive channel estimation without sacrificing representation quality. To foster further work in this direction, we release the PilotWiMAE pretrained weights and training pipeline, together with CSIGen, our Sionna-based ray-tracing channel-generation tool, and the channel datasets used in this work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。