arXiv:2605.00968eess.SPcs.AI2026-05被引 3

为无线信道建模设计动态3D位置编码,显著提升模型泛化能力。

Adaptive 3D-RoPE: Physics-Aligned Rotary Positional Encoding for Wireless Foundation Models

论文配图:Adaptive 3D-RoPE: Physics-Aligned Rotary Positional Encoding for Wireless Foundation Models
图 1 · 摘自论文原文
  • 引入可学习的三维频率库,解耦多维相位依赖关系。
  • 在8倍天线规模外推下,NMSE降低10.7 dB,零样本泛化提升1.07 dB。
  • 适合无线通信、智能信道建模等需要跨场景泛化的研究者。

位置编码对无线基础模型在信道状态信息(CSI)建模、隐式表征和任务特定预测中的外推与泛化性能至关重要。现有CSI模型继承了自然语言与视觉架构中的静态或一维位置先验,与无线信道内在物理特性不匹配,缺乏显式相对衰减,导致三维时空频结构坍缩,且场景适应性差。本文提出Adaptive 3D-RoPE,一种物理对齐的旋转位置编码,为无线基础模型奠定结构基石。该框架结合可学习的轴解耦3D频率库,显式解耦多维相位依赖,并引入轻量级信道条件控制器,通过紧凑的全局CSI描述符动态调制先验。此样本自适应机制将位置编码从静态组件转化为动态、相干感知的归纳偏置,以应对异质信道物理特性。在100个数据集上的大量实验表明,所提方案在尺度外推与零样本泛化上均具优势:在8倍天线规模外推下,归一化均方误差(NMSE)最高降低10.7 dB;相同输入规模下,未见移动场景零样本NMSE提升1.07 dB,低频至毫米波任务提升0.90 dB。

原文摘要 · Abstract (English)

Positional encoding plays a pivotal role in determin?ing the extrapolation and generalization performance of wireless foundation models for channel state information (CSI) modeling, latent characterization, and task-specific prediction. However, existing CSI models inherit static or one-dimensional positional priors from natural language and vision architectures, which fundamentally misalign with the intrinsic physics of wireless channels by lacking explicit relative decay, collapsing the 3D spatio-temporal-frequency structure, and remaining scenario?rigid. This paper proposes Adaptive 3D-RoPE, a physics-aligned rotary positional encoding that establishes the structural corner?stone for wireless foundation models. The framework integrates a learnable, axis-decoupled 3D frequency bank to explicitly disentangle multi-dimensional phase dependencies, coupled with a lightweight channel-conditioned controller that dynamically modulates the prior via compact global CSI descriptors. This sample-adaptive mechanism transforms positional encoding from a static transformer component into a dynamic, coherence-aware inductive bias to resolve heterogeneous channel physics. Extensive experiments across 100 datasets demonstrate the superiority of the proposed scheme in both scale extrapolation and zero-shot generalization. Compared to the state-of-the-art, our method achieves up to a 10.7 dB reduction in normalized mean square error (NMSE) under 8 times antenna scale extrapolation. Given the same CSI input scales, our method can also improve zero-shot NMSE by 1.07 dB across unseen mobility scenarios and 0.90 dB in low-frequency-to-millimeter-wave tasks.

位置编码无线建模基础模型3D结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。