arXiv:2509.08139cs.ITcs.LG2025-09被引 3

用频谱注意力机制让大模型高效预测无线信道变化。

SCA-LLM: Spectral-Attentive LLM-Based Wireless World Modeling for Agentic Communications

  • 设计频谱-信道注意力模块,将信道数据适配大模型序列建模能力。
  • 在多步信道状态预测中实现-2.4 dB NMSE优势,零样本泛化强。
  • 适合智能通信系统、无线网络规划等需要动态感知的场景。

未来人工智能原生无线网络正从被动优化转向具备感知、预测与规划能力的智能体决策。这需要能够预测并推演信道动态的无线世界模型,其中多步信道状态信息(CSI)预测提供了短时前瞻能力。近年来基础序列模型的发展推动了大语言模型(LLM)作为通用动态学习器的应用,但将其适配非文本时间序列信号仍具挑战:有效适配器需揭示信道的频谱与时间演化模式,而现有设计提供的归纳偏置有限。为此,本文提出SCA-LLM框架,通过频谱-信道注意力(SCA)适配器将CSI与LLM连接。SCA适配器进行多频谱表示学习,提取关键信道特征并对齐到LLM的序列建模能力,实现参数高效适配且保持LLM主干基本冻结。大量仿真表明,SCA-LLM达到当前最优预测性能,具备强零样本泛化能力,在与先前基于LLM的方法对比中取得最高达-2.4 dB的归一化均方误差(NMSE)优势。消融实验进一步验证了该适配器在缓解领域错位方面的有效性。

原文摘要 · Abstract (English)

Future AI-native wireless networks are moving from reactive optimization to agentic decision-making that can sense, predict, and plan under fast-varying channels. This calls for wireless world models that can predict and roll out channel dynamics, for which multi-step channel state information (CSI) prediction offers a practical short-horizon look-ahead. Recent advances in foundation sequence models further motivate large language models (LLMs) as general-purpose dynamics learners when suitably adapted to non-text time-series signals. However, bridging CSI to LLMs is non-trivial because an effective adapter must expose informative spectral and temporal evolution patterns, while prior designs provide limited inductive bias to capture such channel structures. To this end, we propose SCA-LLM, a spectral-attentive LLM-based wireless world modeling framework that bridges CSI to LLMs via a spectral-channel attention (SCA) adapter. Specifically, the SCA adapter performs multi-spectral representation learning to extract informative channel features and align CSI with the LLM's sequence modeling capability, enabling parameter-efficient adaptation while keeping the LLM backbone largely frozen. Extensive simulations show that SCA-LLM achieves state-of-the-art prediction performance and strong zero-shot generalization, yielding up to -2.4 dB normalized mean squared error (NMSE) advantage over the previous LLM based method. Our ablation studies further confirm the effectiveness of the proposed SCA adapter in mitigating domain mismatch.

无线建模大模型信道预测智能通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。