用混合注意力状态空间模型提升无线信道预测的效率与精度
MambaCSP: Hybrid-Attention State Space Models for Hardware-Efficient Channel State Prediction

- 用线性复杂度的Mamba替代传统Transformer,降低计算开销
- 在多输入多输出正交频分复用系统中,精度提升9%-12%,推理速度加快2.9倍
- 适合资源受限的实时无线网络部署,尤其关注硬件效率的场景
近期研究显示,基于注意力机制的Transformer和大语言模型(LLM)可通过捕捉信道状态信息(CSI)序列中的长程时序依赖,实现优异的信道状态预测(CSP)性能。然而,这些模型在序列长度上存在二次方复杂度,导致计算成本高、内存占用大、推理延迟高,限制了其在实时和资源受限无线场景中的应用。本文探讨了选择性状态空间模型(SSM)是否可作为高效替代方案。提出MambaCSP——一种混合注意力状态空间架构,将基于LLM的预测主干替换为线性时间复杂度的Mamba模型。为克服纯SSM仅具局部依赖的局限,引入轻量级块混合注意力层,周期性注入跨标记注意力,增强长上下文预测能力。大规模多输入多输出正交频分复用(MISO-OFDM)仿真表明,相比基于LLM的方法,MambaCSP在预测精度上提升9%-12%,吞吐量最高提升3.0倍,显存使用降低2.6倍,推理速度提升2.9倍。结果表明,混合状态空间架构为未来无线网络中可扩展、硬件高效的AI原生信道状态预测提供了有前景的方向。
原文摘要 · Abstract (English)
Recent works have demonstrated that attention-based transformer and large language model (LLM) architectures can achieve strong channel state prediction (CSP) performance by capturing long-range temporal dependencies across channel state information (CSI) sequences. However, these models suffer from quadratic scaling in sequence length, leading to substantial computational cost, memory consumption, and inference latency, which limits their applicability in real-time and resource-constrained wireless deployments. In this paper, we investigate whether selective state space models (SSMs) can serve as a hardware-efficient alternative for CSI prediction. We propose MambaCSP, a hybrid-attention SSM architecture that replaces LLM-based prediction backbones with a linear-time Mamba model. To overcome the local-only dependencies of pure SSMs, we introduce lightweight patch-mixer attention layers that periodically inject cross-token attentions, helping with long-context CSI prediction. Extensive MISO-OFDM simulations show that MambaCSP improves prediction accuracy over LLM-based approaches by 9-12%, while delivering up to 3.0x higher throughput, 2.6x lower VRAM usage, and 2.9x faster inference. Our results demonstrate that hybrid state space architectures provide a promising direction for scalable and hardware-efficient AI-native CSI prediction in future wireless networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。