arXiv:2606.25401cs.NIcs.AI2026-06

轻量级网络提升5G信道预测精度,参数减少58%仍更准。

Lightweight PCGAE-Net: Parallel CrossGate Attention and Bottleneck AutoEncoder for Efficient 5G Channel Prediction

  • 用并行交叉门注意力替代串行注意力,避免信息畸变。
  • 引入瓶颈自编码器压缩深层特征,降低计算开销。
  • 在QuaDriGa数据集上速度更快、精度更高,适合基站部署。

精确的信道状态信息(CSI)预测对5G大规模MIMO系统的主动波束成形和资源管理至关重要,但高性能Transformer模型因参数量超3000万,难以在基站硬件上部署。本文提出Lightweight PCGAE-Net,不依赖后处理压缩,而是修正现有模型的两个架构缺陷:一是顺序注意力导致的偏差——在CS3T-UNet中,组内时序注意力(GTA)总作用于已受交叉空间注意力(CSA)影响的特征,扭曲其捕获的时序信息。我们通过将两个注意力模块统一作用于层归一化输入,并以可学习的逐通道Sigmoid交叉门融合输出来消除此依赖。二是深层瓶颈未压缩:在编码器最深阶段(通道深度达4C)使用全自注意力,计算复杂度为二次方且冗余严重。采用仅含1×1卷积的瓶颈自编码器(BAE),将通道深度减半,并引入辅助重建损失防止信息丢失。结合频域降维(N_f=32, C=48)的浅层编码器-解码器结构,最终模型仅含854万参数,比基线CS3T-UNet减少58%,在QuaDriGa数据集上的单步预测中,分别在5km/h和9km/h下优于基线3.26dB和6.0dB。

原文摘要 · Abstract (English)

Accurate channel state information (CSI) prediction is essential for proactive beamforming and resource management in 5G massive MIMO systems, yet the deployment of high-accuracy transformer-based predictors on base-station hardware remains challenging because the most capable models carry upwards of 30\,M parameters. This paper introduces Lightweight PCGAE-Net, which addresses the efficiency problem not by post-hoc compression but by correcting two architectural flaws in the current state of the art. The first is a sequential attention ordering bias: in CS3T-UNet, group-wise temporal attention (GTA) always operates on features that have already been transformed by cross-shaped spatial attention (CSA), distorting what temporal information GTA can capture. We remove this dependency by routing both attention modules to the same layer-normalized input and combining their independent outputs through a learned per-channel sigmoid CrossGate. The second flaw is an uncompressed bottleneck: applying full self-attention at the deepest encoder stage, where channel depth reaches $4C$, is quadratically expensive and carries redundant features. A Bottleneck AutoEncoder (BAE) with $1\times1$ convolutions halves this depth and uses an auxiliary reconstruction loss to prevent information collapse. Wrapping these components inside a shallower encoder-decoder with frequency-domain dimensionality reduction ($N_f\!=\!32$, $C\!=\!48$) produces a model with just 8.54\,M parameters -- 58\% fewer than the CS3T-UNet baseline -- that outperforms it by up to 3.26\,dB at 5\,km/h and 6.0\,dB at 9\,km/h in single-step prediction on QuaDriGa dataset.

5G通信信道预测轻量化模型注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。