LinFormer用线性结构替代注意力机制,实现高效时变信道预测。
LinFormer: A Linear-based Lightweight Transformer Architecture For Time-Aware MIMO Channel Prediction
- 采用全线性编码器架构,以时间感知多层感知机替代传统注意力机制。
- 计算复杂度显著降低,实测在多种移动场景下精度优于现有方法。
- 适合部署于低成本基站,尤其适用于6G高移动性通信场景。
6G移动网络推动高速移动通信发展,但信道老化问题亟待解决。现有信道预测方法虽精度较高,却因计算复杂度过高难以实际应用。为此,我们提出LinFormer,一种基于可扩展全线性编码器的轻量级Transformer框架。受BERT等自然语言处理模型启发,该框架将计算耗时的注意力机制替换为时间感知多层感知机(TMLP),显著降低计算开销。TMLP模块具备天然的时间感知能力,更适配信道预测任务。通过引入加权均方误差损失(WMSELoss)与数据增强技术,充分利用大规模通信数据集提升训练效果。实验结果表明,无论在仿真还是实测数据上,LinFormer均在各类移动场景中超越现有方法,在保持高精度的同时大幅降低计算复杂度,具备在成本敏感型基站中部署的潜力,为未来无线通信系统提供可行解决方案。
原文摘要 · Abstract (English)
The emergence of 6th generation (6G) mobile networks brings new challenges in supporting high-mobility communications, particularly in addressing the issue of channel aging. While existing channel prediction methods offer improved accuracy at the expense of increased computational complexity, limiting their practical application in mobile networks. To address these challenges, we present LinFormer, an innovative channel prediction framework based on a scalable, all-linear, encoder-only Transformer model. Our approach, inspired by natural language processing (NLP) models such as BERT, adapts an encoder-only architecture specifically for channel prediction tasks. We propose replacing the computationally intensive attention mechanism commonly used in Transformers with a time-aware multi-layer perceptron (TMLP), significantly reducing computational demands. The inherent time awareness of TMLP module makes it particularly suitable for channel prediction tasks. We enhance LinFormer's training process by employing a weighted mean squared error loss (WMSELoss) function and data augmentation techniques, leveraging larger, readily available communication datasets. Our approach achieves a substantial reduction in computational complexity while maintaining high prediction accuracy, making it more suitable for deployment in cost-effective base stations (BS). Comprehensive experiments using both simulated and measured data demonstrate that LinFormer outperforms existing methods across various mobility scenarios, offering a promising solution for future wireless communication systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。