用BERT思想提升无线信道状态预测与分类效率,解决数据少、丢包等问题。
CSI-BERT2: A BERT-inspired Framework for Efficient CSI Prediction and Classification in Wireless Communication and Sensing
- 基于双向自注意力机制,用掩码预测模型学习信道特征。
- 在真实与仿真数据上达到当前最优性能,支持不同采样率和丢包场景。
- 适合无线感知与通信领域,尤其适用于数据稀缺环境的模型设计。
信道状态信息(CSI)是无线通信与感知系统的核心,支撑资源优化与环境感知等功能。无线感知中存在数据稀缺与报文丢失问题,而无线通信中高维CSI矩阵与高速移动导致的短相干时间则带来估计难题。为此,我们提出统一框架CSI-BERT2,基于CSI-BERT改进,通过双向自注意力捕捉CSI序列间复杂关系。采用两阶段训练:先用掩码语言模型(MLM)在稀疏数据上无监督学习通用特征,再针对下游任务微调。具体地,将MLM扩展为掩码预测模型(MPM),高效完成预测任务;改进原结构,引入自适应重加权层(ARL)增强子载波表示,并设计基于MLP的时序嵌入模块,缓解原始Transformer中的时序信息丢失问题。在真实采集与仿真数据上的大量实验表明,CSI-BERT2在所有任务中均达领先性能,且对不同采样率具有强泛化能力,能有效处理由丢包引起的不连续CSI序列——传统方法难以应对。代码与数据集已公开于https://github.com/RS2002/CSI-BERT2。
原文摘要 · Abstract (English)
Channel state information (CSI) is a fundamental component in both wireless communication and sensing systems, enabling critical functions such as radio resource optimization and environmental perception. In wireless sensing, data scarcity and packet loss hinder efficient model training, while in wireless communication, high-dimensional CSI matrices and short coherent times caused by high mobility present challenges in CSI estimation. To address these issues, we propose a unified framework named CSI-BERT2 for CSI prediction and classification tasks, built on CSI-BERT, which adapts BERT to capture the complex relationships among CSI sequences through a bidirectional self-attention mechanism. We introduce a two-stage training method that first uses a mask language model (MLM) to enable the model to learn general feature extraction from scarce datasets in an unsupervised manner, followed by fine-tuning for specific downstream tasks. Specifically, we extend MLM into a mask prediction model (MPM), which efficiently addresses the CSI prediction task. To further enhance the representation capacity of CSI data, we modify the structure of the original CSI-BERT. We introduce an adaptive re-weighting layer (ARL) to enhance subcarrier representation and a multi-layer perceptron (MLP)-based temporal embedding module to mitigate temporal information loss problem inherent in the original Transformer. Extensive experiments on both real-world collected and simulated datasets demonstrate that CSI-BERT2 achieves state-of-the-art performance across all tasks. Our results further show that CSI-BERT2 generalizes effectively across varying sampling rates and robustly handles discontinuous CSI sequences caused by packet loss-challenges that conventional methods fail to address. The dataset and code are publicly available at https://github.com/RS2002/CSI-BERT2 .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。