构建无线网络多任务预测通用模型,支持任意输入长度和零样本新任务
A Wireless Foundation Model for Multi-Task Prediction
- 通过单变量分解统一不同预测任务,引入区间感知编码与因果Transformer
- 在大规模数据上训练后,零样本性能超越传统全量训练基线
- 适合需要跨场景泛化与快速部署的无线系统研发人员
随着移动通信网络复杂性和动态性的增加,准确预测信道状态信息(CSI)、用户位置和网络流量等关键系统参数,已成为物理层(PHY)和介质访问控制层(MAC)各类任务的关键。尽管传统深度学习方法已广泛应用于此类预测任务,但通常在不同场景和任务间泛化能力不足。为此,我们提出一种统一的无线网络多任务预测基础模型,支持多样化的预测时间间隔。该模型采用单变量分解以统一异构任务,引入粒度编码实现区间感知,并使用因果Transformer骨干网络提升预测精度。此外,训练中引入补丁掩码策略,支持任意输入长度。在大规模数据集上训练后,该基础模型展现出对未见场景的强大泛化能力,在新任务上实现零样本性能,优于传统全量训练基线。
原文摘要 · Abstract (English)
With the growing complexity and dynamics of the mobile communication networks, accurately predicting key system parameters, such as channel state information (CSI), user location, and network traffic, has become essential for a wide range of physical (PHY)-layer and medium access control (MAC)-layer tasks. Although traditional deep learning (DL)-based methods have been widely applied to such prediction tasks, they often struggle to generalize across different scenarios and tasks. In response, we propose a unified foundation model for multi-task prediction in wireless networks that supports diverse prediction intervals. The proposed model enforces univariate decomposition to unify heterogeneous tasks, encodes granularity for interval awareness, and uses a causal Transformer backbone for accurate predictions. Additionally, we introduce a patch masking strategy during training to support arbitrary input lengths. After trained on large-scale datasets, the proposed foundation model demonstrates strong generalization to unseen scenarios and achieves zero-shot performance on new tasks that surpass traditional full-shot baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。