提出轻量级Transformer模型,实现多用户波束成形的实时可扩展泛化。
A Semi-amortized Lifted Learning-to-Optimize Masked (SALLO-M) Transformer Model for Scalable and Generalizable Beamforming
- 用多层Transformer迭代优化波束成形,每层结合梯度上升步骤。
- 支持不同用户和天线数量,无需重训练,性能优于传统方法。
- 适合无线通信系统设计者,尤其在超载场景下表现更优。
我们提出一种无监督深度学习框架,用于多用户多输入单输出(MU-MISO)系统中的实时、可扩展且泛化能力强的下行波束成形。所提半压缩提升学习优化(SALLO)框架采用多层Transformer,通过每层少量投影梯度上升步骤,迭代优化辅助变量与波束成形解。其核心优势在于通过用户-天线双标记化与结构化样本/注意力掩码机制,可处理不同用户数与天线数配置,实现无需重训练的泛化能力。为提升收敛性与鲁棒性,引入三项训练策略:(a) 滑动窗口训练以稳定梯度传播,(b) 带随机掩码的课程学习以促进配置泛化并防止早期收敛不良,(c) 样本回放以缓解多阶段训练中的灾难性遗忘。消融实验验证关键架构设计,表明增强训练方案同时提升泛化性与解质量。高斯信道与稀疏信道上的仿真结果表明,该方案在多种系统配置与信道条件下均持续优于现有深度学习基线。在过载场景中性能增益尤为显著,体现更强鲁棒性;且在非过载系统中超越WMMSE基准,在一定过载因子阈值内也优于后者。该方法具备快速推理能力,模型远轻于无线基础模型。
原文摘要 · Abstract (English)
We develop an unsupervised deep learning framework for real-time scalable and generalizable downlink beamforming in multi-user multiple-input single-output (MU-MISO) systems. The proposed semi-amortized lifted learning-to-optimize (SALLO) framework employs a multi-layer Transformer to iteratively refine an auxiliary variable and the beamformer solution, with a few projected gradient ascent steps at each layer. A key feature of our SALLO Transformer model is that it can handle varying numbers of users and antennas, enabled by a user-antenna dual tokenization and a structured sample/attention masking scheme, leading to generalization across different configurations without retraining. To improve convergence and robustness, we introduce three training strategies: (a) sliding-window training to stabilize gradient propagation, (b) curriculum learning with random masking to enable user-antenna configuration generalization and prevent poor early-stage convergence, and (c) sample replay to mitigate catastrophic forgetting during multi-stage training. Ablation studies validate several key architecture designs and show that the enhanced training scheme improves both generalizability and solution quality. Simulation results over both Gaussian and sparse channels show that the proposed scheme consistently outperforms existing deep learning baselines across diverse system configurations and channel conditions. The performance gain becomes more pronounced in overloaded regimes, highlighting improved robustness under challenging scenarios. Furthermore, our scheme surpasses the WMMSE benchmark in underloaded systems and even in overloaded systems when the overloading factor is below certain threshold. These gains are achieved with fast inference and a substantially more lightweight model than wireless foundation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。