用图模型预训练+微调,实现无线资源分配的快速适配。
A Graph Foundation Model for Wireless Resource Allocation

- 基于干扰拓扑的Transformer架构,注入全局注意力机制。
- 自监督预训练使模型在少样本下仍能有效适应新场景。
- 适合需要快速响应和多场景泛化的无线网络优化任务。
现代无线网络的密集化导致严重互干扰,传统迭代算法计算成本过高,难以满足实时需求。现有深度学习方法虽有潜力,但通常为特定任务设计,更换目标或场景需昂贵重训。为此,我们提出一种基于预训练与微调范式的图基础模型(GFM-RA),以提取统一表征,实现对不同目标与场景的快速适应。具体地,引入一种考虑干扰的Transformer架构,通过偏置投影将干扰拓扑注入全局注意力机制。此外,设计一种混合自监督预训练策略,结合掩码边预测与无负样本的教师-学生对比学习,从大规模无标签数据中捕捉可迁移的结构表征。大量实验表明,该框架达到当前最优性能,并随模型容量提升有效扩展。关键的是,借助统一表征,模型展现出优异样本效率,可在分布外(OOD)场景中对多样且无监督的下游目标实现稳健少样本适应。结果验证了预训练基础模型在可适配无线资源分配中的潜力,为未来通用学习型无线优化研究奠定坚实基础。
原文摘要 · Abstract (English)
The aggressive densification of modern wireless networks necessitates judicious resource allocation to mitigate severe mutual interference. However, classical iterative algorithms remain computationally prohibitive for real-time applications requiring rapid responsiveness. While recent deep learning-based methods show promise, they typically function as task-specific solvers lacking the flexibility to adapt to different objectives and scenarios without expensive retraining. To address these limitations, we propose a graph foundation model for resource allocation (GFM-RA) based on a pre-training and fine-tuning paradigm to extract unified representations, thereby enabling rapid adaptation to different objectives and scenarios. Specifically, we introduce an interference-aware Transformer architecture with a bias projector that injects interference topologies into global attention mechanisms. Furthermore, we develop a hybrid self-supervised pre-training strategy that synergizes masked edge prediction with negative-free Teacher-Student contrastive learning, enabling the model to capture transferable structural representations from massive unlabeled datasets. Extensive experiments demonstrate that the proposed framework achieves state-of-the-art performance and scales effectively with increased model capacity. Crucially, leveraging its unified representations, the foundation model exhibits exceptional sample efficiency, enabling robust few-shot adaptation to diverse and unsupervised downstream objectives in out-of-distribution (OOD) scenarios. These results demonstrate the promise of pre-trained foundation models for adaptable wireless resource allocation and provide a strong foundation for future research on generalizable learning-based wireless optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。