arXiv:2505.09160cs.LGcs.AI2025-05被引 29

用自监督学习构建无线信道的通用表示,提升跨场景适应能力。

A Multi-Task Foundation Model for Wireless Channel Representation Using Contrastive and Masked Autoencoder Learning

  • 融合掩码重建与对比学习,设计无线环境特化的目标函数。
  • 在跨频段波束选择等任务中表现优于监督基线,数据效率高。
  • 适合做无线通信自监督学习的基础模型,尤其适用于少样本场景。

当前自监督学习在无线信道表征中的应用多沿用文本和图像处理的范式,未能充分考虑无线通信的独特特性与约束。为此,我们提出ContraWiMAE——一种基于Transformer的无线信道基础模型,统一了掩码重建与掩码对比学习。其核心创新在于设计了一种新的无线启发式对比目标,利用无线环境固有的噪声、衰落和部分可观测性作为自然增强。在未见过的场景和条件下广泛评估表明,该方法在跨频段波束选择、视距检测和信道估计等多个下游任务中均表现出色。ContraWiMAE在多样化无线环境中展现出优异的线性可分性和适应性,在挑战性条件下具备出色的泛化能力与数据效率,相比监督基线表现更优。与现有先进无线信道基础模型相比,本方法进一步验证了其优越性能与高效性,具有成为未来自监督无线信道表示学习强大基准的潜力。为促进该方向研究,我们公开了ContraWiMAE的模型权重与训练流程。

原文摘要 · Abstract (English)

Current applications of self-supervised learning to wireless channel representation often borrow paradigms developed for text and image processing, without fully addressing the unique characteristics and constraints of wireless communications. To bridge this gap, we introduce ContraWiMAE, Wireless Contrastive Masked Autoencoder, a transformer-based foundation model that unifies masked reconstruction and masked contrastive learning for wireless channel representation. Our key innovation is a new wireless-inspired contrastive objective that exploits the inherent characteristics of wireless environment, including noise, fading, and partial observability, as natural augmentation. Through extensive evaluation on unseen scenarios and conditions, we demonstrate our method's effectiveness in multiple downstream tasks, including cross-frequency beam selection, line-of-sight detection, and channel estimation. ContraWiMAE exhibits superior linear separability and adaptability in diverse wireless environments, demonstrating exceptional data efficiency and competitive performance compared with supervised baselines under challenging conditions. Comparative evaluations against a state-of-the-art wireless channel foundation model confirm the superior performance and data efficiency of our approach, highlighting its potential as a powerful baseline for future research in self-supervised wireless channel representation learning. To foster further work in this direction, we release the model weights and training pipeline for ContraWiMAE.

自监督学习无线信道基础模型对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。