arXiv:2605.24077eess.SPcs.LG2026-05

通过对比学习构建无线数据表示空间,距离越近越易迁移。

LWM-CDE: A Representation Space for Wireless Data Reasoning and Transferability

论文配图:LWM-CDE: A Representation Space for Wireless Data Reasoning and Transferability
图 1 · 摘自论文原文
  • 用对比与几何约束损失微调基础模型的数据集嵌入
  • 在多个无线基准上相关性优于现有指标且更高效
  • 适合做数据选型、增广和预算预训练的决策支持

真实场景中的无线通信机器学习部署面临显著泛化挑战,源于位置与环境特有的信号结构、不同部署间数据高度多样性以及真实数据获取受限。当前评估训练与推理分布相似性及模型可迁移性的方法存在计算成本高、性能不一致的问题,导致模型部署与生命周期管理缺乏可靠依据。为此,我们提出基于预训练无线基础模型特征空间的数据集相似性框架。LWM-CDE(对比学习的数据集嵌入)通过联合使用对比损失与几何塑形损失微调数据集嵌入,构建出一个结构化的流形空间,其中距离能可靠反映可迁移性。在多个无线基准上的实验表明,该方法在预测实际迁移性能方面相关性更强,同时计算效率更高。所学表示空间可有效支持源数据集选择、标签感知增强与预算预训练等任务,展现出在各类无线通信应用中的广泛适用性。

原文摘要 · Abstract (English)

Machine learning deployments in real-world wireless communication tasks face significant generalization challenges due to location and environment-specific signal structure, high diversity in data across different deployments, and limited availability of real-world data. Current approaches for assessing data similarity between training and inference (deployment) distributions, as well as evaluating model transferability, suffer from high computational costs and inconsistent performance, leaving critical model deployment and model life cycle management decisions without a principled foundation. To address this, we introduce a dataset similarity framework built upon the feature space of a pretrained wireless foundation model. Our method, LWM-CDE (Contrastive learning of Dataset Embedding), fine-tunes the dataset embeddings of the foundation model using a combination of contrastive and geometry-shaping losses, creating a structured manifold where distance reliably indicates transferability. Extensive experiments on wireless benchmarks show that LWM-CDE achieves stronger correlation with empirical transfer performance than existing metrics while being more computationally efficient. The learned representation space supports more effective and data-efficient decision-making for tasks like source dataset selection, label-aware augmentation, and budgeted pretraining, demonstrating its broader utility across different wireless communication applications.

无线通信迁移学习数据表征模型部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。