arXiv:2504.08811cs.LGcs.CE2025-04被引 9

用物理相对性思想提升模型跨场景泛化能力

Analogical Learning for Cross-Scenario Generalization: Framework and Application to Intelligent Localization

  • 引入参考系与相对性概念,让模型关注数据间相对关系而非绝对特征
  • 在多种数据集上实现波长级定位精度,优于或媲美现有最优方法
  • 适合需要跨环境快速适应的智能定位任务,如无线网络部署

现代学习系统在不同场景间联合学习及快速适应新场景时表现不佳,因其严重依赖场景相关的绝对数据-标签表示。本文提出类比学习(AL)框架,通过挖掘不同场景下底层物理过程的内在不变性,提升跨场景泛化能力。具体地,将参考系与相对性物理概念引入神经建模,以场景内数据-标签对作为参考锚点,强制网络通过剔除场景依赖变化的数据域相对度量来实现数据到标签的转换。我们以双分支Transformer结构的Mateformer实例化该框架:辅助变压器每层提取当前数据特征空间,主变压器对应层计算数据特征间的注意力,并以此作为相对度量,加权当前标签特征以合成下一阶段标签特征,最终生成预测结果。我们将AL应用于智能无线定位这一典型多场景学习任务,在合成、真实世界及城市尺度数据集上均实现鲁棒的跨场景迁移与多场景联合学习,达到波长级定位精度,性能匹配或超越现有最先进方法。该受物理启发的学习框架为其他跨场景学习任务提供了可行替代方案。

原文摘要 · Abstract (English)

Modern learning systems often struggle with joint learning across diverse scenarios and immediate adaptation to new ones, because they rely heavily on the scenario-dependent absolute data-label representations. Here, we propose analogical learning (AL), a learning framework that explores the inherent invariance of the underlying physical processes across scenarios, to improve the cross-scenario generalization. Specifically, we introduce the physical concepts of reference frames and relativity into the neural modeling. The resultant framework explicitly employs intra-scenario data-label pairs as reference anchors and enforces the network to mediate its data-to-label transformation through data-domain relative metrics that factor out the scenario-dependent variations. We instantiate AL with Mateformer, a bipartite Transformer-based neural architecture. Each layer of the auxiliary Transformer extracts certain feature space of the current data, while the corresponding layer of the primary Transformer computes attention among the data feature space and then use it as a relativity metric to weight the current label feature to synthesize the next label feature and, ultimately, the final prediction. We apply AL to intelligent wireless localization, a representative multi-scenario learning task. Across synthetic, real-world, and city-scale datasets, AL enables robust cross-scenario transfer and multi-scenario joint learning, achieving wavelength-scale localization accuracy that matches or surpasses state-of-the-art methods. This physics-inspired learning framework provides a promising alternative for other cross-scenario learning tasks and applications.

跨场景学习物理启发无线定位Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。