arXiv:2503.02036cs.LGcs.CV2025-03被引 1

用地理坐标建模连续潜在域,提升模型对地理位置变化的鲁棒性。

Latent Domain Modeling Improves Robustness to Geographic Shifts

  • 通过位置编码学习连续潜变量表示地理域
  • 在四个数据集上显著提升最差群体性能
  • 适合关注地理分布偏移的视觉模型研究者

地理分布偏移指训练数据中的地理位置分布与推理时实际分布不一致。使用标准经验风险最小化在此场景下会导致不同空间分组(如大洲或生物群落)间泛化能力不均。现有方法多依赖离散组标签进行领域自适应,忽略可获取的地理坐标元数据;而整合地理坐标的建模方法虽能提升整体性能,但其对地理领域泛化的具体影响尚未被系统研究。本文提出一种通用建模框架,通过位置编码学习连续潜变量,并将主任务预测器条件于联合训练的潜变量。在四个具有不同分组划分的地理标注图像数据集上,该框架显著优于现有领域自适应与位置感知建模方法。尤其在WILDS基准的两个数据集上取得新的最先进结果。

原文摘要 · Abstract (English)

Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at inference time. Using standard empirical risk minimization (ERM) in this setting can lead to uneven generalization across different spatially-determined groups of interest such as continents or biomes. The most common approaches to tackling geographic distribution shift apply domain adaptation methods using discrete group labels, ignoring geographic coordinates that are often available as metadata. On the other hand, modeling methods that integrate geographic coordinates have been shown to improve overall performance, but their impact on geographic domain generalization has not been studied. In this work, we propose a general modeling framework for improving robustness to geographic distribution shift. The key idea is to model continuous, latent domain assignment using location encoders and to condition the main task predictor on the jointly-trained latents. On four diverse geo-tagged image datasets with different group splits, we show that instances of our framework achieve significant improvements in worst-group performance compared to existing domain adaptation and location-aware modeling methods. In particular, we achieve new state-of-the-art results on two datasets from the WILDS benchmark.

地理分布域泛化位置编码鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。