arXiv:2502.20668cs.CVcs.AI2025-02被引 3

构建首个大规模细粒度遥感开放世界基准,助力模型持续学习新数据。

OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing

  • 构建涵盖189类场景与物体的细粒度遥感数据集,覆盖真实世界主要语义变化
  • 包含5个具有显著分布差异的数据域,支持多类型开放世界任务评估
  • 适合研究持续学习、领域自适应与遥感智能分析的学者使用

遥感技术的进步推动了全球范围内卫星影像的持续获取,带来了开放世界任务的新挑战。模型需不断适应新数据,这些数据常与训练阶段数据存在显著差异。为有效应对新数据,模型需检测语义漂移、适应观测分布变化,并在不遗忘已有知识的前提下持续更新参数。然而,现有研究多局限于单一数据集,缺乏可评估多种开放世界任务的大规模基准。本文提出 extbf{OpenEarthSensing (OES)},一个面向开放世界遥感的大规模细粒度基准。该数据集包含189个场景与物体类别,覆盖现实世界中可能发生的绝大多数语义变化;同时涵盖五个具有显著协变量偏移的数据域:两个RGB卫星域、一个RGB航空域、一个多光谱RGB域和一个红外域。我们在OES上评估了多种基线方法,验证其作为有意义且具挑战性的开放世界遥感评估基准的有效性。数据集已公开于 https://haiv-lab.github.io/OES。

原文摘要 · Abstract (English)

The advancement of remote sensing, including satellite systems, facilitates the continuous acquisition of remote sensing imagery globally, introducing novel challenges for achieving open-world tasks. Deployed models need to continuously adjust to a constant influx of new data, which frequently exhibits diverse shifts from the data encountered during the training phase. To effectively handle the new data, models are required to detect semantic shifts, adapt to covariate shifts, and continuously update their parameters without forgetting learned knowledge, as has been considered in works on a variety of open-world tasks. However, existing studies are typically conducted within a single dataset to simulate realistic conditions, with a lack of large-scale benchmarks capable of evaluating multiple open-world tasks. In this paper, we introduce \textbf{OpenEarthSensing (OES)}, a large-scale fine-grained benchmark for open-world remote sensing. OES includes 189 scene and object categories, covering the vast majority of potential semantic shifts that may occur in the real world. Additionally, to provide a more comprehensive testbed for evaluating the generalization performance, OES encompasses five data domains with significant covariate shifts, including two RGB satellite domains, one RGB aerial domain, one multispectral RGB domain, and one infrared domain. We evaluate the baselines and existing methods for diverse tasks on OES, demonstrating that it serves as a meaningful and challenging benchmark for open-world remote sensing. The proposed dataset OES is available at https://haiv-lab.github.io/OES.

遥感开放世界持续学习基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。