构建真实卫星影像领域迁移基准,评估目标检测模型在气候变化与灾害场景下的泛化能力。
Benchmarking Object Detectors under Real-World Distribution Shifts in Satellite Imagery
- 设计三套面向人道主义与气候问题的新型领域泛化基准数据集
- 首次在真实地理与气候差异下系统评估检测模型性能退化
- 适合关注遥感、灾备系统鲁棒性研究的学者与开发者
目标检测模型在诸多应用中表现优异,但通常基于独立同分布(i.i.d.)假设训练与评估,即数据来自同一来源分布。然而在实际部署中,目标分布常偏离源数据,导致性能显著下降。领域泛化(DG)旨在不依赖目标分布信息的情况下提升模型对分布外(OOD)数据的泛化能力,增强对未见条件的鲁棒性。本文聚焦空间领域偏移,考察当前最先进目标检测器在真实世界分布偏移下的泛化性与鲁棒性。由于缺乏针对真实场景下对象检测的标准化基准,我们提出真实世界分布偏移(RWDS)数据集套件,包含三个新构建的领域泛化基准数据集,专用于人道主义与气候变化应用。这些数据集支持在气候带、灾害类型及地理区域间的分布偏移分析。据我们所知,这是首个为真实高影响场景下的目标检测领域泛化设计的基准。数据集与代码已公开于https://github.com/RWGAI/RWDS,旨在推动未来检测模型在复杂现实环境中的评估与发展。
原文摘要 · Abstract (English)
Object detectors have achieved remarkable performance in many applications; however, these deep learning models are typically designed under the i.i.d. assumption, meaning they are trained and evaluated on data sampled from the same (source) distribution. In real-world deployment, however, target distributions often differ from source data, leading to substantial performance degradation. Domain Generalisation (DG) seeks to bridge this gap by enabling models to generalise to Out-Of-Distribution (OOD) data without access to target distributions during training, enhancing robustness to unseen conditions. In this work, we examine the generalisability and robustness of state-of-the-art object detectors under real-world distribution shifts, focusing particularly on spatial domain shifts. Despite the need, a standardised benchmark dataset specifically designed for assessing object detection under realistic DG scenarios is currently lacking. To address this, we introduce Real-World Distribution Shifts (RWDS), a suite of three novel DG benchmarking datasets that focus on humanitarian and climate change applications. These datasets enable the investigation of domain shifts across (i) climate zones and (ii) various disasters and geographic regions. To our knowledge, these are the first DG benchmarking datasets tailored for object detection in real-world, high-impact contexts. We aim for these datasets to serve as valuable resources for evaluating the robustness and generalisation of future object detection models. Our datasets and code are available at https://github.com/RWGAI/RWDS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。