arXiv:2502.13289cs.LG2025-02被引 4

构建多分布偏移航空数据集,用于测试时错误检测与模型自适应。

Multiple Distribution Shift -- Aerial (MDS-A): A Dataset for Test-Time Error Detection and Model Adaptation

  • 基于不同模拟天气条件生成6个相关航空数据集。
  • 基准模型在混合天气测试集上性能下降显著,最大降幅达42%。
  • 结合错误检测技术后,模型泛化能力提升,适合遥感与无人机领域研究者。

机器学习模型通常假设训练与测试样本来自同一分布,但当两者分布差异较大时,模型性能会显著下降。本文提出多重分布偏移——航空(MDS-A)数据集,包含在不同模拟天气条件下采集的6个相关航空图像数据集,以及6个基础目标检测模型。此外,还提供了多个混合天气条件的测试集,其与训练数据存在显著分布差异。本文对MDS-A进行了特性分析,报告了基准模型在各自训练集和测试集上的性能表现,以及应用近期知识工程错误检测技术(EDR)后的改进效果。实验表明,使用EDR可有效缓解分布外性能退化。数据集已公开:https://lab-v2.github.io/mdsa-dataset-website。

原文摘要 · Abstract (English)

Machine learning models assume that training and test samples are drawn from the same distribution. As such, significant differences between training and test distributions often lead to degradations in performance. We introduce Multiple Distribution Shift -- Aerial (MDS-A) -- a collection of inter-related datasets of the same aerial domain that are perturbed in different ways to better characterize the effects of out-of-distribution performance. Specifically, MDS-A is a set of simulated aerial datasets collected under different weather conditions. We include six datasets under different simulated weather conditions along with six baseline object-detection models, as well as several test datasets that are a mix of weather conditions that we show have significant differences from the training data. In this paper, we present characterizations of MDS-A, provide performance results for the baseline machine learning models (on both their specific training datasets and the test data), as well as results of the baselines after employing recent knowledge-engineering error-detection techniques (EDR) thought to improve out-of-distribution performance. The dataset is available at https://lab-v2.github.io/mdsa-dataset-website.

分布偏移航空图像错误检测模型自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。