arXiv:2412.17284cs.CV2024-12NeurIPS被引 7

无需目标标签,通过模型平坦性评估实现无监督模型选择。

Towards Unsupervised Model Selection for Domain Adaptive Object Detection

  • 基于参数空间平坦性原理,设计无标签评估方法
  • 在多个基准上验证其与模型性能高度相关
  • 适合实际应用中缺乏标注数据的域自适应检测场景

近年来,如何在新场景中评估深度模型性能日益受到关注。然而,虽然可获取新场景数据,但标注往往不可用。现有域自适应目标检测(DAOD)方法通常依赖目标域的验证或测试集进行模型选择,这在真实应用中不切实际。本文提出一种新的无监督模型选择方法,可在不使用任何目标标签的情况下选出接近最优的模型。该方法基于平坦极小值原理:参数空间中位于平坦极小值区域的模型通常具备良好泛化能力。然而传统方法需标签数据来评估模型是否处于平坦极小值区域,对DAOD任务不现实。为此,我们设计了检测适配度评分(DAS),无需目标标签即可近似衡量平坦性。我们通过泛化界证明,平坦性可视为模型方差,而极小值取决于域分布距离。据此,提出平坦指数评分(FIS)以测量分类与定位在参数扰动前后的波动,并引入原型距离比(PDR)评分以衡量模型的迁移性和判别力。整体上,所提DAS能有效评估模型在目标域上的泛化能力。我们在多个DAOD基准和方法上进行了广泛实验,结果表明DAS与模型性能高度相关,可作为训练后有效的模型选择工具。

原文摘要 · Abstract (English)

Evaluating the performance of deep models in new scenarios has drawn increasing attention in recent years. However, while it is possible to collect data from new scenarios, the annotations are not always available. Existing DAOD methods often rely on validation or test sets on the target domain for model selection, which is impractical in real-world applications. In this paper, we propose a novel unsupervised model selection approach for domain adaptive object detection, which is able to select almost the optimal model for the target domain without using any target labels. Our approach is based on the flat minima principle, i,e., models located in the flat minima region in the parameter space usually exhibit excellent generalization ability. However, traditional methods require labeled data to evaluate how well a model is located in the flat minima region, which is unrealistic for the DAOD task. Therefore, we design a Detection Adaptation Score (DAS) approach to approximately measure the flat minima without using target labels. We show via a generalization bound that the flatness can be deemed as model variance, while the minima depend on the domain distribution distance for the DAOD task. Accordingly, we propose a Flatness Index Score (FIS) to assess the flatness by measuring the classification and localization fluctuation before and after perturbations of model parameters and a Prototypical Distance Ratio (PDR) score to seek the minima by measuring the transferability and discriminability of the models. In this way, the proposed DAS approach can effectively evaluate the model generalization ability on the target domain. We have conducted extensive experiments on various DAOD benchmarks and approaches, and the experimental results show that the proposed DAS correlates well with the performance of DAOD models and can be used as an effective tool for model selection after training.

无监督学习域自适应目标检测模型选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。