arXiv:2505.23726cs.CV2025-05

用大模型修正标注噪声,提升目标检测鲁棒性

FMG-Det: Foundation Model Guided Robust Object Detection

  • 用大模型预处理修正标注,再结合多实例学习训练
  • 在标准与少样本场景下均达顶尖性能,优于现有方法
  • 方法简单高效,适合标注不一致或部分遮挡数据

目标检测中高质量数据的获取因标注边界主观性强而困难,不同标注者对同一物体的边界标注往往不一致。尤其当物体部分可见或模糊时,这种问题更加严重。在少样本场景下,少量错误标注即会显著降低检测器性能。本文提出FMG-Det,一种基于大模型引导的鲁棒目标检测方法。该方法将多实例学习(MIL)框架与预处理流程结合,利用强大基础模型在训练前修正标注。配合探测器头的微调,FMG-Det在多个数据集上实现标准与少样本场景下的最优性能,且结构更简单、效率更高。

原文摘要 · Abstract (English)

Collecting high quality data for object detection tasks is challenging due to the inherent subjectivity in labeling the boundaries of an object. This makes it difficult to not only collect consistent annotations across a dataset but also to validate them, as no two annotators are likely to label the same object using the exact same coordinates. These challenges are further compounded when object boundaries are partially visible or blurred, which can be the case in many domains. Training on noisy annotations significantly degrades detector performance, rendering them unusable, particularly in few-shot settings, where just a few corrupted annotations can impact model performance. In this work, we propose FMG-Det, a simple, efficient methodology for training models with noisy annotations. More specifically, we propose combining a multiple instance learning (MIL) framework with a pre-processing pipeline that leverages powerful foundation models to correct labels prior to training. This pre-processing pipeline, along with slight modifications to the detector head, results in state-of-the-art performance across a number of datasets, for both standard and few-shot scenarios, while being much simpler and more efficient than other approaches.

目标检测大模型标注噪声少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。