解决Transformer检测器增量学习中的背景误判问题,提升记忆保持能力。
Better Matching, Less Forgetting: A Quality-Guided Matcher for Transformer-based Incremental Object Detection
- 用质量引导的最小费用最大流算法替代匈牙利匹配,避免背景误匹配。
- 在COCO数据集上,新方法在多种增量设置下均超越现有最佳模型。
- 特别适合需要长期学习新类别的目标检测系统使用。
增量目标检测(IOD)旨在持续学习新类别而不遗忘旧类别。一个主要挑战是灾难性遗忘,传统检测器中主要源于背景分布变化。尽管伪标签能缓解密集检测器的遗忘问题,我们发现DETR类架构存在一种新型、独特的遗忘源:背景前景化。这由匈牙利匹配的完备性约束引发——即使预测主要覆盖背景区域(低交并比),也强制将每个真实目标分配给一个预测。这种错误监督迫使模型将背景特征误判为特定前景类别,破坏已学表征并加速遗忘。为此,我们提出质量引导的最小费用最大流(Q-MCMF)匹配器。该方法构建流图并基于几何质量剔除不合理匹配,再优化最终匹配以最小化代价并最大化有效匹配数。此策略消除背景前景化带来的有害监督,同时最大化前景学习信号。在COCO数据集上的大量实验表明,该方法在多种增量设置下持续优于现有最先进方法。
原文摘要 · Abstract (English)
Incremental Object Detection (IOD) aims to continuously learn new object classes without forgetting previously learned ones. A persistent challenge is catastrophic forgetting, primarily attributed to background shift in conventional detectors. While pseudo-labeling mitigates this in dense detectors, we identify a novel, distinct source of forgetting specific to DETR-like architectures: background foregrounding. This arises from the exhaustiveness constraint of the Hungarian matcher, which forcibly assigns every ground truth target to one prediction, even when predictions primarily cover background regions (i.e., low IoU). This erroneous supervision compels the model to misclassify background features as specific foreground classes, disrupting learned representations and accelerating forgetting. To address this, we propose a Quality-guided Min-Cost Max-Flow (Q-MCMF) matcher. To avoid forced assignments, Q-MCMF builds a flow graph and prunes implausible matches based on geometric quality. It then optimizes for the final matching that minimizes cost and maximizes valid assignments. This strategy eliminates harmful supervision from background foregrounding while maximizing foreground learning signals. Extensive experiments on the COCO dataset under various incremental settings demonstrate that our method consistently outperforms existing state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。