arXiv:2503.15295cs.CV2025-03AAAI被引 10

解决增量检测中识别能力退化问题,提出分步优化策略

DCA: Dividing and Conquering Amnesia in Incremental Object Detection

  • 将检测流程拆分为定位与识别两阶段,分别应对遗忘问题
  • 在MS-COCO上长期增量场景下最终平均精度提升6.9%
  • 利用语言模型语义知识稳定识别特征,适合长期增量学习任务

增量目标检测(IOD)旨在构建可持续识别新类别的检测器,同时保持对旧类别的性能。现有方法通过改进知识蒸馏和实例回放在基于Transformer的框架中取得进展,但内在遗忘机制仍不明确。本文深入分析发现,基于Transformer的IOD存在定位与识别间的遗忘不平衡:定位能力更稳健且可泛化至未来类别,而识别部分易发生灾难性遗忘。据此,我们提出分治遗忘(DCA)策略,将检测流程重构为先定位后识别的两阶段过程。DCA能有效维持并传递定位能力,将脆弱的识别部分独立处理。为减少识别特征漂移,我们利用预训练语言模型中的语义知识,将类别表征锚定在统一特征空间中。具体通过双路分类器融合,并以查询形式嵌入类别语义特征到识别解码过程。大量实验验证,该方法在长期增量场景下达到领先性能。例如,在MS-COCO四阶段设置下,最终平均精度(AP)显著提升6.9%。

原文摘要 · Abstract (English)

Incremental object detection (IOD) aims to cultivate an object detector that can continuously localize and recognize novel classes while preserving its performance on previous classes. Existing methods achieve certain success by improving knowledge distillation and exemplar replay for transformer-based detection frameworks, but the intrinsic forgetting mechanisms remain underexplored. In this paper, we dive into the cause of forgetting and discover forgetting imbalance between localization and recognition in transformer-based IOD, which means that localization is less-forgetting and can generalize to future classes, whereas catastrophic forgetting occurs primarily on recognition. Based on these insights, we propose a Divide-and-Conquer Amnesia (DCA) strategy, which redesigns the transformer-based IOD into a localization-then-recognition process. DCA can well maintain and transfer the localization ability, leaving decoupled fragile recognition to be specially conquered. To reduce feature drift in recognition, we leverage semantic knowledge encoded in pre-trained language models to anchor class representations within a unified feature space across incremental tasks. This involves designing a duplex classifier fusion and embedding class semantic features into the recognition decoding process in the form of queries. Extensive experiments validate that our approach achieves state-of-the-art performance, especially for long-term incremental scenarios. For example, under the four-step setting on MS-COCO, our DCA strategy significantly improves the final AP by 6.9%.

增量学习目标检测Transformer遗忘抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。