arXiv:2508.11339cs.CV2025-08

提出索引对齐蒸馏,解决增量检测中旧知识遗忘问题。

Index-Aligned Query Distillation for Transformer-based Incremental Object Detection

  • 用相同索引的查询对应关系替代匈牙利匹配,稳定旧知识编码。
  • 仅对关键查询进行蒸馏,保留旧类别语义与空间特征。
  • 在多个基准上实现新最佳性能,适合持续学习场景。

增量目标检测(IOD)旨在持续扩展模型对新类别的检测能力,同时保持对旧类别的性能。采用基于Transformer的检测模型时,灾难性遗忘问题不可避免,即旧类别的检测性能可能严重下降。以往方法主要依赖知识蒸馏(KD)缓解此问题,通常使用匈牙利匹配建立前后阶段检测模型查询间的对应关系,并对匹配查询的分类器与回归器输出进行对齐。然而我们发现,在IOD任务中,匈牙利匹配并不合适:当前阶段的查询可能在不同迭代中匹配到前一阶段的不同查询,导致每个查询中的旧知识被重塑以适应新类别,从而造成旧知识遗忘。为此,我们提出一种名为索引对齐查询蒸馏(IAQD)的新蒸馏方法。IAQD不仅建立前后阶段模型中同索引查询的对应关系,还仅对对旧类别检测至关重要的部分查询进行蒸馏。该策略有效保留了旧类别的语义与空间编码能力,同时避免干扰新类别的学习。在多个代表性基准上的大量实验表明,IAQD能显著缓解知识遗忘,达到新的最先进性能。

原文摘要 · Abstract (English)

Incremental object detection (IOD) aims to continuously expand the capability of a model to detect novel categories while preserving its performance on previously learned ones. When adopting a transformer-based detection model to perform IOD, catastrophic knowledge forgetting may inevitably occur, meaning the detection performance on previously learned categories may severely degenerate. Previous typical methods mainly rely on knowledge distillation (KD) to mitigate the catastrophic knowledge forgetting of transformer-based detection models. Specifically, they utilize Hungarian Matching to build a correspondence between the queries of the last-phase and current-phase detection models and align the classifier and regressor outputs between matched queries to avoid knowledge forgetting. However, we observe that in IOD task, Hungarian Matching is not a good choice. With Hungarian Matching, the query of the current-phase model may match different queries of the last-phase model at different iterations during KD. As a result, the knowledge encoded in each query may be reshaped towards new categories, leading to the forgetting of previously encoded knowledge of old categories. Based on our observations, we propose a new distillation approach named Index-Aligned Query Distillation (IAQD) for transformer-based IOD. Beyond using Hungarian Matching, IAQD establishes a correspondence between queries of the previous and current phase models that have the same index. Moreover, we perform index-aligned distillation only on partial queries which are critical for the detection of previous categories. In this way, IAQD largely preserves the previous semantic and spatial encoding capabilities without interfering with the learning of new categories. Extensive experiments on representative benchmarks demonstrate that IAQD effectively mitigates knowledge forgetting, achieving new state-of-the-art performance.

增量检测Transformer知识蒸馏持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。