arXiv:2606.15253cs.CV2026-06中稿 · ICML被引 1

解决增量目标检测中梯度稀释问题,提升模型对旧类知识的保留能力。

Focus, Align, and Sustain: Counteracting Gradient Dilution in Incremental Object Detection

论文配图:Focus, Align, and Sustain: Counteracting Gradient Dilution in Incremental Object Detection
图 1 · 摘自论文原文
  • 引入先验注入查询,聚焦关键特征信号,抑制背景干扰。
  • 通过确定性锚点蒸馏,稳定查询-目标匹配,保持语义一致性。
  • 采用流形支持回放,维持旧类别特征分布,防止表征退化。

将检测变换器应用于增量目标检测(IOD)面临系统性挑战,因基于集合的优化在序列学习中易失稳。本文识别出梯度稀释是性能下降的根本原因:保留旧知识所需的优化信号随时间逐渐弱化。该现象表现为梯度幅度、方向和覆盖范围的级联衰减,由三个紧密耦合因素驱动:信号分散(前景梯度被背景噪声淹没)、分配漂移(随机查询-目标匹配导致梯度轨迹不一致)和支持流失(保留样本的梯度不足以覆盖旧类别特征空间,导致新类别干扰下决策边界弱化)。为此,提出FAS统一框架,通过聚焦、对齐和维持梯度流动来应对。具体包括:引入先验注入查询,在源头过滤背景干扰以聚焦判别信号;提出确定性锚点蒸馏,对齐查询-目标分配,确保跨阶段语义一致性;设计流形支持回放,维持旧类别分布支持,对抗持续更新引起的表征侵蚀。大量实验表明,FAS恢复了鲁棒的优化动态,在40+10x4的挑战性设置下,相比现有最优方法提升超过5.0 AP。

原文摘要 · Abstract (English)

Adapting Detection Transformers to Incremental Object Detection (IOD) poses a systemic challenge, as set-based optimization is inherently destabilized by sequential learning. In this work, we identify Gradient Dilution as the root cause of performance degradation, wherein optimization signals required to preserve old knowledge are progressively weakened. This phenomenon manifests as a cascading erosion of preservation gradients in magnitude, direction, and support coverage, driven by three tightly coupled factors: Signal Dispersion, where foreground gradients are overwhelmed by background noise; Assignment Drift, where stochastic query-target matching induces inconsistent gradient trajectories; and Support Attrition, where gradients from retained samples insufficiently cover the old-class feature space, weakening decision boundaries under interference from new classes. To counteract this, we propose FAS, a unified framework that Focuses, Aligns, and Sustains gradient flow throughout incremental learning. Specifically, we introduce prior-injected queries to focus discriminative signals by filtering background interference at the source. We further propose deterministic anchor distillation to align query-target assignments and enforce semantic consistency across stages under unstable matching. Finally, we devise manifold-support replay to sustain distributional support of old classes, counteracting representational erosion induced by continual updates. Extensive experiments show that FAS restores robust optimization dynamics and outperforms state-of-the-art methods, achieving over 5.0 AP improvement in the challenging 40+10x4 incremental setting.

增量检测梯度稀释检测变换器知识保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。