arXiv:2504.10214cs.CV2025-04

区分检测器稳定与可塑组件,提升增量学习中旧类保持与新类适应能力。

Exploiting Stability-Plasticity Asymmetry in Pretrained Detectors for Incremental Object Detection

  • 按组件区分稳定性与可塑性,冻结定位头,仅微调分类相关部分。
  • 在COCO/VOC/TT100K上实现新类识别准确率提升,旧类遗忘率低于5%。
  • 创新使用质量感知伪特征回放,缓解分类侧遗忘,适合持续学习场景。

基于预训练模型的增量目标检测(PTMIOD)利用预训练检测器丰富的检测先验,持续学习新类别同时保留对旧类的检测能力。现有方法通常将预训练检测器整体使用,未明确区分应保持稳定或需灵活调整的组件。本文从组件级稳定性-可塑性视角重新审视PTMIOD。分析发现:基于DETR的检测器中,定位头在跨域任务中仍能保留可迁移的几何先验,而分类相关表示则需更强的可塑性以应对新类别。基于此,我们提出选择性适应与保留框架:冻结显式定位头以维持定位稳定性,采用参数高效微调更新变压器表示,并更新分类头以增强分类可塑性。为缓解分类侧遗忘,首次在PTMIOD中引入伪特征回放,设计质量感知高斯特征回放,从高质量匹配对象特征中估计可靠类别级特征分布,并回放采样伪特征以维持旧类决策边界。由于持续适应可能改变特征空间,破坏回放分布,我们进一步提出两阶段一致性蒸馏,在提案生成与精炼阶段分别对齐教师与学生表示。在COCO、VOC和TT100K上的大量实验表明,本方法达到最先进性能,实现了旧类保留与新类适应的良好平衡。

原文摘要 · Abstract (English)

Pretrained model-based incremental object detection (PTMIOD) leverages the rich detection priors of pretrained detectors to learn new categories incrementally while preserving detection ability on previously learned ones. Existing methods mainly exploit pretrained detectors as a whole, without explicitly distinguishing which components should remain stable and which require plastic adaptation. In this paper, we revisit PTMIOD from a component-wise stability-plasticity perspective. Our analysis of pretrained DETR-based detectors reveals a clear asymmetry: localization heads preserve transferable geometric priors across tasks, whereas classification-related representations require greater plasticity to handle new categories, especially in cross-domain scenarios where downstream data deviate from the pretraining domain. Based on this finding, we propose a selective adaptation and retention framework that freezes explicit localization heads to preserve localization stability, while adapting transformer representations with parameter-efficient fine-tuning and updating classification heads for classification-oriented plasticity. To alleviate classification-side forgetting, we pioneer the use of pseudo-feature replay in PTMIOD and design Quality-aware Gaussian Feature Replay, which estimates reliable class-wise feature distributions from high-quality matched object features and replays sampled pseudo features to maintain old-class decision boundaries. Since continual adaptation can shift the feature space and undermine replayed distributions, we further develop Two-stage Consistent Distillation to align teacher and student representations at both proposal generation and refinement stages.Extensive experiments on COCO, VOC, and TT100K show that our method achieves state-of-the-art performance, demonstrating a favorable balance between old-class retention and new-class adaptation.

增量学习目标检测特征回放稳定性-可塑性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。