arXiv:2607.14560cs.CV2026-07

提出新框架缓解长序列3D目标检测中的模型遗忘问题。

Breaking the Model Forgetting Cycle in Long-Incremental 3D Object Detection

论文配图:Breaking the Model Forgetting Cycle in Long-Incremental 3D Object Detection
图 1 · 摘自论文原文
  • 通过监控学习动态,分阶段回顾遗忘最严重的物体。
  • 在SUN RGB-D和ScanNetV2上显著降低遗忘率,优于所有基线。
  • 适合长期增量学习场景,尤其对复杂室内环境有效。

增量式3D目标检测需在连续接收数据时学习新类别并记住旧类别。现有基于伪标签的方法在短序列中表现尚可,但在长序列中仍面临严重模型遗忘。我们分析发现存在一种有害的自我强化循环:新类别的数据分布变化导致旧类别遗忘,进而引发伪标签累积误差,加剧模型退化。受人类学习过程启发,我们提出学习动态驱动的记忆与回顾框架(LDMR)。LDMR在周期性训练检查点监控每类检测质量,利用学习动态信号驱动两个创新机制:(i) 类似人类的阶段内回顾,将每个增量阶段划分为多个子阶段,聚焦于记忆最易遗忘的物体;(ii) 场景感知的跨阶段记忆演化,通过联合考虑场景可学性和多样性,进化记忆库以实现连续阶段间知识迁移。在室内基准SUN RGB-D和ScanNetV2上的多组长增量协议实验表明,LDMR显著缓解了模型遗忘,性能全面超越各基线。代码已开源:https://github.com/qianpeisheng/LDMR。

原文摘要 · Abstract (English)

Incremental 3D object detection requires a detector to learn novel object classes while remembering previously learned ones over sequentially arriving data. Previous methods, primarily based on pseudo-labeling, perform reasonably in short-incremental stages but still suffer from severe model forgetting when dealing with long-incremental sequences. We investigate this failure and reveal a detrimental self-reinforcing cycle: data distribution shift of novel classes causes model forgetting on old classes, which further produces accumulated error in pseudo-labeling that exacerbates model degradation. To address this issue, we draw inspiration from the human learning process and propose the \emph{Learning-Dynamics-driven Memory and Review} (LDMR) framework. LDMR monitors per-class detection quality at periodic training checkpoints and uses these learning-dynamics signals to drive two innovative mechanisms, namely (i) human-like intra-stage review that divides each incremental stage into multiple sub-stages' training and concentrates on remembering the most-forgotten objects, and (ii) scene-aware cross-stage memory evolution that evolves a memory bank to transfer knowledge between two consecutive stages by jointly considering scene learnability and diversity. Extensive experiments across multiple long-incremental protocols on indoor benchmarks SUN RGB-D and ScanNetV2 show that LDMR substantially mitigates the model forgetting and outperforms all baselines by a clear margin. Code is available at https://github.com/qianpeisheng/LDMR.

3D检测增量学习模型遗忘记忆机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。