YOLO-IOD让实时目标检测模型能持续学习新类别,不遗忘旧知识。
YOLO-IOD: Towards Real Time Incremental Object Detection
- 针对YOLO框架设计分阶段高效微调,解决遗忘问题。
- 在常规和新基准上均实现高精度与低遗忘率。
- 适合需要实时更新的视觉系统开发者使用。
当前增量目标检测方法多基于Faster R-CNN或DETR系列,难以适配实时的YOLO框架。本文首次识别出导致YOLO类增量检测灾难性遗忘的三类知识冲突:前景-背景混淆、参数干扰、知识蒸馏错位。为此提出YOLO-IOD,基于预训练YOLO-World模型,通过分阶段参数高效微调实现增量学习。包含三个核心组件:1)冲突感知伪标签优化(CPR),利用伪标签置信度缓解前景-背景混淆;2)重要性驱动卷积核选择(IKS),定位并更新当前任务关键卷积核;3)跨阶段非对称知识蒸馏(CAKD),通过前后教师检测头传递学生特征,实现新旧类别间的不对称蒸馏。此外构建了更真实的LoCo COCO基准以消除阶段间数据泄露。在传统及LoCo COCO基准上实验表明,YOLO-IOD性能优越且遗忘极少。
原文摘要 · Abstract (English)
Current methods for incremental object detection (IOD) primarily rely on Faster R-CNN or DETR series detectors; however, these approaches do not accommodate the real-time YOLO detection frameworks. In this paper, we first identify three primary types of knowledge conflicts that contribute to catastrophic forgetting in YOLO-based incremental detectors: foreground-background confusion, parameter interference, and misaligned knowledge distillation. Subsequently, we introduce YOLO-IOD, a real-time Incremental Object Detection (IOD) framework that is constructed upon the pretrained YOLO-World model, facilitating incremental learning via a stage-wise parameter-efficient fine-tuning process. Specifically, YOLO-IOD encompasses three principal components: 1) Conflict-Aware Pseudo-Label Refinement (CPR), which mitigates the foreground-background confusion by leveraging the confidence levels of pseudo labels and identifying potential objects relevant to future tasks. 2) Importancebased Kernel Selection (IKS), which identifies and updates the pivotal convolution kernels pertinent to the current task during the current learning stage. 3) Cross-Stage Asymmetric Knowledge Distillation (CAKD), which addresses the misaligned knowledge distillation conflict by transmitting the features of the student target detector through the detection heads of both the previous and current teacher detectors, thereby facilitating asymmetric distillation between existing and newly introduced categories. We further introduce LoCo COCO, a more realistic benchmark that eliminates data leakage across stages. Experiments on both conventional and LoCo COCO benchmarks show that YOLO-IOD achieves superior performance with minimal forgetting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。