新方法通过能量分离提升未知物体检测能力,同时避免旧知识遗忘。
Detecting Unknown Objects via Energy-based Separation for Open World Object Detection
- 利用等角紧框架构建正交子空间,清晰分离已知与未知物体特征
- 在多个基准上实现未知物体检测率提升,已知类别性能保持领先
- 适合需要持续学习且关注未知目标识别的开放世界检测场景
本文针对开放世界目标检测(OWOD)问题,提出DEUS(基于能量分离的未知物体检测)框架。该框架包含基于等角紧框架的未知分离模块(EUS)和基于能量的已知类区分损失(EKD)。EUS利用等角紧框架的几何特性建立正交子空间,实现已知与未知物体表征的更清晰分离;相比仅关注已知空间的已有能量方法,EUS同时利用双空间能量以更好捕捉未知物体的特征模式。EKD损失则强化历史与当前分类器间的分离,降低记忆回放过程中的知识干扰。在多个OWOD基准上验证表明,DEUS显著提升未知物体检测性能,同时保持优异的已知类别检测表现。
原文摘要 · Abstract (English)
In this work, we tackle the problem of Open World Object Detection (OWOD). This challenging scenario requires the detector to incrementally learn to classify known objects without forgetting while identifying unknown objects without supervision. Previous OWOD methods have enhanced the unknown discovery process and employed memory replay to mitigate catastrophic forgetting. However, since existing methods heavily rely on the detector's known class predictions for detecting unknown objects, they struggle to effectively learn and recognize unknown object representations. Moreover, while memory replay mitigates forgetting of old classes, it often sacrifices the knowledge of newly learned classes. To resolve these limitations, we propose DEUS (Detecting Unknowns via energy-based Separation), a novel framework that addresses the challenges of Open World Object Detection. DEUS consists of Equiangular Tight Frame (ETF)-Subspace Unknown Separation (EUS) and an Energy-based Known Distinction (EKD) loss. EUS leverages ETF-based geometric properties to create orthogonal subspaces, enabling cleaner separation between known and unknown object representations. Unlike prior energy-based approaches that consider only the known space, EUS utilizes energies from both spaces to better capture distinct patterns of unknown objects. Furthermore, EKD loss enforces the separation between previous and current classifiers, thus minimizing knowledge interference between previous and newly learned classes during memory replay. We thoroughly validate DEUS on OWOD benchmarks, demonstrating outstanding performance improvements in unknown detection while maintaining competitive known class performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。