用合成异常数据训练,让检测器同时识别常见与罕见物体。
Out-of-Distribution Object Detection in Street Scenes via Synthetic Outlier Exposure and Transfer Learning
- 用Stable Diffusion生成语义合理的异常物体数据用于训练。
- 在街景数据集上达到当前最优的平均精度,显著提升罕见物检测能力。
- 适合需要鲁棒检测罕见目标的自动驾驶等实际场景使用。
分布外(OOD)物体检测是重要但研究不足的任务。可靠的目标检测器应能定位并正确分类出其未见过的异常物体,而非将其误判为背景。现有方法多依赖复杂结构或辅助分支,且缺乏对分布内(ID)与分布外(OOD)统一处理的框架。本文提出SynOE-OD框架,利用Stable Diffusion和开放词汇目标检测器(OVODs,如GroundingDINO)生成语义合理、对象级别的合成异常数据,用于训练时的迁移学习。该方法在主流的OOD物体检测基准上实现最先进的平均精度,显著改善了现有OVOD在街景场景中对分布外物体的零样本检测性能。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) object detection is an important yet underexplored task. A reliable object detector should be able to handle OOD objects by localizing and correctly classifying them as OOD. However, a critical issue arises when such atypical objects are completely missed by the object detector and incorrectly treated as background. Existing OOD detection approaches in object detection often rely on complex architectures or auxiliary branches and typically do not provide a framework that treats in-distribution (ID) and OOD in a unified way. In this work, we address these limitations by enabling a single detector to detect OOD objects, that are otherwise silently overlooked, alongside ID objects. We present \textbf{SynOE-OD}, a \textbf{Syn}thetic \textbf{O}utlier-\textbf{E}xposure-based \textbf{O}bject \textbf{D}etection framework, that leverages strong generative models, like Stable Diffusion, and Open-Vocabulary Object Detectors (OVODs) to generate semantically meaningful, object-level data that serve as outliers during training. The generated data is used for transfer-learning to establish strong ID task performance and supplement detection models with OOD object detection robustness. Our approach achieves state-of-the-art average precision on an established OOD object detection benchmark, where OVODs, such as GroundingDINO, show limited zero-shot performance in detecting OOD objects in street-scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。