用扩散模型生成可可视化的目标级异常图像,提升目标检测的分布外检测能力。
Dream-Box: Object-wise Outlier Generation for Out-of-Distribution Detection
- 基于扩散模型在像素空间生成目标级异常样本
- 在COCO和PASCAL VOC上实现与传统方法相当的检测性能
- 首次提供分布外异常目标的清晰可视化,便于分析失败模式
深度神经网络在训练集与测试集来自同一分布的任务中表现出强大泛化能力,但分布外(OOD)检测仍是近年重要挑战。OOD检测旨在识别非训练分布的样本,同时保持对分布内任务(如分类或目标检测)的良好性能。近期研究通过生成合成异常样本并用于训练异常检测器,显著提升了检测效果。现有方法多在特征空间或像素空间生成异常:特征空间方法性能强但无法可视化异常,难以分析失败原因;而基于扩散模型的像素空间生成虽能提供可视化且在图像分类中表现良好,但尚未应用于目标检测。本文提出Dream-Box,首次实现像素空间中的目标级异常生成,利用扩散模型生成目标级异常样本,联合训练目标检测器与分布外检测能力。该方法在COCO和PASCAL VOC数据集上达到与传统方法相当的性能,并首次提供真实的分布外目标可视化,助力故障分析。
原文摘要 · Abstract (English)
Deep neural networks have demonstrated great generalization capabilities for tasks whose training and test sets are drawn from the same distribution. Nevertheless, out-of-distribution (OOD) detection remains a challenging task that has received significant attention in recent years. Specifically, OOD detection refers to the detection of instances that do not belong to the training distribution, while still having good performance on the in-distribution task (e.g., classification or object detection). Recent work has focused on generating synthetic outliers and using them to train an outlier detector, generally achieving improved OOD detection than traditional OOD methods. In this regard, outliers can be generated either in feature or pixel space. Feature space driven methods have shown strong performance on both the classification and object detection tasks, at the expense that the visualization of training outliers remains unknown, making further analysis on OOD failure modes challenging. On the other hand, pixel space outlier generation techniques enabled by diffusion models have been used for image classification using, providing improved OOD detection performance and outlier visualization, although their adaption to the object detection task is as yet unexplored. We therefore introduce Dream-Box, a method that provides a link to object-wise outlier generation in the pixel space for OOD detection. Specifically, we use diffusion models to generate object-wise outliers that are used to train an object detector for an in-distribution task and OOD detection. Our method achieves comparable performance to previous traditional methods while being the first technique to provide concrete visualization of generated OOD objects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。