arXiv:2409.06424cs.CV2024-09IJCV被引 15

用似然比方法检测未知物体,不破坏大模型原有能力。

A Likelihood Ratio-Based Approach to Segmenting Unknown Objects

  • 设计轻量模块学习已知与未知分布,实现无损异常监督。
  • 在多个数据集上提升平均精度5.74个百分点,误报率更低。
  • 适合需要开放世界感知的视觉系统,尤其大型模型部署场景。

解决开放世界环境中分布外(OoD)分割问题,是感知系统运行的前提。尽管大型基础模型常用于下游任务,其在分布外场景下的潜力仍待挖掘。本文旨在利用大模型构建鲁棒表征,同时避免传统异常监督需重训练部分网络的问题——这会破坏已有特征表示,且对大模型不可行。为此,提出一种自适应、轻量级的未知估计模块(UEM),可显著提升分布外分割性能,且不损害原模型的表征能力。UEM学习未知类和通用已知类的分布,基于此构建似然比得分函数,融合UEM置信度与像素级分割网络置信度,实现未知物体检测。此外,提出直接优化该得分的损失函数。实验表明,本方法在多个数据集上达到新基准,平均精度提升5.74个百分点,同时保持更低误报率,且原模型在已知类别上的表现不受影响。

原文摘要 · Abstract (English)

Addressing the Out-of-Distribution (OoD) segmentation task is a prerequisite for perception systems operating in an open-world environment. Large foundational models are frequently used in downstream tasks, however, their potential for OoD remains mostly unexplored. We seek to leverage a large foundational model to achieve robust representation. Outlier supervision is a widely used strategy for improving OoD detection of the existing segmentation networks. However, current approaches for outlier supervision involve retraining parts of the original network, which is typically disruptive to the model's learned feature representation. Furthermore, retraining becomes infeasible in the case of large foundational models. Our goal is to retrain for outlier segmentation without compromising the strong representation space of the foundational model. To this end, we propose an adaptive, lightweight unknown estimation module (UEM) for outlier supervision that significantly enhances the OoD segmentation performance without affecting the learned feature representation of the original network. UEM learns a distribution for outliers and a generic distribution for known classes. Using the learned distributions, we propose a likelihood-ratio-based outlier scoring function that fuses the confidence of UEM with that of the pixel-wise segmentation inlier network to detect unknown objects. We also propose an objective to optimize this score directly. Our approach achieves a new state-of-the-art across multiple datasets, outperforming the previous best method by 5.74% average precision points while having a lower false-positive rate. Importantly, strong inlier performance remains unaffected.

OoD分割异常检测大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。