arXiv:2411.10794cs.CVcs.LG2024-11被引 3

无需外部数据,用已有数据合成难检测的异常样本提升模型安全

Image-based Outlier Synthesis With Training Data

  • 从正常数据中通过梯度扰动生成虚拟异常样本
  • 在7个数据集上超过30种方法,显著提升复杂场景检测效果
  • 特别适合处理数据中有虚假关联或类别相似的情况

分布外(OOD)检测对保障深度学习模型在关键应用中的安全性至关重要。现有模型常将分布外样本误判为分布内样本,尤其在训练集中存在虚假关联时问题更严重。在细粒度分类中,由于分布外样本与分布内样本高度相似,检测难度更高。然而当前研究多集中于较简单的常规情况,少数针对复杂场景的工作仍依赖人工标注或合成的外部异常数据。为此,本文提出统一框架ASCOOD,可在无需任何外部数据的情况下实现对虚假关联、细粒度和常规三种场景的OOD检测。方法通过在分布内样本上叠加梯度归因值,破坏不变特征并增强真实类别置信度,从而生成近流形的挑战性虚拟异常样本;同时利用z-score标准化特征,同步激励模型对正常样本的分类准确性和对虚拟异常样本的预测不确定性。在7个数据集上与30+种方法对比,ASCOOD在三类场景中均表现优异。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability worsens in the presence of spurious correlation in the training set. Likewise, in fine-grained classification settings, detection of fine-grained OOD samples becomes inherently challenging due to their high similarity to ID samples. However, current research on OOD detection has focused instead largely on relatively easier (conventional) cases. Even the few recent works addressing these challenging cases rely on carefully curated or synthesized outliers, ultimately requiring external data. This motivates our central research question: ``Can we innovate OOD detection training framework for fine-grained and spurious settings \textbf{without requiring any external data at all?}" In this work, we present a unified \textbf{A}pproach to \textbf{S}purious, fine-grained, and \textbf{C}onventional \textbf{OOD D}etection (\textbf{\ASCOOD}) that eliminates the reliance on external data. First, we synthesize virtual outliers from ID data by approximating the destruction of invariant features. Specifically, we propose to add gradient attribution values to ID inputs to disrupt invariant features while amplifying true-class logit, thereby synthesizing challenging near-manifold virtual outliers. Then, we simultaneously incentivize ID classification and predictive uncertainty towards virtual outliers. For this, we further propose to leverage standardized features with z-score normalization. ASCOOD effectively mitigates impact of spurious correlations and encourages capturing fine-grained attributes. Extensive experiments across \textbf{7} datasets and and comparisons with \textbf{30+} methods demonstrate merit of ASCOOD in spurious, fine-grained and conventional settings.

OOD检测异常生成细粒度分类模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。