arXiv:2512.00229cs.LGcs.CV2025-12

通过闭环迭代提升模型对异常输入的识别与不确定性估计能力。

TIE: A Training-Inversion-Exclusion Framework for Visually Interpretable and Uncertainty-Guided Out-of-Distribution Detection

  • 引入垃圾类并迭代训练、反演、排除,让模型自动生成异常样本原型。
  • 在MNIST/FashionMNIST上测试时,误报率接近0(≈0 FPR@95%TPR)。
  • 无需外部异常数据,结果可视觉解释,适合需要可信AI的场景。

深度神经网络常无法识别超出训练范围的输入,导致不可靠且过度自信的预测。构建可靠的机器学习系统需同时具备预测不确定性和异常检测能力。本文提出TIE框架,通过训练-反演-排除的闭环迭代机制,将标准n分类器扩展为包含一个垃圾类的(n+1)分类模型。该垃圾类初始为高斯噪声,用于表示异常输入。每轮训练后,从分类器反演出高置信度的异常样本,并将其排除至垃圾类。随着迭代进行,反演样本从噪声逐渐变为具视觉一致性的类别原型,揭示模型对数据流形的学习过程。推理时,模型通过将异常输入映射到垃圾类或生成低置信度误判来拒绝异常,无需依赖外部异常数据集。基于多个指标的全面评估显示,该方法在使用MNIST或FashionMNIST训练并在多种未见数据集上测试时,实现近乎完美的异常检测性能(≈0 FPR@95%TPR),同时提供可解释的不确定性估计。

原文摘要 · Abstract (English)

Deep neural networks often struggle to recognize when an input lies outside their training experience, leading to unreliable and overconfident predictions. Building dependable machine learning systems therefore requires methods that can both estimate predictive \textit{uncertainty} and detect \textit{out-of-distribution (OOD)} samples in a unified manner. In this paper, we propose \textbf{TIE: a Training--Inversion--Exclusion} framework for visually interpretable and uncertainty-guided anomaly detection that jointly addresses these challenges through iterative refinement. TIE extends a standard $n$-class classifier to an $(n+1)$-class model by introducing a garbage class initialized with Gaussian noise to represent outlier inputs. Within each epoch, TIE performs a closed-loop process of \textit{training, inversion, and exclusion}, where highly uncertain inverted samples reconstructed from the just-trained classifier are excluded into the garbage class. Over successive iterations, the inverted samples transition from noisy artifacts into visually coherent class prototypes, providing transparent insight into how the model organizes its learned manifolds. During inference, TIE rejects OOD inputs by either directly mapping them to the garbage class or producing low-confidence, uncertain misclassifications within the in-distribution classes that are easily separable, all without relying on external OOD datasets. A comprehensive threshold-based evaluation using multiple OOD metrics and performance measures such as \textit{AUROC}, \textit{AUPR}, and \textit{FPR@95\%TPR} demonstrates that TIE offers a unified and interpretable framework for robust anomaly detection and calibrated uncertainty estimation (UE) achieving near-perfect OOD detection with \textbf{\(\!\approx\!\) 0 FPR@95\%TPR} when trained on MNIST or FashionMNIST and tested against diverse unseen datasets.

异常检测不确定性估计可解释性闭环训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。