arXiv:2510.01456cs.LG2025-10被引 3

一种快速检测扩散模型异常数据的新方法,计算量降阶且效果顶尖。

SCOPED: Score-Curvature Out-of-distribution Proximity Evaluator for Diffusion

  • 基于得分函数的雅可比迹与模长构造统一判据
  • 单次前向传播+一次雅可比-向量积,计算成本降低一个数量级
  • 无需标注,适用于视觉、机器人控制等多场景异常检测

异常数据检测对视觉、机器人、强化学习等领域的可靠部署至关重要。本文提出针对扩散模型的得分-曲率异常检测方法SCOPED,相比以往方法将模型前向传播次数减少一个数量级,性能超越多数扩散基基线并接近最强方法。SCOPED仅需一次在多样化数据集上训练的扩散模型,通过结合得分函数的雅可比迹与平方范数生成单一测试统计量。不采用固定阈值,而是用核密度估计法估计分布内得分密度,实现灵活无监督检测;最简情形下仅需一次前向传播和一次雅可比-向量积(JVP),利用Hutchinson迹估计实现高效计算。在四个视觉基准上,尽管计算成本低,仍达到竞争性或领先水平的精确率-召回率表现。该方法还可推广至共享状态与动作空间的机器人控制任务,有效识别不同奖励函数与训练策略下的分布偏移。结果表明,SCOPED为现实世界中感知伪影、自回归模型异常检测、强化学习探索及无监督训练数据筛选提供了实用的快速可靠异常检测基础。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection is essential for reliable deployment of machine learning systems in vision, robotics, reinforcement learning, and beyond. We introduce Score-Curvature Out-of-distribution Proximity Evaluator for Diffusion (SCOPED), a fast and general-purpose OOD detection method for diffusion models that reduces the number of forward passes on the trained model by an order of magnitude compared to prior methods, outperforming most diffusion-based baselines and closely approaching the accuracy of the strongest ones. SCOPED is computed from a single diffusion model trained once on a diverse dataset, and combines the Jacobian trace and squared norm of the model's score function into a single test statistic. Rather than thresholding on a fixed value, we estimate the in-distribution density of SCOPED scores using kernel density estimation, enabling a flexible, unsupervised test that, in the simplest case, only requires a single forward pass and one Jacobian-vector product (JVP), made efficient by Hutchinson's trace estimator. On four vision benchmarks, SCOPED achieves competitive or state-of-the-art precision-recall scores despite its low computational cost. The same method generalizes to robotic control tasks with shared state and action spaces, identifying distribution shifts across reward functions and training regimes. These results position SCOPED as a practical foundation for fast and reliable OOD detection in real-world domains, including perceptual artifacts in vision, outlier detection in autoregressive models, exploration in reinforcement learning, and dataset curation for unsupervised training.

扩散模型异常检测机器学习可靠性无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。