利用主模型自身输出范围实现快速异常检测
RangeAD: Fast On-Model Anomaly Detection
- 基于主模型的神经元输出范围设计异常检测算法
- 高维任务下性能优于传统方法,推理成本大幅降低
- 适合需要高效实时异常检测的部署场景
实践中,机器学习方法常需异常检测(AD)来过滤输入或发现分布偏移。通常通过在主模型外独立运行一个AD模型实现,但这种分离方式忽略了主模型已编码目标分布的大量信息。本文提出‘在模型内异常检测’(On-Model AD)设定,明确利用相关主模型的信息。在此设定下,我们提出RangeAD算法,利用主模型中神经元的输出范围进行异常判断。该方法在高维任务上表现优异,同时显著降低推理开销。结果表明,On-Model AD具有作为高效异常检测实用框架的巨大潜力。
原文摘要 · Abstract (English)
In practice, machine learning methods commonly require anomaly detection (AD) to filter inputs or detect distributional shifts. Typically, this is implemented by running a separate AD model alongside the primary model. However, this separation ignores the fact that the primary model already encodes substantial information about the target distribution. In this paper, we introduce On-Model AD, a setting for anomaly detection that explicitly leverages access to a related machine learning model. Within this setting, we propose RangeAD, an algorithm that utilizes neuron-wise output ranges derived from the primary model. RangeAD achieves superior performance even on high-dimensional tasks while incurring substantially lower inference costs. Our results demonstrate the potential of the On-Model AD setting as a practical framework for efficient anomaly detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。