arXiv:2410.01322cs.LGcs.AI2024-10ICLR被引 11

用语义典型性检测异常数据,比传统方法更准。

Forte : Finding Outliers with Representation Typicality Estimation

论文配图:Forte : Finding Outliers with Representation Typicality Estimation
图 1 · 摘自论文原文
  • 基于自监督表示学习估计数据典型集
  • 在多个基准上达到当前最佳性能
  • 特别适合检测合成数据与近似异常

生成模型如今能创造出几乎无法与真实训练数据区分的逼真合成数据,这超越了以往可被人类轻易分辨的生成效果。近期研究质疑生成模型似然值作为分布外(OOD)检测器的有效性,原因包括似然误估、生成过程中的熵问题及典型性偏差。我们推测,生成式方法失败在于其关注像素而非语义内容,导致在像素相似但信息不同的近似异常情况下失效。为此,我们提出一种新方法:利用表示学习与基于流形估计的信息统计量,解决上述问题。该方法在多个公开基准和新的合成数据检测任务中表现优于现有无监督方法,达到当前最优水平。

原文摘要 · Abstract (English)

Generative models can now produce photorealistic synthetic data which is virtually indistinguishable from the real data used to train it. This is a significant evolution over previous models which could produce reasonable facsimiles of the training data, but ones which could be visually distinguished from the training data by human evaluation. Recent work on OOD detection has raised doubts that generative model likelihoods are optimal OOD detectors due to issues involving likelihood misestimation, entropy in the generative process, and typicality. We speculate that generative OOD detectors also failed because their models focused on the pixels rather than the semantic content of the data, leading to failures in near-OOD cases where the pixels may be similar but the information content is significantly different. We hypothesize that estimating typical sets using self-supervised learners leads to better OOD detectors. We introduce a novel approach that leverages representation learning, and informative summary statistics based on manifold estimation, to address all of the aforementioned issues. Our method outperforms other unsupervised approaches and achieves state-of-the art performance on well-established challenging benchmarks, and new synthetic data detection tasks.

异常检测生成模型表示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。