用大模型知识生成更真实的异常样本,提升视觉异常检测效果
KKA: Improving Vision Anomaly Detection through Anomaly-related Knowledge from Large Language Models
- 从大模型提取异常知识,生成与正常样本相关的异常图像
- 区分易/难异常样本,逐步增加难样本比例以优化检测边界
- 无需高成本生成,显著提升多种检测器性能
视觉异常检测在无监督场景下常因异常多样性难以区分正常与异常样本。现有方法通过生成异常帮助学习有效边界,但生成异常多依赖随机因素,缺乏真实性,且与正常样本差异过大,难以构建有效边界。为此,本文提出关键知识增强(KKA)方法,利用大语言模型(LLMs)的先验知识,基于正常样本生成语义相关异常。KKA根据生成异常与正常样本的相似度,将其分类为易异常(差异大)和难异常(接近正常)。通过迭代更新生成策略,逐步提高难异常比例,使检测器学习更精细的边界。实验表明,该方法显著提升多种视觉异常检测器性能,同时保持低生成成本。
原文摘要 · Abstract (English)
Vision anomaly detection, particularly in unsupervised settings, often struggles to distinguish between normal samples and anomalies due to the wide variability in anomalies. Recently, an increasing number of studies have focused on generating anomalies to help detectors learn more effective boundaries between normal samples and anomalies. However, as the generated anomalies are often derived from random factors, they frequently lack realism. Additionally, randomly generated anomalies typically offer limited support in constructing effective boundaries, as most differ substantially from normal samples and lie far from the boundary. To address these challenges, we propose Key Knowledge Augmentation (KKA), a method that extracts anomaly-related knowledge from large language models (LLMs). More specifically, KKA leverages the extensive prior knowledge of LLMs to generate meaningful anomalies based on normal samples. Then, KKA classifies the generated anomalies as easy anomalies and hard anomalies according to their similarity to normal samples. Easy anomalies exhibit significant differences from normal samples, whereas hard anomalies closely resemble normal samples. KKA iteratively updates the generated anomalies, and gradually increasing the proportion of hard anomalies to enable the detector to learn a more effective boundary. Experimental results show that the proposed method significantly improves the performance of various vision anomaly detectors while maintaining low generation costs. The code for CMG can be found at https://github.com/Anfeather/KKA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。