arXiv:2412.17619cs.CV2024-12AAAI被引 34

通过图结构建模视觉特征跨层关系,提升少样本异常检测精度

Kernel-Aware Graph Prompt Learning for Few-Shot Anomaly Detection

  • 构建分层图结构,捕捉不同层级特征间的上下文关系
  • 在MVTecAD和VisA上实现图像级与像素级最优性能
  • 适合关注少样本异常检测与视觉表征融合的研究者

少样本异常检测(FSAD)旨在仅依赖极少量同类正常支持图像的情况下,识别未见过的异常区域。现有方法通常通过设计复杂文本提示来对齐视觉特征,但普遍忽视了视觉特征中固有的上下文信息,例如不同视觉层之间的交互关系,而这些关系对全面检测异常至关重要。为此,我们提出一种核感知图提示学习框架——KAG-prompt,通过推理视觉特征的跨层关系实现FSAD。具体而言,以关注不同尺度异常区域的各层特征为节点,任意两节点间的关系作为边,构建核感知分层图。通过图上的消息传递机制,KAG-prompt可捕获跨层上下文信息,从而提升异常预测准确性。此外,为融合预测图中的多级异常信号,提出基于多层级信息融合的图像级评分方法。在MVTecAD和VisA数据集上的大量实验表明,KAG-prompt在图像级/像素级异常检测上均达到当前最优性能。代码已公开于https://github.com/CVL-hub/KAG-prompt.git。

原文摘要 · Abstract (English)

Few-shot anomaly detection (FSAD) aims to detect unseen anomaly regions with the guidance of very few normal support images from the same class. Existing FSAD methods usually find anomalies by directly designing complex text prompts to align them with visual features under the prevailing large vision-language model paradigm. However, these methods, almost always, neglect intrinsic contextual information in visual features, e.g., the interaction relationships between different vision layers, which is an important clue for detecting anomalies comprehensively. To this end, we propose a kernel-aware graph prompt learning framework, termed as KAG-prompt, by reasoning the cross-layer relations among visual features for FSAD. Specifically, a kernel-aware hierarchical graph is built by taking the different layer features focusing on anomalous regions of different sizes as nodes, meanwhile, the relationships between arbitrary pairs of nodes stand for the edges of the graph. By message passing over this graph, KAG-prompt can capture cross-layer contextual information, thus leading to more accurate anomaly prediction. Moreover, to integrate the information of multiple important anomaly signals in the prediction map, we propose a novel image-level scoring method based on multi-level information fusion. Extensive experiments on MVTecAD and VisA datasets show that KAG-prompt achieves state-of-the-art FSAD results for image-level/pixel-level anomaly detection. Code is available at https://github.com/CVL-hub/KAG-prompt.git.

异常检测少样本学习图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。