arXiv:2505.09265cs.CVcs.AI2025-05中稿 · NeurIPS被引 16

用一张正常图就能识别任意新异常,无需语言提示和训练。

MetaUAS: Universal Anomaly Segmentation with One-Prompt Meta-Learning

  • 将异常分割统一为变化分割,利用合成图像对进行训练。
  • 仅需一个正常样本提示,在零样本场景下超越现有方法。
  • 纯视觉模型,无需语言模型或特定数据集,适合通用异常检测。

零样本和少样本视觉异常分割依赖强大的视觉-语言模型,通过人工设计的文本提示检测未见异常。然而,视觉表征与语言本身是独立的。本文探索纯视觉基础模型作为替代方案,实现通用视觉异常分割。提出一种新范式,将异常分割统一为变化分割,从而利用大规模合成图像对(来自现有图像数据集)进行训练,这些图像对包含对象级和局部区域的变化,且不依赖目标异常数据集。我们提出一种基于单提示的元学习框架(MetaUAS),在合成数据上训练后,可泛化至真实世界中任意新异常的分割。为应对提示图与查询图间的几何差异,设计了软特征对齐模块,连接成对图像的变化感知与单图语义分割。这是首个完全基于纯视觉模型实现通用异常分割的工作,无需特殊异常检测数据集或预训练视觉-语言模型。该方法仅需一个正常图像提示,无需语言引导且无需训练,高效准确地分割各类异常。MetaUAS显著优于此前的零样本、少样本甚至全样本异常分割方法。代码与预训练模型已公开于 https://github.com/gaobb/MetaUAS。

原文摘要 · Abstract (English)

Zero- and few-shot visual anomaly segmentation relies on powerful vision-language models that detect unseen anomalies using manually designed textual prompts. However, visual representations are inherently independent of language. In this paper, we explore the potential of a pure visual foundation model as an alternative to widely used vision-language models for universal visual anomaly segmentation. We present a novel paradigm that unifies anomaly segmentation into change segmentation. This paradigm enables us to leverage large-scale synthetic image pairs, featuring object-level and local region changes, derived from existing image datasets, which are independent of target anomaly datasets. We propose a one-prompt Meta-learning framework for Universal Anomaly Segmentation (MetaUAS) that is trained on this synthetic dataset and then generalizes well to segment any novel or unseen visual anomalies in the real world. To handle geometrical variations between prompt and query images, we propose a soft feature alignment module that bridges paired-image change perception and single-image semantic segmentation. This is the first work to achieve universal anomaly segmentation using a pure vision model without relying on special anomaly detection datasets and pre-trained visual-language models. Our method effectively and efficiently segments any anomalies with only one normal image prompt and enjoys training-free without guidance from language. Our MetaUAS significantly outperforms previous zero-shot, few-shot, and even full-shot anomaly segmentation methods. The code and pre-trained models are available at https://github.com/gaobb/MetaUAS.

异常分割视觉模型零样本元学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。