arXiv:2504.04340cs.CV2025-04CVPR被引 3

无需标注即可生成真实多样的异常图像,通用性强。

AnomalyHybrid: A Domain-agnostic Generative Framework for General Anomaly Detection

  • 用参考图与目标图结合,通过双解码器融合外观与结构。
  • 在MVTecAD上生成质量达2.06 IS/0.32 LPIPS,检测精度97.3 AP。
  • 适合工业外的多种场景异常生成,尤其擅长凸起凹陷类异常。

异常生成是缓解异常检测任务数据稀缺的有效方法。现有方法多针对工业场景,依赖多个专用模块或大型生成模型,难以泛化至其他应用。本文提出AnomalyHybrid,一种无需领域知识的生成框架,仅通过组合参考图像与目标图像即可生成真实且多样化的异常。该框架基于GAN,包含两个解码器:一个将参考图像外观融入目标图像深度结构,另一个将外观融入边缘结构。深度解码器使生成结果在深度变化异常(如凸起、凹陷)上更逼真;边缘解码器放宽细粒度控制,提升多样性。训练无需标注,仅需同一图像在不同增强下的颜色、深度和边缘图。在HeliconiusButterfly、MVTecAD和MVTec3D数据集上的实验表明,AnomalyHybrid在异常生成及下游分类、检测、分割任务中均超越现有基于GAN的先进方法。在MVTecAD上,生成质量为2.06 IS / 0.32 LPIPS,ResNet34分类准确率达52.6%,使用简单UNet实现图像级与像素级检测的AP分别为97.3和72.9。

原文摘要 · Abstract (English)

Anomaly generation is an effective way to mitigate data scarcity for anomaly detection task. Most existing works shine at industrial anomaly generation with multiple specialists or large generative models, rarely generalizing to anomalies in other applications. In this paper, we present AnomalyHybrid, a domain-agnostic framework designed to generate authentic and diverse anomalies simply by combining the reference and target images. AnomalyHybrid is a Generative Adversarial Network(GAN)-based framework having two decoders that integrate the appearance of reference image into the depth and edge structures of target image respectively. With the help of depth decoders, AnomalyHybrid achieves authentic generation especially for the anomalies with depth values changing, such a s protrusion and dent. More, it relaxes the fine granularity structural control of the edge decoder and brings more diversity. Without using annotations, AnomalyHybrid is easily trained with sets of color, depth and edge of same images having different augmentations. Extensive experiments carried on HeliconiusButterfly, MVTecAD and MVTec3D datasets demonstrate that AnomalyHybrid surpasses the GAN-based state-of-the-art on anomaly generation and its downstream anomaly classification, detection and segmentation tasks. On MVTecAD dataset, AnomalyHybrid achieves 2.06/0.32 IS/LPIPS for anomaly generation, 52.6 Acc for anomaly classification with ResNet34, 97.3/72.9 AP for image/pixel-level anomaly detection with a simple UNet.

异常检测生成模型无监督多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。