用少量样本生成真实且对齐的异常图像和掩码,提升工业检测效果。
Generate Aligned Anomaly: Region-Guided Few-Shot Anomaly Image-Mask Pair Synthesis for Industrial Inspection
- 基于预训练扩散模型,通过区域引导生成异常图像与掩码。
- 在MVTec AD和LOCO数据集上,异常定位与分类性能领先。
- 适合缺乏异常样本的工业视觉检测场景使用。
异常检测在工业制造中至关重要,但异常样本稀缺严重限制了现有方法在定位与分类任务中的效果。尽管已有若干异常合成方法用于数据增强,但普遍存在真实感低、掩码对齐不准、泛化能力差等问题。为此,本文提出生成对齐异常(GAA),一种基于区域引导的少样本异常图像-掩码对生成框架。GAA利用预训练隐空间扩散模型的强大先验,仅需少量样本即可生成真实、多样且语义对齐的异常。框架首先通过局部概念分解联合建模异常的语义特征与空间信息,实现对异常类型和位置的灵活控制;随后采用自适应多轮异常聚类进行细粒度语义聚类,提升异常表征一致性;进而通过区域引导的掩码生成策略确保异常与掩码精确对齐,并引入低质量样本过滤模块进一步提升生成样本整体质量。在MVTec AD和LOCO数据集上的大量实验表明,GAA在异常合成质量及下游任务(如定位与分类)中均表现优异。
原文摘要 · Abstract (English)
Anomaly inspection plays a vital role in industrial manufacturing, but the scarcity of anomaly samples significantly limits the effectiveness of existing methods in tasks such as localization and classification. While several anomaly synthesis approaches have been introduced for data augmentation, they often struggle with low realism, inaccurate mask alignment, and poor generalization. To overcome these limitations, we propose Generate Aligned Anomaly (GAA), a region-guided, few-shot anomaly image-mask pair generation framework. GAA leverages the strong priors of a pretrained latent diffusion model to generate realistic, diverse, and semantically aligned anomalies using only a small number of samples. The framework first employs Localized Concept Decomposition to jointly model the semantic features and spatial information of anomalies, enabling flexible control over the type and location of anomalies. It then utilizes Adaptive Multi-Round Anomaly Clustering to perform fine-grained semantic clustering of anomaly concepts, thereby enhancing the consistency of anomaly representations. Subsequently, a region-guided mask generation strategy ensures precise alignment between anomalies and their corresponding masks, while a low-quality sample filtering module is introduced to further improve the overall quality of the generated samples. Extensive experiments on the MVTec AD and LOCO datasets demonstrate that GAA achieves superior performance in both anomaly synthesis quality and downstream tasks such as localization and classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。