一个模型搞定工业缺陷生成、正常产品和精确掩码,支持少样本快速适配新缺陷。
SeaS: Few-shot Industrial Anomaly Image Generation with Separation and Sharing Fine-tuning
- 用统一U-Net架构结合分离与共享微调,实现多任务联合生成。
- 在工业异常检测中提升8.66%像素级AP、12.79%分割IoU,性能突破现有方法。
- 适合需要快速生成新缺陷数据的工业质检场景,尤其适用于小样本应用。
我们提出SeaS,一种统一的工业生成模型,可自动创建多样化的异常图像、真实的正常产品及精确的异常掩码。现有方法通常仅聚焦单一任务(如仅生成异常或正常品),或需为每类异常训练独立模型,导致生成能力受限或模型数量庞大。我们发现,U-Net具备区分细微正常品差异与多样化异常特征的学习能力,因此可构建统一模型完成所有任务。具体地,我们引入不均衡异常(UA)文本提示,包含一个正常标记与多个异常标记;更重要的是,解耦异常对齐(DA)损失将异常属性与不同异常标记解耦绑定,使SeaS能通过重组属性生成未见异常。此外,正常图像对齐(NA)损失将正常标记与正常模式对齐,确保生成正常品全局一致且局部多样。最后,通过融合判别性U-Net特征与高分辨率VAE特征,生成精确异常掩码。SeaS在工业生成任务上树立新基准,显著提升下游应用:合成驱动的异常检测方法平均提升+8.66%像素级AP,无监督异常检测提升+1.10%图像级AP,有监督分割模型提升+12.79% IoU。代码已开源。
原文摘要 · Abstract (English)
We introduce SeaS, a unified industrial generative model for automatically creating diverse anomalies, authentic normal products, and precise anomaly masks. While extensive research exists, most efforts either focus on specific tasks, i.e., anomalies or normal products only, or require separate models for each anomaly type. Consequently, prior methods either offer limited generative capability or depend on a vast array of anomaly-specific models. We demonstrate that U-Net's differentiated learning ability captures the distinct visual traits of slightly-varied normal products and diverse anomalies, enabling us to construct a unified model for all tasks. Specifically, we first introduce an Unbalanced Abnormal (UA) Text Prompt, comprising one normal token and multiple anomaly tokens. More importantly, our Decoupled Anomaly Alignment (DA) loss decouples anomaly attributes and binds them to distinct anomaly tokens of UA, enabling SeaS to create unseen anomalies by recombining these attributes. Furthermore, our Normal-image Alignment (NA) loss aligns the normal token to normal patterns, making generated normal products globally consistent and locally varied. Finally, SeaS produces accurate anomaly masks by fusing discriminative U-Net features with high-resolution VAE features. SeaS sets a new benchmark for industrial generation, significantly enhancing downstream applications, with average improvements of $+8.66\%$ pixel-level AP for synthesis-based AD approaches, $+1.10\%$ image-level AP for unsupervised AD methods, and $+12.79\%$ IoU for supervised segmentation models. Code is available at \href{https://github.com/HUST-SLOW/SeaS}{https://github.com/HUST-SLOW/SeaS}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。