用生成模型自动造缺陷图,解决工业质检数据少难题
SynSur: An end-to-end generative pipeline for synthetic industrial surface defect generation and detection

- 基于视觉语言模型生成提示,用扩散模型合成缺陷
- 合成数据+真实数据混合训练,检测准确率提升显著
- 无需人工标注,适合数据稀缺的工业质检场景
工业表面缺陷检测面临数据瓶颈:缺陷罕见、标注需专家知识,构建平衡训练集耗时昂贵。我们提出SynSur,一个端到端的合成缺陷生成与自动标注流水线,旨在降低人工成本与数据稀缺带来的限制。该流程结合视觉-语言模型生成提示、LoRA适配的扩散模型、掩码引导修复、基于度量的样本筛选及自动标签生成。在BSData(滚珠丝杠表面凹坑)和MSD的划痕子集上评估,对比YOLOX、YOLOv26与LW-DETR在仅真实数据、仅合成数据、混合训练与联合训练下的表现。完整流程处理1000张候选图像,生成无须人工标注的过滤后合成数据集。仅用合成数据训练无法替代真实数据;但将合成数据加入全量真实数据可稳定提升平均精度(AP),尤其在真实数据稀缺时能显著缩小与全量真实数据训练的性能差距。跨域实验表明流程具备迁移能力,但需进行领域特定适配与标注质量控制。结果证明,基于扩散模型的缺陷合成是强化工业检测流程的实用工具,尤其适用于标注数据采集为瓶颈的场景。
原文摘要 · Abstract (English)
Industrial surface defect inspection suffers from a fundamental data bottleneck: defects are rare, annotations require expert knowledge, and collecting balanced training sets is slow and costly. We present SynSur, an end-to-end pipeline for synthetic defect generation and automatic annotation, designed to reduce the manual effort and data scarcity that limit deployed inspection systems. The pipeline combines Vision-Language-Model-based prompt construction, LoRA-adapted diffusion, mask-guided inpainting, metric-based sample filtering, and automatic label derivation. We evaluate SynSur on BSData (pitting defects on ball screw drives) and the scratch subset of MSD, reporting downstream detection performance across YOLOX, YOLOv26, and LW-DETR under real-only, synthetic-only, mixed, and union training regimes. The full generation pipeline processes a candidate pool of 1,000 images and delivers a filtered, annotated synthetic dataset with no manual labeling effort. Synthetic-only training does not replace real data; however, augmenting the full real set with synthetic samples yields consistent AP gains in selected configurations, and augmenting scarce real sets substantially reduces the performance gap to full real-data training. The cross-domain study on MSD confirms pipeline portability while highlighting the importance of domain-specific adaptation and annotation quality control. SynSur demonstrates that diffusion-based defect synthesis is a practically viable tool for strengthening industrial inspection pipelines, particularly where labeled data collection is the primary bottleneck.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。