用合成数据零样本实现工业零件缺陷检测,解决数据少且不均衡难题。
Hybrid Synthetic Data Generation with Domain Randomization Enables Zero-Shot Vision-Based Part Inspection Under Extreme Class Imbalance
- 融合仿真渲染、域随机化与真实背景拼接生成合成数据。
- 检测[email protected]达0.995,分类准确率96%,平衡准确率90.1%。
- 适合无标注数据、缺陷样本极少的工业质检场景。
机器学习,尤其是深度学习,正在改变工业质量检测。然而,训练鲁棒模型通常需要大量高质量标注数据,这在制造环境中获取成本高、耗时长且人力密集。此外,缺陷样本本身稀少,导致严重类别不平衡,降低模型性能。这些数据限制阻碍了基于机器学习的质量检测方法在真实生产环境中的广泛应用。合成数据生成(SDG)通过高效、低成本、可扩展的方式生成大规模、平衡且完全标注的数据集,提供了一种有前景的解决方案。本文提出一种混合式SDG框架,结合基于仿真的渲染、域随机化和真实背景拼接,实现无需人工标注的零样本视觉工业零件检测。该SDG流程通过变化零件几何、光照和表面属性,在一小时内生成12,960张带标签图像,并将合成零件叠加至真实图像背景上。采用基于YOLOv8n的两阶段架构进行目标检测,使用MobileNetV3-small进行质量分类,所有模型均仅在合成数据上训练,最终在300个真实工业零件上评估。结果表明,检测[email protected]达到0.995,分类准确率达96%,平衡准确率为90.1%。与少量真实数据基线相比,本方法在极端类别不平衡下仍保持90-91%的平衡准确率,而基线仅为50%。结果证明,该方法实现了无需标注、可扩展且鲁棒的工业质检应用。
原文摘要 · Abstract (English)
Machine learning, particularly deep learning, is transforming industrial quality inspection. Yet, training robust machine learning models typically requires large volumes of high-quality labeled data, which are expensive, time-consuming, and labor-intensive to obtain in manufacturing. Moreover, defective samples are intrinsically rare, leading to severe class imbalance that degrades model performance. These data constraints hinder the widespread adoption of machine learning-based quality inspection methods in real production environments. Synthetic data generation (SDG) offers a promising solution by enabling the creation of large, balanced, and fully annotated datasets in an efficient, cost-effective, and scalable manner. This paper presents a hybrid SDG framework that integrates simulation-based rendering, domain randomization, and real background compositing to enable zero-shot learning for computer vision-based industrial part inspection without manual annotation. The SDG pipeline generates 12,960 labeled images in one hour by varying part geometry, lighting, and surface properties, and then compositing synthetic parts onto real image backgrounds. A two-stage architecture utilizing a YOLOv8n backbone for object detection and MobileNetV3-small for quality classification is trained exclusively on synthetic data and evaluated on 300 real industrial parts. The proposed approach achieves an [email protected] of 0.995 for detection, 96% classification accuracy, and 90.1% balanced accuracy. Comparative evaluation against few-shot real-data baseline approaches demonstrates significant improvement. The proposed SDG-based approach achieves 90-91% balanced accuracy under severe class imbalance, while the baselines reach only 50% accuracy. These results demonstrate that the proposed method enables annotation-free, scalable, and robust quality inspection for real-world manufacturing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。