arXiv:2602.21141cs.CV2026-02

开源工具与数据集,助力工业物体感知的仿真到现实双向迁移。

SynthRender and I-AsSET: Open-Source Framework and Dataset for Bidirectional Sim-Real Transfer in Industrial Object Perception

  • 用程序化域随机化生成逼真合成图像,提升训练效率。
  • 在三个工业数据集上实现95.1%以上mAP@50,性能接近真实数据训练。
  • 适合做工业视觉系统研发、机器人抓取与质检的工程师使用。

物体感知是机器人物料搬运和质量检测等任务的基础。然而,现代监督学习模型需大量标注数据才能在半受控条件下稳定运行,这对专有工业零件的大规模应用构成障碍。本文提出一个集成框架,结合合成数据生成与结构化实证评估,系统研究双向仿真-现实迁移。通过2D到3D的真实-仿真技术,从实物构建3D资产,并利用SynthRender开源框架进行程序化引导域随机化(GDR)生成合成图像。在多个基准上开展结构化消融实验,量化渲染设计选择的影响,提供高效合成训练的实用指南。为支持真实工业场景评估,我们发布I-AsSET数据集,包含32类物体,具有多变纹理、类内差异大、类间相似性强等特点,共19,672个标注,提供CAD模型与重建网格,支持双向仿真-现实对比。在三个工业基准上,该框架表现优异:在公开机器人数据集上达到98.7% mAP@50,汽车基准97.9% mAP@50,I-AsSET数据集95.1% mAP@50。

原文摘要 · Abstract (English)

Object perception is fundamental for tasks such as robotic material handling and quality inspection. However, modern supervised deep-learning models require large annotated datasets for robust automation under semi-uncontrolled conditions; a major barrier for widespread deployment with proprietary industrial parts. We address this through an integrated framework combining synthetic data generation and structured empirical evaluation for systematic investigation of bidirectional sim-to-real transfer. Our method integrates 2D-to-3D Reality-to-Simulation techniques for 3D asset creation from physical parts with programmatic Guided Domain Randomization (GDR) via SynthRender, an open-source synthetic image generation framework. Structured ablation studies across multiple benchmarks quantify the impact of individual rendering design choices, yielding practical guidelines for data-efficient synthetic training. To support evaluation under realistic industrial conditions, we introduce Industrial Assets for Sim-to-Real Evaluation and Transfer (I-AsSET), a 32-class dataset with diverse textures, intra-class variation, strong inter-class similarities, and 19,672 annotations, providing both CAD models and reconstructed meshes for bidirectional sim-to-real benchmarking. Across three industrial benchmarks, the proposed framework achieves highly competitive performance, reaching 98.7% mAP@50 on a public robotics dataset, 97.9% mAP@50 on an automotive benchmark, and 95.1% mAP@50 on I-AsSET.

工业视觉仿真迁移合成数据目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。