用程序化生成26类3D可动物体,自动标注丰富数据用于训练。
Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotations
- 通过结构程序生成可变形状的3D可动物体
- 支持26类物体生成并提供多任务标注
- 适合需要大量带注释数据的机器人与视觉研究
获取大规模3D可动物体数据成本高、耗时长,且详细标注困难,制约了深度学习在可动物体理解任务中的表现。为快速构建大规模、多样化且带全面标注的3D可动物体数据集,我们提出Arti-PG工具箱——一个基于结构程序的程序化生成系统。该系统包含:i)通过通用结构程序描述可动物体及其点云的解析对应关系;ii)通过结构程序操作规则生成海量多样新物体;iii)以数学形式描述知识(如可用性、语义等)实现自动标注。Arti-PG具备两大优势:一是通过程序化结构操作实现形状无限变化;二是可广泛适配多种任务并轻松提供详尽标注。目前支持26类可动物体的生成,并覆盖视觉与操作任务的多维度标注。实验充分验证其优越性。我们将公开该工具箱供社区使用。
原文摘要 · Abstract (English)
The acquisition of substantial volumes of 3D articulated object data is expensive and time-consuming, and consequently the scarcity of 3D articulated object data becomes an obstacle for deep learning methods to achieve remarkable performance in various articulated object understanding tasks. Meanwhile, pairing these object data with detailed annotations to enable training for various tasks is also difficult and labor-intensive to achieve. In order to expeditiously gather a significant number of 3D articulated objects with comprehensive and detailed annotations for training, we propose Articulated Object Procedural Generation toolbox, a.k.a. Arti-PG toolbox. Arti-PG toolbox consists of i) descriptions of articulated objects by means of a generalized structure program along with their analytic correspondence to the objects' point cloud, ii) procedural rules about manipulations on the structure program to synthesize large-scale and diverse new articulated objects, and iii) mathematical descriptions of knowledge (e.g. affordance, semantics, etc.) to provide annotations to the synthesized object. Arti-PG has two appealing properties for providing training data for articulated object understanding tasks: i) objects are created with unlimited variations in shape through program-oriented structure manipulation, ii) Arti-PG is widely applicable to diverse tasks by easily providing comprehensive and detailed annotations. Arti-PG now supports the procedural generation of 26 categories of articulate objects and provides annotations across a wide range of both vision and manipulation tasks, and we provide exhaustive experiments which fully demonstrate its advantages. We will make Arti-PG toolbox publicly available for the community to use.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。