用通用几何概念自动标注3D物体,提升视觉与机器人认知研究效率
ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualization
- 基于人类认知原理,用立方体、圆柱等通用几何组件识别3D物体
- 构建了可定制的网页工具套件和大量已概念化物体资产库
- 适合做3D理解、机器人交互、视觉建模的研究者使用
我们提出ConceptFactory,一种通过泛化概念(即物体概念化)识别3D物体的新范式,旨在促进机器从视觉与机器人双重角度学习全面的物体知识。该思路源自人类认知研究发现:物体感知可被解释为对通用几何组件(如立方体、圆柱体)的组合过程。ConceptFactory包含两个核心部分:i) ConceptFactory Suite,一个采用标准概念模板库(STL-C)的统一工具箱,支持基于Web的物体概念化平台;ii) ConceptFactory Asset,利用该套件获取的大规模概念化物体集合。本方法使研究者能轻松获取或自定义多样化物体知识,全面支持各类物体理解任务研究。我们在视觉与机器人多个基准任务上,以先进算法验证了该方法的有效性,证明其标注质量高、适用性强。项目主页见 https://apeirony.github.io/ConceptFactory。
原文摘要 · Abstract (English)
We present ConceptFactory, a novel scope to facilitate more efficient annotation of 3D object knowledge by recognizing 3D objects through generalized concepts (i.e. object conceptualization), aiming at promoting machine intelligence to learn comprehensive object knowledge from both vision and robotics aspects. This idea originates from the findings in human cognition research that the perceptual recognition of objects can be explained as a process of arranging generalized geometric components (e.g. cuboids and cylinders). ConceptFactory consists of two critical parts: i) ConceptFactory Suite, a unified toolbox that adopts Standard Concept Template Library (STL-C) to drive a web-based platform for object conceptualization, and ii) ConceptFactory Asset, a large collection of conceptualized objects acquired using ConceptFactory suite. Our approach enables researchers to effortlessly acquire or customize extensive varieties of object knowledge to comprehensively study different object understanding tasks. We validate our idea on a wide range of benchmark tasks from both vision and robotics aspects with state-of-the-art algorithms, demonstrating the high quality and versatility of annotations provided by our approach. Our website is available at https://apeirony.github.io/ConceptFactory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。