arXiv:2409.11702cs.ROcs.CV2024-09AAAI被引 4

让机器像人一样理解可动物体的结构和使用方式,无需训练数据。

Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objects

  • 用可微分的语义模板建模物体的几何与运动规律
  • 零样本识别新类可动物体的结构与交互方式
  • 适合机器人感知与交互任务,不依赖真实数据

人类认知能利用基础概念知识(如几何与运动学)来感知、理解并操作新物体。受此启发,我们提出一种在概念层面进行理解的方法,以让机器智能掌握可动物体的结构与功能,尤其针对全新类别物体——这因复杂的几何结构和多样的关节类型而极具挑战。为此,我们设计了分析性本体模板(Analytic Ontology Template, AOT),一种参数化且可微分的通用概念描述程序。基于AOT构建的AOTNet可使智能体具备泛化概念能力,从而有效发现可动物体的结构与可用性知识。该方法在三个关键方面具优势:一、无需真实训练数据即可实现概念级理解;二、提供解析性的结构信息;三、引入丰富的交互可用性信息,指明正确的操作方式。大量实验验证了该方法在理解与交互可动物体上的优越性。

原文摘要 · Abstract (English)

Human cognition can leverage fundamental conceptual knowledge, like geometric and kinematic ones, to appropriately perceive, comprehend and interact with novel objects. Motivated by this finding, we aim to endow machine intelligence with an analogous capability through performing at the conceptual level, in order to understand and then interact with articulated objects, especially for those in novel categories, which is challenging due to the intricate geometric structures and diverse joint types of articulated objects. To achieve this goal, we propose Analytic Ontology Template (AOT), a parameterized and differentiable program description of generalized conceptual ontologies. A baseline approach called AOTNet driven by AOTs is designed accordingly to equip intelligent agents with these generalized concepts, and then empower the agents to effectively discover the conceptual knowledge on the structure and affordance of articulated objects. The AOT-driven approach yields benefits in three key perspectives: i) enabling concept-level understanding of articulated objects without relying on any real training data, ii) providing analytic structure information, and iii) introducing rich affordance information indicating proper ways of interaction. We conduct exhaustive experiments and the results demonstrate the superiority of our approach in understanding and then interacting with articulated objects.

可动物体概念理解零样本本体建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。