arXiv:2606.17073cs.ROcs.AI2026-06

用大模型自动把机器人结构文件转成带语义的常识知识库

Extracting Semantics: LLM-Guided Automatic Population of Robot Ontology from URDF

  • 用大模型解析机器人结构文件中的名称,补全语义关系
  • 通过多轮投票和格式校验,确保生成结果符合知识库规范
  • 适合需要理解机器人物理特性的交互系统开发者

虚拟智能体依赖常识知识即可,但与人类互动的实体机器人需具备环境与自身身体的具身化、语义丰富的表示。认知机器人学中,本体可整合异构知识,支持可解释推理,即使在持续更新时也有效。然而,手动构建本体仍是瓶颈。本文提出一种初步方法,将统一机器人描述格式(URDF)模型自动转换为已填充的本体。尽管URDF提供结构与运动学描述,其标识符常需常识理解才能恢复有意义的语义,这正是大语言模型(LLMs)擅长之处。我们的流程通过提示已有本体中的概念,让LLMs推断语义关系,确保最终分类与正式模型对齐。为提升可靠性,流程结合多次LLM查询的多数投票,以及语法与模式级验证,确保输出符合预期表示格式与本体约束。我们在多个机器人描述上评估该方法,并讨论生成的抽象结果。初步结果显示,该方法能有效弥合低层机器人描述与人类-机器人交互所需结构化、具身化知识表示之间的鸿沟。

原文摘要 · Abstract (English)

While commonsense knowledge may suffice for virtual agents, embodied robots interacting with humans require grounded and semantically rich representations of both their environment and their own physical embodiment. In cognitive robotics, ontologies are effective for integrating such heterogeneous knowledge to enable explainable reasoning, even during continuous knowledge updates. Yet, their manual construction remains a bottleneck. We present a preliminary approach for the automatic generation of robot semantic abstractions by transforming Unified Robot Description Format (URDF) models into populated ontologies. Although URDF files provide structural and kinematic descriptions, their identifiers often require commonsense interpretation to recover meaningful semantics, a task at which Large Language Models (LLMs) excel. Our pipeline leverages LLMs to infer semantic relationships by prompting them with concepts from an existing ontology, ensuring the final classification remains aligned with the formal model. To improve reliability, the pipeline combines majority voting across multiple LLM queries along with syntactic and schema-level validation to ensure that generated outputs conform to the expected representation format and ontology constraints. We evaluate the approach on multiple robot descriptions and discuss the generated abstractions. Initial results indicate that the proposed method can effectively bridge the gap between low-level robot descriptions and the structured, grounded knowledge representations required for human-robot interaction.

机器人大模型知识图谱语义解析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。