arXiv:2411.11323cs.RO2024-11ICRA被引 9

让机器人按操作手册执行任务,确保合规性。

SayComply: Grounding Field Robotic Tasks in Operational Compliance through Retrieval-Based Language Models

  • 用分层数据库检索操作手册,指导机器人规划
  • 实测在真实场景中比传统方法更准地遵守规程
  • 适合需要严格合规的工业或医疗机器人部署

本文解决机器人在现实场景中需遵循操作手册进行任务规划的问题。当前基于大语言模型的方法依赖通用常识,缺乏对领域知识的精准约束,难以在不同客户或站点间迁移。为此,我们提出SayComply,通过检索增强的语言模型实现机器人任务规划与操作合规性的结合。构建了包含操作、环境和机器人本体手册的分层数据库,支持在有限上下文长度下高效检索关键信息。采用基于树结构的检索增强生成(RAG)技术,使机器人在执行用户指令的同时,能严格遵守数据库中的领域知识。通过仿真与硬件实验验证,该方法在多类型上下文的精确检索任务中优于标准RAG方法。本方案为跨场景、复杂环境中机器人持续合规运行提供了可扩展、边缘部署的解决方案。

原文摘要 · Abstract (English)

This paper addresses the problem of task planning for robots that must comply with operational manuals in real-world settings. Task planning under these constraints is essential for enabling autonomous robot operation in domains that require adherence to domain-specific knowledge. Current methods for generating robot goals and plans rely on common sense knowledge encoded in large language models. However, these models lack grounding of robot plans to domain-specific knowledge and are not easily transferable between multiple sites or customers with different compliance needs. In this work, we present SayComply, which enables grounding robotic task planning with operational compliance using retrieval-based language models. We design a hierarchical database of operational, environment, and robot embodiment manuals and procedures to enable efficient retrieval of the relevant context under the limited context length of the LLMs. We then design a task planner using a tree-based retrieval augmented generation (RAG) technique to generate robot tasks that follow user instructions while simultaneously complying with the domain knowledge in the database. We demonstrate the benefits of our approach through simulations and hardware experiments in real-world scenarios that require precise context retrieval across various types of context, outperforming the standard RAG method. Our approach bridges the gap in deploying robots that consistently adhere to operational protocols, offering a scalable and edge-deployable solution for ensuring compliance across varied and complex real-world environments. Project website: saycomply.github.io.

机器人规划合规控制检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。