arXiv:2409.17755cs.ROcs.AI2024-09被引 2

让机器人在不知关键概念时,通过对话学习并完成任务。

SECURE: Semantics-aware Embodied Conversation under Unawareness for Lifelong Robot Learning

  • 通过具身对话主动询问,识别未知概念
  • 错误时利用用户纠正反馈,提升认知模型
  • 实测比不对话的机器人更省数据,适合长期学习

本文研究一种称为'无意识重排'的交互式任务学习场景:智能体在未掌握解决任务所需的关键概念前提下,必须在部署过程中学习该概念。例如,用户要求将两个'Granny Smith'苹果放入篮子,但智能体此前从未接触过此概念,无法识别对应物体。为此,我们提出SECURE策略,使智能体在处理具身对话时能进行语义分析并自主决策。通过与用户的互动,智能体可动态修正其领域模型,识别并学习先前未知的概念。当出现错误时,智能体从用户的具身纠正反馈中学习,并战略性地发起对话以获取与任务相关的新概念信息。这些能力使智能体能够泛化至新任务。我们在模拟的Blocksworld环境和真实世界的苹果操作环境中验证,相较于不进行具身对话或语义分析的智能体,采用SECURE的智能体在解决此类无意识重排任务时表现出更高的数据效率。

原文摘要 · Abstract (English)

This paper addresses a challenging interactive task learning scenario we call rearrangement under unawareness: an agent must manipulate a rigid-body environment without knowing a key concept necessary for solving the task and must learn about it during deployment. For example, the user may ask to "put the two granny smith apples inside the basket", but the agent cannot correctly identify which objects in the environment are "granny smith" as the agent has not been exposed to such a concept before. We introduce SECURE, an interactive task learning policy designed to tackle such scenarios. The unique feature of SECURE is its ability to enable agents to engage in semantic analysis when processing embodied conversations and making decisions. Through embodied conversation, a SECURE agent adjusts its deficient domain model by engaging in dialogue to identify and learn about previously unforeseen possibilities. The SECURE agent learns from the user's embodied corrective feedback when mistakes are made and strategically engages in dialogue to uncover useful information about novel concepts relevant to the task. These capabilities enable the SECURE agent to generalize to new tasks with the acquired knowledge. We demonstrate in the simulated Blocksworld and the real-world apple manipulation environments that the SECURE agent, which solves such rearrangements under unawareness, is more data-efficient than agents that do not engage in embodied conversation or semantic analysis.

具身对话机器人学习语义理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。