arXiv:2409.15658cs.ROcs.AI2024-09被引 2

无需示例即可完成复杂任务规划,有效避免错误与幻觉。

Long-horizon Embodied Planning with Implicit Logical Inference and Hallucination Mitigation

  • 通过微调学习隐式逻辑推理,自动生成任务步骤
  • 在未见任务上达成高成功率和执行合规性
  • 适合需要长期自主决策的机器人应用

长时序具身规划是具身人工智能的核心。为完成长时序任务,最可行的方法是将抽象指令分解为可执行步骤。当前基础模型在长时序规划中仍易出现逻辑错误和幻觉,除非提供高度相关的示例,但为任意任务提供此类示例不现实。为此,我们提出 ReLEP 框架,实现无需上下文示例的实时长时序具身规划。通过微调大型视觉语言模型,学习隐式逻辑推理,将计划表示为技能函数序列,从精心设计的技能库中选取。ReLEP 配备记忆模块用于状态回溯,以及机器人配置模块以支持多类型机器人。我们还提出了数据生成流水线以缓解数据稀缺问题,在构建数据集时考虑隐式逻辑关系,使模型能学习逻辑并抑制幻觉。在多种长时序任务上的全面评估显示,ReLEP 在未见任务上仍保持高成功率与执行合规性,优于现有最优基线方法。

原文摘要 · Abstract (English)

Long-horizon embodied planning underpins embodied AI. To accomplish long-horizon tasks, one of the most feasible ways is to decompose abstract instructions into a sequence of actionable steps. Foundation models still face logical errors and hallucinations in long-horizon planning, unless provided with highly relevant examples to the tasks. However, providing highly relevant examples for any random task is unpractical. Therefore, we present ReLEP, a novel framework for Real-time Long-horizon Embodied Planning. ReLEP can complete a wide range of long-horizon tasks without in-context examples by learning implicit logical inference through fine-tuning. The fine-tuned large vision-language model formulates plans as sequences of skill functions. These functions are selected from a carefully designed skill library. ReLEP is also equipped with a Memory module for plan and status recall, and a Robot Configuration module for versatility across robot types. In addition, we propose a data generation pipeline to tackle dataset scarcity. When constructing the dataset, we considered the implicit logical relationships, enabling the model to learn implicit logical relationships and dispel hallucinations. Through comprehensive evaluations across various long-horizon tasks, ReLEP demonstrates high success rates and compliance to execution even on unseen tasks and outperforms state-of-the-art baseline methods.

具身智能任务规划视觉语言模型机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。