arXiv:2409.11279cs.ROcs.CL2024-09被引 22

P-RAG让智能体通过迭代学习,逐步积累任务知识,无需真实答案也能高效完成日常任务。

P-RAG: Progressive Retrieval Augmented Generation For Planning on Embodied Everyday Task

  • 采用迭代检索增强生成,逐步更新知识库以积累任务经验
  • 无需真实样本,在多个任务上表现优于传统方法
  • 适合需要持续学习的机器人任务规划场景

具身日常任务是具身AI领域的热门任务,要求智能体根据自然语言指令和视觉观察执行一系列动作。传统学习方法面临两大挑战:自然语言指令常缺乏显式任务规划;模型需大量训练才能掌握环境知识。基于大语言模型(LLM)的先前工作或因缺乏特定任务知识而表现不佳,或依赖真实样本作为少样本提示。为此,我们提出一种新方法——渐进式检索增强生成(P-RAG),不仅有效利用LLM强大的语言处理能力,还能在不依赖真实样本的情况下逐步积累任务特定知识。与传统RAG一次性从数据库中检索信息不同,P-RAG采用迭代方式,每次迭代均检索最新知识库,并结合前序交互的历史信息作为经验参考。此外,还引入更细粒度的检索策略,不仅检索相似任务,还引入相似情境,提供更有价值的参考经验。大量实验表明,P-RAG在不使用真实样本的情况下取得有竞争力的结果,并可通过自迭代进一步提升性能。

原文摘要 · Abstract (English)

Embodied Everyday Task is a popular task in the embodied AI community, requiring agents to make a sequence of actions based on natural language instructions and visual observations. Traditional learning-based approaches face two challenges. Firstly, natural language instructions often lack explicit task planning. Secondly, extensive training is required to equip models with knowledge of the task environment. Previous works based on Large Language Model (LLM) either suffer from poor performance due to the lack of task-specific knowledge or rely on ground truth as few-shot samples. To address the above limitations, we propose a novel approach called Progressive Retrieval Augmented Generation (P-RAG), which not only effectively leverages the powerful language processing capabilities of LLMs but also progressively accumulates task-specific knowledge without ground-truth. Compared to the conventional RAG methods, which retrieve relevant information from the database in a one-shot manner to assist generation, P-RAG introduces an iterative approach to progressively update the database. In each iteration, P-RAG retrieves the latest database and obtains historical information from the previous interaction as experiential references for the current interaction. Moreover, we also introduce a more granular retrieval scheme that not only retrieves similar tasks but also incorporates retrieval of similar situations to provide more valuable reference experiences. Extensive experiments reveal that P-RAG achieves competitive results without utilizing ground truth and can even further improve performance through self-iterations.

具身智能任务规划检索增强LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。