arXiv:2509.24160cs.ROcs.AI2025-09被引 1

用历史成功代码指导LLM重规划,让机器人轻松适应新环境。

Memory Transfer Planning: LLM-driven Context-Aware Code Adaptation for Robot Manipulation

  • 从记忆库中检索成功代码,动态适配当前任务
  • 在仿真和真实机器人上成功率显著提升
  • 无需重训练,适合快速部署到新场景

大型语言模型(LLMs)在机器人操作中日益受到关注,但现有方法在新环境中适应能力有限。许多系统依赖特定环境的策略训练或固定提示与单次代码生成,导致泛化性差且需手动调参。我们提出记忆迁移规划(MTP)框架,利用来自不同环境的成功控制代码作为过程知识,以上下文引导方式支持LLM驱动的规划。MTP首先通过LLM生成初始计划与代码,其次从代码记忆库中检索相关成功示例,最后在不更新模型参数的前提下,根据目标环境上下文对检索代码进行自适应调整并重新规划。我们在RLBench、CALVIN及物理机器人上进行了评估,证明其在仿真外仍有效。相比固定提示生成、朴素检索与无记忆重规划,MTP在多个场景下均显著提升成功率与适应性。此外,硬件实验表明,仅在仿真中构建的记忆库即可有效支持真实部署。MTP提供了一种实用方法,通过挖掘过程知识实现跨多样化机器人操作场景的鲁棒规划,增强对新环境的适应力,并弥合仿真与现实之间的鸿沟。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly explored in robot manipulation, but many existing methods struggle to adapt to new environments. Many systems require either environment-specific policy training or depend on fixed prompts and single-shot code generation, leading to limited transferability and manual re-tuning. We introduce Memory Transfer Planning (MTP), a framework that leverages successful control-code examples from different environments as procedural knowledge, using them as in-context guidance for LLM-driven planning. Specifically, MTP (i) generates an initial plan and code using LLMs, (ii) retrieves relevant successful examples from a code memory, and (iii) contextually adapts the retrieved code to the target setting for re-planning without updating model parameters. We evaluate MTP on RLBench, CALVIN, and a physical robot, demonstrating effectiveness beyond simulation. Across these settings, MTP consistently improved success rate and adaptability compared with fixed-prompt code generation, naive retrieval, and memory-free re-planning. Furthermore, in hardware experiments, leveraging a memory constructed in simulation proved effective. MTP provides a practical approach that exploits procedural knowledge to realize robust LLM-based planning across diverse robotic manipulation scenarios, enhancing adaptability to novel environments and bridging simulation and real-world deployment.

机器人操作LLM应用代码生成迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。