arXiv:2410.16919cs.ROcs.AI2024-10被引 2

通过跨环境知识迁移,提升机器人在不同场景下的自主适应能力。

EnvBridge: Bridging Diverse Environments with Cross-Environment Knowledge Transfer for Embodied AI

  • 保留并迁移源环境中的成功控制代码到目标环境。
  • 在RLBench、MetaWorld等基准上显著提升任务成功率。
  • 适合需要跨场景泛化的机器人决策研究者使用。

近年来,大语言模型(LLMs)展现出强大的推理能力,被广泛应用于各类决策任务中。其中,将LLM作为智能体进行机器人操作是极具前景的应用方向。已有研究表明,LLM可生成文本规划或控制代码,实现高度灵活的交互。然而,现有方法在不同环境间仍存在灵活性与适用性不足的问题,限制了其自主适应能力。当前方法主要分为两类:依赖特定环境策略训练,导致迁移性差;或基于固定提示生成代码,面对新环境时性能下降。为解决上述问题,本文提出一种名为EnvBridge的新方法,通过保留并转移源环境中成功的机器人控制代码至目标环境,利用多环境经验增强智能体在多样化场景中的适应性与性能。该方法有效缓解了环境约束,提供了更灵活、通用的机器人操作解决方案。我们在RLBench、MetaWorld和CALVIN等多个机器人操作基准上验证了方法的有效性,结果表明LLM智能体能够成功利用多样化的知识源完成复杂任务,显著提升了跨环境规划的适应性与鲁棒性。

原文摘要 · Abstract (English)

In recent years, Large Language Models (LLMs) have demonstrated high reasoning capabilities, drawing attention for their applications as agents in various decision-making processes. One notably promising application of LLM agents is robotic manipulation. Recent research has shown that LLMs can generate text planning or control code for robots, providing substantial flexibility and interaction capabilities. However, these methods still face challenges in terms of flexibility and applicability across different environments, limiting their ability to adapt autonomously. Current approaches typically fall into two categories: those relying on environment-specific policy training, which restricts their transferability, and those generating code actions based on fixed prompts, which leads to diminished performance when confronted with new environments. These limitations significantly constrain the generalizability of agents in robotic manipulation. To address these limitations, we propose a novel method called EnvBridge. This approach involves the retention and transfer of successful robot control codes from source environments to target environments. EnvBridge enhances the agent's adaptability and performance across diverse settings by leveraging insights from multiple environments. Notably, our approach alleviates environmental constraints, offering a more flexible and generalizable solution for robotic manipulation tasks. We validated the effectiveness of our method using robotic manipulation benchmarks: RLBench, MetaWorld, and CALVIN. Our experiments demonstrate that LLM agents can successfully leverage diverse knowledge sources to solve complex tasks. Consequently, our approach significantly enhances the adaptability and robustness of robotic manipulation agents in planning across diverse environments.

机器人操作跨环境迁移LLM智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。