让编码代理像机器人专家一样,用多文件策略库自动优化机器人任务执行。
RHO: Your Coding Agent is Secretly a Roboticist

- 训练时用工具增强的编码代理搜索可解释的多文件策略库,替代单次代码生成。
- 在LIBERO-PRO上达45.0%成功率,是现有最强系统的2.5倍,且无需实时交互修正。
- 适合需要高效、无纠错部署的机器人控制场景,尤其适用于低延迟环境。
Code-as-Policies(CaP)表明大语言模型(LLMs)可通过组合感知、规划与控制原语编写代码来解决机器人任务。然而,现有系统依赖测试时的多轮代码生成循环,难以满足实时机器人控制需求。本文提出机器人调度优化(RHO),一种新范式:在训练阶段,工具增强的编码代理主动提出并搜索可解释的神经符号多文件策略库(仓库即策略),而非单个提示、函数或文件。RHO通过环境奖励和执行反馈进行反思式搜索,而非依赖人工示范。该方法在扰动的抓取放置任务(如LIBERO-PRO)中表现优异,此时OpenVLA得分为0.0%,$π_{0.5}$平均为12.83%;而使用相同底层原语的RHO达到45.0%成功率,分别高出最强多轮智能体2.5倍和$π_{0.5}$的3.5倍。在Robosuite上,RHO达成70.0%的新最佳成绩,超过先前单轮执行的68.29%记录,且部署时无需修正代码。在RAI的O3DE基准中,当使用LLM于控制回路时,RHO优化部署代理的多文件提示、工具与控制代码组合,将保留测试集成功率从23.5%提升至44.3%,同时减少20%运行时间与27%工具调用次数。
原文摘要 · Abstract (English)
Code-as-Policies (CaP) has shown that large language models (LLMs) can write code to solve robotics tasks by composing perception, planning, and control primitives. Recent CaP systems, however, rely on multi-turn code-generation loops at test time, which is often infeasible for real-time robot control. We introduce Robotics Harness Optimization (RHO), a novel paradigm in which tool-enabled coding agents, at training time, propose and search for interpretable, neurosymbolic multi-file policy repositories (Repositories-as-Policies) that compose these primitives rather than a single prompt, function, or file. RHO searches with reflective feedback from environment reward and execution rather than teleoperation demonstrations. It generalizes to perturbed pick-and-place settings like LIBERO-PRO, where OpenVLA scores 0.0% and $π_{0.5}$ averages 12.83%. Using the same low-level primitives, RHO reaches a 45.0% success rate, 2.5x higher than the strongest multi-turn agentic system, and 3.5x higher than $π_{0.5}$. On Robosuite, RHO sets a new state-of-the-art of 70.0%, exceeding the prior multi-turn record of 68.29% using single-turn execution with no corrective LLM code edits at deployment. When an LLM is used in the control loop, as on RAI's O3DE benchmark, RHO optimizes the deployed agent's multi-file harness of prompts, tools, and control code, improving held-out success from 23.5% to 44.3% with 20% less wall-clock time and 27% fewer tool calls.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。