arXiv:2607.18060cs.RO2026-07被引 1

让多种机器人策略协作完成复杂任务,自动判断谁该做什么。

RoboHarness: Memory-Driven Orchestration of Heterogeneous Robot Policies for Long-Horizon Planning

论文配图:RoboHarness: Memory-Driven Orchestration of Heterogeneous Robot Policies for Long-Horizon Planning
图 1 · 摘自论文原文
  • 用记忆和实时证据动态判断每个策略能干啥
  • 实测在500个任务上零样本规划成功率显著提升
  • 适合需要长期规划的智能机器人系统开发者

长时序机器人任务需多种能力,单一策略难以胜任。异构策略虽互补,但现有方法多基于同质预设技能,忽视能力边界不确定性和策略间分布不匹配问题。本文提出RoboHarness框架,将独立开发的机器人控制系统(如视觉语言动作模型、强化学习策略、任务与运动规划系统)封装为可复用的代理技能。通过多模态执行记忆与在线证据,动态刻画策略能力边界,实现能力感知的任务分解与路由。为稳定策略交接,其内存桥检索下一策略的执行轨迹,估计其分布内状态区域,并引导机器人进入该区域,无需重新训练。在三个公开基准、500个定制任务及135次真实机器人实验中,验证了该方法在零样本长时序规划与分布外鲁棒性上的显著提升。

原文摘要 · Abstract (English)

Long-horizon robotic tasks require diverse capabilities that no single policy can reliably provide. Heterogeneous policies offer complementary strengths, but orchestrating them requires reasoning over uncertain capability boundaries and cross-policy distribution mismatch, which are largely overlooked by existing planning methods built on homogeneous, predefined skills with fixed applicability. We propose RoboHarness, a unified framework that encapsulates independently developed robot control systems as reusable agentic skills. Although instantiated in this work with VLAs, RL policies, and task-and-motion planning (TAMP) systems, RoboHarness is designed as a general framework compatible with a broader range of robot policies, such as navigation policies, model predictive controllers, and world-action models. RoboHarness uses multi-modal execution memory and online evidence to characterize policy capability boundaries for capability-aware decomposition and routing. To stabilize policy handoffs, its Memory Bridge retrieves execution trajectories associated with the next policy, estimates its in-distribution state region, and guides the robot toward that region without joint policy retraining. Extensive experiments on three public benchmarks, 500 customized tasks, and 135 real-robot experiments demonstrate effective capability-aware routing and stable policy orchestration, yielding substantial improvements in zero-shot long-horizon planning and out-of-distribution robustness.

机器人长程规划策略协同

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。