用自然语言指导机器人学习,让动作可解释、可改进。
A Few Words Go a Long Way: Language Guided Robot Policy Synthesis

- 将机器人策略生成视为交互式编程任务,利用大模型生成模块化程序。
- 在Franka Panda上实现复杂任务成功率超现有模型,长时任务表现优异。
- 支持人类用语言纠错并积累可复用技能库,适合需要可解释性的场景。
尽管视觉-语言-动作模型展现出出色的零样本操作能力,但其本质上是黑箱策略,难以解释、调整或修正。本文提出ARCHITECT框架,将机器人策略获取视为交互式程序合成任务。该框架利用大语言模型编码代理的推理能力,生成使用感知与控制工具集的模块化机器人程序。相比端到端模型因分布偏移导致不可预测的级联失败,其模块化结构允许用户在所需抽象层级上隔离故障并定位反馈。我们引入迭代过程:人类监督者提供自然语言修正,这些修正通过程序执行轨迹锚定于策略代码,并提炼为持久化的技能库,形成一种长期上下文学习,使智能体能积累可复用、可解释的行为。在Franka Panda机器人上的基准评估显示,ARCHITECT在复杂长时任务(包括可动物体操作和布料折叠)中优于最先进的VLA模型和程序合成基线。结果表明,合成的技能库使系统能以更少的人工干预迁移到新任务,为黑箱机器人学习提供可引导、数据高效的替代方案。
原文摘要 · Abstract (English)
While vision-language-action models have demonstrated impressive zero-shot manipulation capabilities, they remain fundamentally black box policies that are difficult to interpret, adapt, or correct when they inevitably fail. In this work, we propose ARCHITECT, a framework that treats robot policy acquisition as an interactive program synthesis task. ARCHITECT leverages the reasoning capabilities of LLM coding agents to synthesize modular robot programs that utilize a suite of perception and control tools. Unlike end-to-end models where distribution shift leads to unpredictable, cascading failures, our modular architecture allows users to isolate failures and localize feedback at the level of abstraction required. We introduce an iterative process where a human supervisor provides natural language corrections to steer the policy. These corrections are grounded in the policy code by program execution traces and distilled into a persistent skill library, a form of long-term in-context learning which enables the agent to accumulate a repertoire of reusable, interpretable behaviors. In a benchmark evaluation on a Franka Panda robot, ARCHITECT outperforms state-of-the-art VLA models and program synthesis baselines on complex, long-horizon tasks, including articulated object manipulation and cloth folding. Our results demonstrate that the synthesized skill library enables the system to transfer to novel tasks with decreasing human intervention, providing a steerable and data-efficient alternative to black-box robot learning. Website: https://robo-architect.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。