让视觉语言模型直接生成可重写的机器人控制代码,实现失败自修复的闭环操控。
VLCP: Vision Language Control Policy Closed-Loop Code Replanning for Robot Manipulation

- 冻结预训练视觉语言模型,用Python函数生成控制逻辑,无需微调或演示。
- 单次任务成功率仅3.5%,闭环重规划后提升至35.1%,失败后可即时修正。
- 适合无标注数据、需高鲁棒性的机器人任务部署,尤其擅长抓取失败修复。
将前沿视觉语言模型转化为机器人策略通常需要微调以输出预训练未见的动作表示,这会损失模型原有的推理能力。本文反其道而行之,保持视觉语言模型(VLM)冻结状态,直接生成短小的Python控制函数,无需演示或微调。初始编写为开环,但现有闭环方法反应层级错误:仅重试固定策略或切换子任务,从不重写失效代码。VLCP在单个任务期内直接在控制代码层面闭合反馈环,每K步基于多视角RGB、本体感知状态和状态差值重新观测场景,并重写控制函数,防止失败累积。在57项MuJoCo/RoboVerse任务中评估,该免训练策略达到35.1%的综合成功率,相较每期仅查询一次的系统(3.5%)提升十倍,且所有场景族均具显著差异。提升源于27.3%的单期恢复率——开环控制器遗漏的抓取失败可在下次重规划时被重新观测并修正。整个闭环代价极低:84%输入词元命中缓存,每轮仅需约10次紧凑查询,且每次重规划生成的控制块会持久化至跨任务技能库供后续提示复用。
原文摘要 · Abstract (English)
Turning a frontier vision-language model into a robot policy usually means fine-tuning it to emit an action representation it never saw in pretraining, which throws away much of the reasoning that made the model worth reaching for. We go the other way and keep the VLM frozen. It writes the policy as a short Python control function, with no demonstrations and no fine-tuning. Writing that code once is open-loop, though. Existing closed-loop methods react at the wrong level: they retry a fixed policy or pick a different subtask, but never rewrite the code that failed. VLCP closes the loop where the failure actually lives, on the control code, within a single episode. Every $K$ steps the VLM re-observes the scene from multi-view RGB, proprioceptive state, and a state delta, then rewrites the control function from what it just saw, so a failure is caught before it compounds. We evaluate on a 57-task MuJoCo/RoboVerse sweep. This training-free policy reaches $35.1\%$ pooled success, against $3.5\%$ for the identical system queried once per episode. That tenfold gap holds with non-overlapping confidence intervals in every scene family. The gain traces to a $27.3\%$ within-episode recovery rate on failed grasps: a miss an open-loop controller would carry to the end of the episode gets re-observed and fixed at the next replan. And the loop stays cheap. A median $84\%$ of input tokens hit cache, an episode needs only about $10$ compact queries, and control blocks written during any replan persist to a cross-episode skill library reused in later prompts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。