用语义指导增强已有机器人策略,不改架构也能提升性能。
GUIDES: Guidance Using Instructor-Distilled Embeddings for Pre-trained Robot Policy Enhancement
- 用视觉语言模型生成上下文指令,编码为引导嵌入注入旧策略。
- 在仿真中任务成功率显著提升,真实机器人抓取更精准。
- 适合想升级现有机器人系统但不愿重训练的开发者使用。
预训练机器人策略是许多验证过系统的基础,蕴含大量具身知识,但缺乏基础模型的语义感知能力。完全替换成本高且会损失积累的知识。为此,我们提出GUIDES——一种轻量级框架,通过引入基础模型的语义指导来增强预训练策略,无需重构模型架构。GUIDES使用微调的视觉语言模型(Instructor)生成上下文指令,由辅助模块编码为引导嵌入,并注入策略的潜在空间。通过简短针对性微调,旧模型可适应新语义输入。推理时,基于大语言模型的Reflector监控Instructor置信度;当置信度低时,启动推理循环,分析执行历史、检索相关示例并扩充VLM上下文以优化后续动作。在RoboCasa仿真环境中对多种策略架构的广泛验证显示,任务成功率持续显著提升。真实世界部署于UR5机器人也表明,GUIDES提升了关键子任务如抓取的运动精度。总体而言,GUIDES提供了一种实用且资源高效的路径,用于升级而非替换已验证的机器人策略。
原文摘要 · Abstract (English)
Pre-trained robot policies serve as the foundation of many validated robotic systems, which encapsulate extensive embodied knowledge. However, they often lack the semantic awareness characteristic of foundation models, and replacing them entirely is impractical in many situations due to high costs and the loss of accumulated knowledge. To address this gap, we introduce GUIDES, a lightweight framework that augments pre-trained policies with semantic guidance from foundation models without requiring architectural redesign. GUIDES employs a fine-tuned vision-language model (Instructor) to generate contextual instructions, which are encoded by an auxiliary module into guidance embeddings. These embeddings are injected into the policy's latent space, allowing the legacy model to adapt to this new semantic input through brief, targeted fine-tuning. For inference-time robustness, a large language model-based Reflector monitors the Instructor's confidence and, when confidence is low, initiates a reasoning loop that analyzes execution history, retrieves relevant examples, and augments the VLM's context to refine subsequent actions. Extensive validation in the RoboCasa simulation environment across diverse policy architectures shows consistent and substantial improvements in task success rates. Real-world deployment on a UR5 robot further demonstrates that GUIDES enhances motion precision for critical sub-tasks such as grasping. Overall, GUIDES offers a practical and resource-efficient pathway to upgrade, rather than replace, validated robot policies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。