用模块化框架让预训练视觉语言模型变可靠机器人
RoboBRIDGE: A Modular Framework for Bridging Policies to Robust Real-World Robotic Agents

- 五模块协同架构,实现错误检测与自动修复
- 跨平台实测中任务成功率显著优于单一策略
- 适合希望快速部署稳健机器人的研发团队
视觉-语言-动作(VLA)模型作为可扩展的机械臂操作方法受到广泛关注。尽管其动作预测有效,但直接部署为机器人时存在关键缺陷:缺乏故障恢复机制、长时序执行不一致,且对观测、任务或机器人形态变化敏感。现有方案多通过重新训练或定制环境模块逐一解决,但缺乏系统性框架将预训练VLA转化为鲁棒机器人代理。本文提出RoboBRIDGE,一个包含监控、感知、规划、控制和机器人接口五个模块的集成框架,可组合现成组件(包括预训练VLA)构建鲁棒机器人。监控模块实现快速故障检测与分层恢复,防止错误蔓延;当环境偏离计划时,规划模块触发重规划,感知模块异步更新场景理解,避免执行停滞;控制器通过专用LoRA适配器微调基础技能,使操作具备领域不变性,降低对领域偏移的敏感度。在LIBERO、RoboCasa及多平台真实场景测试中,RoboBRIDGE consistently超越独立策略与已有增强型VLA部署方案。结果表明,可靠的机器人智能不仅依赖动作预测能力的提升,更源于对其的结构化协同管理。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have attracted growing interest as a scalable approach to robotic manipulation. While these models are effective action predictors, deploying them as robotic agents exposes critical gaps: no mechanism for failure recovery, inconsistent execution over long horizons, and limited robustness to shifts in observations, tasks, or embodiments. Existing solutions address these limitations individually through model retraining or environment-specific modules, yet what is needed is a general framework that systematically transforms a pretrained VLA into a robotic agent. We present RoboBRIDGE, a modular framework that provides an orchestration layer over five coordinated modules, namely Monitor, Perceptor, Planner, Controller, and Robot Interface, to compose robust robotic agents from off-the-shelf components, including pretrained VLAs. The Monitor pairs rapid failure detection with hierarchical recovery to correct errors before they cascade. When the environment diverges from the current plan, the Planner triggers replanning while the Perceptor updates scene understanding asynchronously, avoiding execution stalls. Within the Controller, primitive skill fine-tuning factors manipulation into domain-invariant primitives with dedicated LoRA adapters, reducing sensitivity to domain shifts when a VLA is used. Across LIBERO, RoboCasa, and real-world case studies spanning multiple robot platforms and VLA backbones, RoboBRIDGE consistently outperforms both standalone policies and prior augmented VLA deployments. These results suggest that reliable robotic agency does not arise from scaling action predictors alone, but from structured orchestration around them.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。