arXiv:2608.26645cs.RO2026-08中稿 · CVPR被引 3

让视觉语言机器人学会自动纠错和恢复失败。

FLARE: A Failure-Aware Framework for Autonomous Correction and Recovery in Visual-Language Robotic Manipulation

论文配图:FLARE: A Failure-Aware Framework for Autonomous Correction and Recovery in Visual-Language Robotic Manipulation
图 1 · 摘自论文原文
  • 通过注入扰动和桥接片段,让策略自主应对执行偏差。
  • 在10个接触密集任务中,成功率提升至87.3%。
  • 适合需要高鲁棒性的复杂机器人操作场景。

视觉-语言-动作模型(VLAs)在泛化到复杂、长时程机器人操作任务方面展现出巨大潜力。然而,其性能仍不稳定,因为它们通常在单调、无失败的示范数据上训练。这种对“完美”数据的依赖使其无法从常见执行错误中恢复,如抓取失败、物体掉落或意外碰撞。本文提出FLARE框架,通过“重试”与“重置”范式赋予VLAs强大的错误恢复能力。首先,引入“重试”机制:通过在示范中注入扰动和桥接段,解耦机器人位姿与环境状态,使策略能自主处理执行偏差。其次,针对关键性、状态破坏性(分布外,OOD)失败,设计“重置”流程:利用多模态大语言模型(MLLM)离线分析执行视频,自动识别出分布外状态,并高效收集少量以物体为中心的“重置”技能,训练其将环境恢复至任务有效状态。完整框架整合这些学习到的策略。推理阶段,一个在线的MLLM监控器在任务执行与“重置”技能间进行仲裁。在挑战性的接触密集型操作任务上的实验表明,该方法显著提升了任务成功率和鲁棒性。

原文摘要 · Abstract (English)

Vision-Language-Action Models~(VLAs) have demonstrated significant promise in generalizing to complex, long-horizon robotic manipulation tasks. However, their performance remains brittle, as they are typically trained on trajectory-monotonic, failure-free demonstrations. This reliance on ``perfect" data leaves them unable to recover from common execution errors, such as a missed grasp, a dropped object, or an unexpected collision. In this paper, we propose FLARE, a novel framework that endows VLAs with robust error recovery capabilities through a ``Retry" and ``Reset" paradigm. First, we introduce a ``Retry" mechanism by injecting perturbation and bridging segments that decouple robot pose from environment state into demonstrations, enabling the policy to autonomously handle execution deviations. Second, to address critical, state-breaking (OOD) failures, we introduce a ``Reset" pipeline. We leverage an MLLM for offline failure analysis to automatically identify OOD states from execution videos. This analysis enables the efficient, targeted collection of a small library of object-centric ``Reset" skills, which are trained to restore the environment to a task-valid state. Our full framework integrates these learned policies. At inference, an online MLLM monitor arbitrates between task execution and ``Reset" skills. Experiments on challenging, contact-rich manipulation tasks show our approach significantly improves task success and robustness.

机器人操作错误恢复视觉语言模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。