让机器人从失败中学习,自动规避导致崩溃的错误动作。
Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models

- 用失败轨迹作为负向引导,动态修正动作生成方向。
- 在短/长任务中均提升成功率,最高达基线3倍以上。
- 无需人工设计失败场景,适合真实机器人部署。
视觉-语言-动作(VLA)模型为可扩展的机器人操作提供了新范式,但其依赖成功样本的行为克隆使其脆弱:缺乏纠正信号,微小执行误差会迅速累积成无法恢复的分布外失败。为此,我们提出自适应失效感知学习(AFIL),一种端到端框架,利用失败轨迹作为扩散与流模型驱动的VLA策略的自适应负向引导。AFIL通过预训练VLA在线生成失败轨迹,避免了手工设计失败模式或人机协同恢复的需求。它联合训练用于成功与失败行为的双动作生成器(DAGs),共享同一视觉-语言主干,实现高效且参数开销低的失效感知策略学习。采样时,失败生成器根据成功与失败分布间的每步距离动态调整引导强度,将动作远离高风险区域,趋向更可靠的成功模式。跨域内与域外机器人操作任务实验(涵盖短、长时程设置)表明,AFIL持续优于现有基线,在成功率与鲁棒性上均有显著提升,验证了其有效性、效率与通用性。
原文摘要 · Abstract (English)
Vision-language-action (VLA) models provide a promising paradigm for scalable robotic manipulation, yet their reliance on success-only behavioral cloning leaves them brittle; lacking corrective training signals, minor execution errors rapidly compound into unrecoverable, out-of-distribution failures. To address this limitation, we propose Adaptive Failure-Informed Learning (AFIL), an end-to-end framework that leverages failure trajectories as adaptive negative guidance for diffusion- and flow-based VLA policies. AFIL uses a pretrained VLA to generate failure rollouts online, avoiding the need for handcrafted failure-mode design or human-in-the-loop recovery. It then jointly trains Dual Action Generators (DAGs) for successful and failed behaviors while sharing a common vision-language backbone, enabling efficient failure-aware policy learning with limited parameter overhead. During sampling, the failure generator adaptively steers action generation away from failure-prone regions and toward more reliable success modes, with guidance strength determined by the per-diffusion-step distance between success and failure distributions. Experiments across in-domain and out-of-domain robotic manipulation tasks, covering both short- and long-horizon settings, show that AFIL consistently improves task success rates and robustness over existing VLA baselines, demonstrating its effectiveness, efficiency, and generality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。