通过失败诊断提升自动驾驶视觉语言动作模型性能
Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures
- 从失败中提取具体错误类型,生成可解释的诊断报告
- 修复失败样本并注入强化学习,使模型在长尾场景下表现超越基准
- 适合研究自动驾驶决策与强化学习融合的开发者
面向自动驾驶的视觉-语言-动作(VLA)模型在强化学习优化中常遭遇性能瓶颈。这一现象源于先前监督微调带来的探索能力受限,导致长尾场景中所有尝试动作均获得零分驾驶评分。此类信息稀疏的奖励信号虽表明失败,却无法识别根本原因——是规划错误、推理缺陷还是轨迹执行问题。为此,我们提出ELF-VLA框架,通过结构化失败诊断增强强化学习。该方法不依赖模糊标量奖励,而是生成详细可解释的失败报告,指导策略进行反馈驱动的修正。将修正后的高奖励样本重新注入训练批次,提供精准梯度,使模型能够解决原始探索无法攻克的关键场景。大量实验表明,本方法充分释放了VLA模型的潜在能力,在公开的NAVSIM基准上实现了整体PDMS、EPDMS得分及高层规划准确率的最优表现。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration capabilities constrained by previous Supervised Fine-Tuning (SFT), leading to persistent failures in long-tail scenarios. In these critical situations, all explored actions yield a zero-value driving score. This information-sparse reward signals a failure, yet fails to identify its root cause -- whether it is due to incorrect planning, flawed reasoning, or poor trajectory execution. To address this limitation, we propose VLA with Explicit Learning from Failures (ELF-VLA), a framework that augments RL with structured diagnostic feedback. Instead of relying on a vague scalar reward, our method produces detailed, interpretable reports that identify the specific failure mode. The VLA policy then leverages this explicit feedback to generate a Feedback-Guided Refinement. By injecting these corrected, high-reward samples back into the RL training batch, our approach provides a targeted gradient, which enables the policy to solve critical scenarios that unguided exploration cannot. Extensive experiments demonstrate that our method unlocks the latent capabilities of VLA models, achieving state-of-the-art (SOTA) performance on the public NAVSIM benchmark for overall PDMS, EPDMS score and high-level planning accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。