arXiv:2605.21273cs.CV2026-05

用一步元动作替代复杂语言推理,提升自动驾驶模型效率与表现

DriveMA: Rethinking Language Interfaces in Driving VLAs with One-Step Meta-Actions

  • 用简洁的元动作代替长篇语言推理,降低模型负担
  • 2B和4B版本在Waymo挑战中分别获8.060和8.079分,刷新纪录
  • 适合关注推理效率与实际部署的自动驾驶研究者

驾驶视觉-语言-动作模型(Driving VLAs)通常将自然语言推理作为端到端规划的中间接口,但这类以推理为中心的设计面临三大瓶颈:高质量推理标注难获取、紧凑模型难以生成与理解长推理链、推理延迟显著增加。本文重新思考驾驶VLAs中的语言接口设计,提出用简洁的一步元动作替代冗长推理,元动作兼具语义决策依据且熵低,可从专家轨迹自动推导,支持可扩展监督与可靠轨迹条件化。基于此接口,提出DriveMA,结合以动作为中心的监督训练与逐轮信用分配强化学习框架,联合优化元动作准确性、轨迹质量及轨迹-元动作一致性。实验表明,DriveMA在2B模型下已达到Waymo端到端驾驶挑战新SOTA,Rater Feedback Score(RFS)为8.060;4B版本进一步提升至8.079;在NAVSIM上也取得有竞争力表现。消融实验显示,一步元动作在表达性、可预测性与推理效率之间提供了更优的实用权衡,优于自然语言推理或更细粒度动作序列。代码、数据与模型将公开,推动后续研究。

原文摘要 · Abstract (English)

Driving Vision-Language-Action Models (Driving VLAs) commonly introduce natural-language reasoning as an intermediate interface for end-to-end planning, but reasoning-centric interfaces face three practical bottlenecks: obtaining high-quality reasoning annotations is difficult, generating and understanding long reasoning chains is challenging for compact models, and inference latency is substantially increased. In this paper, we rethink the design of language interfaces in Driving VLAs and show that concise one-step meta-actions are a simple yet effective alternative to verbose reasoning. Meta-actions provide semantic decision grounding while remaining low-entropy, and being automatically derivable from expert trajectories, enabling scalable supervision and reliable trajectory conditioning. Building on this interface, we propose DriveMA, which combines action-centric supervised training with a turn-level credit-assignment reinforcement learning framework that jointly optimizes meta-action correctness, trajectory quality, and trajectory--meta-action consistency. Experiments show that DriveMA already achieves a new state of the art on the Waymo End-to-End Driving Challenge with a 2B model, reaching a Rater Feedback Score (RFS) of 8.060, while its 4B version further improves the state of the art to 8.079; DriveMA also obtains competitive performance on NAVSIM. Ablations demonstrate that one-step meta-actions offer a better practical trade-off between expressiveness, predictability, and inference efficiency than natural-language reasoning or finer-grained action sequences. Code, data, and models will be released to facilitate future research.

自动驾驶语言接口元动作强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。