arXiv:2602.20577cs.CV2026-02被引 1

用掩码视觉语言动作扩散模型,实现高效可解释的端到端自动驾驶。

Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion

  • 将动作离散化为可行路径点,构建紧凑代码本。
  • 在隐空间中逼近物理几何度量,提升规划精度。
  • 优先解码轨迹生成,兼顾效率与可解释性。

大型语言模型(LLMs)和视觉语言模型(VLMs)已成为端到端自动驾驶的有前景候选方案。然而,这些模型通常面临推理延迟高、动作精度低和可解释性差的问题。现有自回归方法在逐标记生成时速度缓慢,而先前基于扩散的规划器则依赖冗长且通用的语言标记,缺乏显式几何结构。本文提出面向自动驾驶的掩码视觉语言动作扩散框架(MVLAD-AD),通过掩码视觉语言动作扩散模型,弥合高效规划与语义可解释性之间的差距。不同于将动作强行映射到语言空间的方法,我们引入离散动作分词策略,从真实驾驶分布中构建紧凑的运动学可行路径点代码本。同时,提出几何感知嵌入学习,确保隐空间中的嵌入近似物理几何度量。最后,设计动作优先解码策略以优先生成轨迹。在nuScenes及衍生基准上的大量实验表明,MVLAD-AD在规划精度上超越最先进的自回归与扩散基线,同时实现更高效率与高保真可解释推理。

原文摘要 · Abstract (English)

Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged as promising candidates for end-to-end autonomous driving. However, these models typically face challenges in inference latency, action precision, and explainability. Existing autoregressive approaches struggle with slow token-by-token generation, while prior diffusion-based planners often rely on verbose, general-purpose language tokens that lack explicit geometric structure. In this work, we propose Masked Vision-Language-Action Diffusion for Autonomous Driving (MVLAD-AD), a novel framework designed to bridge the gap between efficient planning and semantic explainability via a masked vision-language-action diffusion model. Unlike methods that force actions into the language space, we introduce a discrete action tokenization strategy that constructs a compact codebook of kinematically feasible waypoints from real-world driving distributions. Moreover, we propose geometry-aware embedding learning to ensure that embeddings in the latent space approximate physical geometric metrics. Finally, an action-priority decoding strategy is introduced to prioritize trajectory generation. Extensive experiments on nuScenes and derived benchmarks demonstrate that MVLAD-AD achieves superior efficiency and outperforms state-of-the-art autoregressive and diffusion baselines in planning precision, while providing high-fidelity and explainable reasoning.

自动驾驶扩散模型可解释性动作规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。