arXiv:2606.02105cs.CV2026-06

提出可生成多条驾驶动作的扩散模型,提升自动驾驶系统稳定性与性能。

Multimodal Action Diffusion for Robust End-to-End Autonomous Driving

论文配图:Multimodal Action Diffusion for Robust End-to-End Autonomous Driving
图 1 · 摘自论文原文
  • 用扩散Transformer直接建模多种可能驾驶动作,不固定单一输出。
  • 在Bench2Drive上超越当前最好结果,延迟降低十倍。
  • 适合追求高鲁棒性与高效推理的自动驾驶研究者。

端到端自动驾驶系统普遍通过预测中间轨迹点来规划路径,最终控制依赖带GPS的手工控制器。直接端到端预测油门、转向和刹车信号的研究仍较少,且对动作多模态的作用理解不足。我们认为,超越确定性单动作输出不仅是建模选择,更是提升驾驶表现、表征质量与训练稳定性的关键。为此,我们提出动作扩散Transformer(ADT),一种基于MSE损失的无锚点扩散变压器,能原生建模合理驾驶动作的多模态分布。不同于单一确定性指令,ADT在推理时生成K个动作候选,并通过最近邻匹配(NNM)选出最优者。实验表明,动作多模态显著提升学习表征质量与行为一致性,是确定性架构无法实现的。ADT在具有挑战性的闭环Bench2Drive基准上超越现有最先进方法,同时实现十倍更低延迟,证明了表达性强、多模态的动作建模在实际效率与理论必要性上的双重优势。

原文摘要 · Abstract (English)

End-to-End Autonomous Driving (E2E-AD) systems have largely converged on predicting intermediate trajectory waypoints, delegating final control to hand-crafted controllers with GPS access. Direct control-signal prediction (outputting throttle, steer and brake in an end-to-end fashion) remains underexplored, and critically, the role of action multimodality in such systems is not well understood. We argue that moving beyond deterministic, single-action outputs is not merely a modelling choice, but a key driver of driving performance, representational quality, and training stability. To validate this, we introduce the Action Diffusion Transformer (ADT), an anchor-free diffusion transformer trained with a MSE objective that natively models the multimodal distribution of plausible driving actions. Rather than committing to a single deterministic command, ADT generates K action candidates and selects the most suitable one at inference via Nearest Neighbour Matching (NNM). Beyond strong benchmark numbers, we show that action multimodality yields measurable benefits in learned representations and behavioral consistency, effects that deterministic architectures cannot replicate. ADT surpasses previous state-of-the-art on the challenging closed-loop Bench2Drive benchmark while achieving ten times lower latency, demonstrating that expressive, multimodal action modelling is both practically efficient and conceptually essential for robust end-to-end driving.

自动驾驶扩散模型多模态端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。