让语言模型生成更自然的驾驶轨迹,提升复杂场景下的安全性。
LAD-Drive: Bridging Language and Trajectory with Action-Aware Diffusion Transformers
- 用概率化动作解码器分离意图与规划,保留导航不确定性。
- 在LangAuto上驾驶得分比基线最高提升59%,碰撞和偏离大幅减少。
- 适合研究自动驾驶生成式规划、多模态决策的学者和工程师。
尽管多模态大语言模型(MLLM)为自动驾驶提供了先进的推理能力,但如何将离散语义知识转化为连续轨迹仍是根本挑战。现有方法多依赖单模态规划头,难以表征多模式驾驶行为;多数生成方法仅以独热编码动作作为条件,丢失了复杂场景中关键的导航不确定性。为此,我们提出LAD-Drive,一种结构上解耦高层意图与低层空间规划的生成框架。LAD-Drive通过动作解码器推断概率化的元动作分布,建立显式的信念状态,保留了独热编码常丢失的细微意图信息。该分布与车辆运动学状态融合后,作为动作感知扩散解码器的条件,利用截断去噪过程将学习到的运动锚点优化为安全且符合运动学约束的轨迹。在LangAuto基准上的大量评估显示,LAD-Drive达到最先进水平,驾驶得分相较基线最高提升59%,同时显著降低路径偏离和碰撞率。代码与模型将公开发布于https://github.com/iis-esslingen/lad-drive。
原文摘要 · Abstract (English)
While multimodal large language models (MLLMs) provide advanced reasoning for autonomous driving, translating their discrete semantic knowledge into continuous trajectories remains a fundamental challenge. Existing methods often rely on unimodal planning heads that inherently limit their ability to represent multimodal driving behavior. Furthermore, most generative approaches frequently condition on one-hot encoded actions, discarding the nuanced navigational uncertainty critical for complex scenarios. To resolve these limitations, we introduce LAD-Drive, a generative framework that structurally disentangles high-level intention from low-level spatial planning. LAD-Drive employs an action decoder to infer a probabilistic meta-action distribution, establishing an explicit belief state that preserves the nuanced intent typically lost by one-hot encodings. This distribution, fused with the vehicle's kinematic state, conditions an action-aware diffusion decoder that utilizes a truncated denoising process to refine learned motion anchors into safe, kinematically feasible trajectories. Extensive evaluations on the LangAuto benchmark demonstrate that LAD-Drive achieves state-of-the-art results, outperforming competitive baselines by up to 59% in Driving Score while significantly reducing route deviations and collisions. We will publicly release the code and models on https://github.com/iis-esslingen/lad-drive.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。