arXiv:2605.09701cs.CV2026-05被引 3

让自动驾驶模型提前预判未来状态来指导当前决策,提升规划能力。

DriveFuture: Future-Aware Latent World Models for Autonomous Driving

论文配图:DriveFuture: Future-Aware Latent World Models for Autonomous Driving
图 1 · 摘自论文原文
  • 用未来状态反向优化当前潜空间表示,实现前瞻性建模。
  • 在NAVSIM-v2和v1测试集上分别达55.5和90.7的最优指标。
  • 适合关注端到端自动驾驶规划与未来感知融合的研究者。

现有的自动驾驶潜空间世界模型虽为未来感知提供了路径,但通常将未来潜状态视为预测目标或辅助信号,而非直接用于轨迹规划,导致当前与未来特征在潜空间中纠缠。本文提出DriveFuture,一种面向规划的未来感知潜空间建模框架,通过将未来世界状态显式地作为条件,指导当前潜状态建模过程。训练时,模型先从当前潜状态和自车动作预测未来潜状态,再通过交叉注意力与真实未来潜状态对齐;推理时则基于预测的未来潜状态进行规划。该方法在公开的NAVSIM基准上取得领先性能:NAVSIM-v2 navhard上达55.5 EPDMS,navtest上达89.9 EPDMS,NAVSIM-v1 navtest上达90.7 PDMS。结果表明,潜空间建模的关键不在于单纯模拟未来,而在于以未来状态显式影响当前决策。截至2026年4月,DriveFuture在NAVSIM-v2 navhard排行榜上排名第一,并在NAVSIM-v1 navtest上达到最优表现。

原文摘要 · Abstract (English)

Existing latent world models for autonomous driving have opened a promising path toward future-aware driving intelligence. However, they typically treat future latent states as prediction targets or auxiliary signals, rather than directly conditioning trajectory planning. This can entangle current and future features in latent space. In this work, we propose DriveFuture, a future-aware latent world modeling framework for autonomous driving that explicitly learns planning-oriented foresight by conditioning the current latent state modeling process on future world states. Specifically, during training, the model first predicts future latent world states from the current latent state and ego action, and then refines the prediction against the ground-truth future latent state via cross-attention. The resulting future-aware latent serves as an explicit condition for a diffusion-based trajectory planner. During inference, DriveFuture conditions on the predicted future latent state instead of the ground-truth future state. DriveFuture achieves SOTA performance on the public NAVSIM benchmarks, reaching \textbf{55.5} EPDMS on NAVSIM-v2 {\textcolor{blue}{\textit{navhard}}}, \textbf{89.9} EPDMS on NAVSIM-v2 {\textcolor{blue}{\textit{navtest}}}, and \textbf{90.7} PDMS on NAVSIM-v1 {\textcolor{blue}{\textit{navtest}}}, respectively. These results suggest that the key to latent world modeling lies not merely in simulating future states, but more importantly in conditioning current decision-making on future states. Notably, as of April 2026, DriveFuture ranks \textbf{1st} on the \href{https://huggingface.co/spaces/AGC2025/e2e-driving-navhard}{NAVSIM-v2 {\textcolor{blue}{\textit{navhard}}}} leaderboard and achieves SOTA performance on \href{https://huggingface.co/spaces/AGC2024-P/e2e-driving-navtest}{NAVSIM-v1 {\textcolor{blue}{\textit{navtest}}}}.

自动驾驶潜空间建模未来感知轨迹规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。