arXiv:2512.11226cs.CV2025-12被引 6

让自动驾驶模型提前预演未来场景,做出更合理决策

FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model

  • 用思维链预测未来场景变化,引导路径优化
  • 在NAVSIM上使TransFuser的路径质量提升6.2 PDMS
  • 智能判断是否需要深思,兼顾效率与安全

在自动驾驶中,端到端规划器从原始传感器数据学习场景表征并生成运动规划。然而,仅依赖当前场景可能导致在高度动态交通环境中响应不佳,因为自身行为会进一步改变未来场景。为建模未来场景演变,我们引入世界模型来表示车辆与环境随时间交互变化的过程,这需要复杂推理。思维链(CoT)通过预测一系列未来思考,指导轨迹优化。本文提出FutureX,一种基于思维链的增强框架,通过未来场景隐空间推理与轨迹精炼,提升端到端规划器的复杂运动规划能力。具体而言,自动思考开关根据当前场景判断是否需额外推理;进入思考模式后,隐世界模型执行CoT引导的未来推演,预测未来场景表征,由摘要模块进一步优化运动规划;否则以即时模式快速生成规划。大量实验表明,FutureX在不牺牲效率的前提下,显著提升现有方法的合理性与安全性,减少碰撞,如在NAVSIM上使TransFuser的PDMS提升6.2。代码将开源。

原文摘要 · Abstract (English)

In autonomous driving, end-to-end planners learn scene representations from raw sensor data and utilize them to generate a motion plan or control actions. However, exclusive reliance on the current scene for motion planning may result in suboptimal responses in highly dynamic traffic environments where ego actions further alter the future scene. To model the evolution of future scenes, we leverage the World Model to represent how the ego vehicle and its environment interact and change over time, which entails complex reasoning. The Chain of Thought (CoT) offers a promising solution by forecasting a sequence of future thoughts that subsequently guide trajectory refinement. In this paper, we propose FutureX, a CoT-driven pipeline that enhances end-to-end planners to perform complex motion planning via future scene latent reasoning and trajectory refinement. Specifically, the Auto-think Switch examines the current scene and decides whether additional reasoning is required to yield a higher-quality motion plan. Once FutureX enters the Thinking mode, the Latent World Model conducts a CoT-guided rollout to predict future scene representation, enabling the Summarizer Module to further refine the motion plan. Otherwise, FutureX operates in an Instant mode to generate motion plans in a forward pass for relatively simple scenes. Extensive experiments demonstrate that FutureX enhances existing methods by producing more rational motion plans and fewer collisions without compromising efficiency, thereby achieving substantial overall performance gains, e.g., 6.2 PDMS improvement for TransFuser on NAVSIM. Code will be released.

自动驾驶思维链世界模型轨迹规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。