arXiv:2512.10226cs.CVcs.RO2025-12中稿 · CVPR被引 9

用隐空间推理替代文字,让自动驾驶模型更高效地规划动作。

Latent Chain-of-Thought World Modeling for End-to-End Driving

  • 用动作和世界状态的隐变量交替表示推理过程
  • 在大规模基准上实现更快推理与更高轨迹质量
  • 适合追求高效决策的端到端自动驾驶研究者

当前自动驾驶视觉-语言-动作(VLA)模型通过推理阶段的思维链(CoT)提升复杂场景下的表现。以往方法多依赖自然语言表达思维链,但文本并非最优推理表征。本文提出隐式思维链驾驶模型(Latent-CoT-Drive, LCDrive),将思维链以捕捉动作可能结果的隐空间语言表达。该方法统一了思维链与决策,在动作对齐的隐空间中同时表示推理与行为。模型通过交替使用动作提议词(与输出动作共享词汇)和基于学习的隐世界模型词(描述动作未来结果)进行推理。通过监督真实场景回放生成的行动提议与世界模型词实现冷启动,再通过闭环强化学习进行后训练以增强推理能力。在大规模端到端驾驶基准测试中,LCDrive相比无推理及文本推理基线,不仅推理速度更快、轨迹质量更高,且在交互式强化学习中提升幅度更大。

原文摘要 · Abstract (English)

Recent Vision-Language-Action (VLA) models for autonomous driving explore inference-time reasoning as a way to improve driving performance and safety in challenging scenarios. Most prior work uses natural language to express chain-of-thought (CoT) reasoning before producing driving actions. However, text may not be the most efficient representation for reasoning. In this work, we present Latent-CoT-Drive (LCDrive): a model that expresses CoT in a latent language that captures possible outcomes of the driving actions being considered. Our approach unifies CoT reasoning and decision making by representing both in an action-aligned latent space. Instead of natural language, the model reasons by interleaving (1) action-proposal tokens, which use the same vocabulary as the model's output actions; and (2) world model tokens, which are grounded in a learned latent world model and express future outcomes of these actions. We cold start latent CoT by supervising the model's action proposals and world model tokens based on ground-truth future rollouts of the scene. We then post-train with closed-loop reinforcement learning to strengthen reasoning capabilities. On a large-scale end-to-end driving benchmark, LCDrive achieves faster inference, better trajectory quality, and larger improvements from interactive reinforcement learning compared to both non-reasoning and text-reasoning baselines.

自动驾驶思维链隐空间强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。