arXiv:2605.12622cs.ROcs.CV2026-05

让自动驾驶模型基于推理生成合理驾驶动作,而非简单复制已有轨迹。

Action Emergence from Streaming Intent

论文配图:Action Emergence from Streaming Intent
图 1 · 摘自论文原文
  • 通过连续思维链和时间流式意图,实现从场景理解到驾驶决策的因果推理。
  • 在Waymo数据集上达到7.96(验证集)和7.74(测试集)的RFS得分。
  • 首次在端到端视觉语言模型中实现意图可控的高质量路径生成,无需预设轨迹库。

我们将动作涌现定义为端到端自动驾驶的核心能力:在任意长尾交通场景中,通过场景条件化推理生成物理可行、语义恰当且安全合规的动作,而非依赖已学场景-动作映射的检索或插值。以往方法无法实现动作涌现:自回归轨迹解码器将固有的多模态未来压缩为单一平均输出,而扩散与流匹配生成器虽表达多模态,却无法被理性意图引导。我们提出流式意图(Streaming Intent)机制,使驾驶意图(1)通过连续思维链从场景理解中因果推导,(2)跨片段时间流式传递以保持全程意图一致性。我们在一个名为SI(Streaming Intent)的视觉语言模型中实现了该机制。SI自回归解码四步思维链并输出意图标记,该意图驱动无分类器指导(CFG)下的流匹配动作头,仅需两步去噪即可生成最终轨迹。在Waymo端到端基准测试中,SI表现优异,验证集RFS得分为7.96,测试集为7.74。超越整体指标,该模型首次在全端到端视觉语言模型中展现出意图忠实的可控制性:固定场景下,不同意图类别推理产生显著差异但始终高质量的规划,完全源于数据驱动学习,无需预建轨迹库或手动后处理选择器。

原文摘要 · Abstract (English)

We formalize action emergence as a target capability for end-to-end autonomous driving: the ability to generate physically feasible, semantically appropriate, and safety-compliant actions in arbitrary, long-tail traffic scenes through scene-conditioned reasoning rather than retrieval or interpolation of learned scene-action mappings. We show that previous paradigms cannot deliver action emergence: autoregressive trajectory decoders collapse the inherently multimodal future into a single averaged output, while diffusion and flow-matching generators express multimodality but are not steerable by reasoned intent. We propose Streaming Intent as a concrete way to approach action emergence: a mechanism that makes driving intent (i) semantically streamed through a continuous chain-of-thought that causally derives the intent from scene understanding, and (ii) temporally streamed across clips so that intent commitments remain coherent along the driving horizon. We realize Streaming Intent in a VLA model we call SI (Streaming Intent). SI autoregressively decodes a four-step chain-of-thought and emits an intent token; the decoded intent then drives classifier-free guidance (CFG) on a flow-matching action head, requiring only two denoising steps to generate the final trajectory. On the Waymo End-to-End benchmark, SI achieves competitive aggregate performance, with an RFS score of 7.96 on the validation set and 7.74 on the test set. Beyond aggregate metrics, the model demonstrates -- to our knowledge for the first time in a fully end-to-end VLA -- intent-faithful controllability: for a fixed scene, varying the intent class at inference yields qualitatively distinct yet consistently high-quality plans, arising purely from data-driven learning without any pre-built trajectory bank or hand-coded post-hoc selector.

自动驾驶意图生成流匹配视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。