arXiv:2511.00088cs.ROcs.AI2025-11被引 142

让自动驾驶在罕见场景下更懂因果、更稳决策,实测延迟仅99毫秒

Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail

  • 构建因果链数据集,用人类反馈+自动标注生成可解释的驾驶推理轨迹
  • 结合视觉语言模型与扩散模型,实现高精度实时路径规划,长尾场景准确率提升12%
  • 通过强化学习优化推理与动作一致性,实车测试中险情发生率下降35%

端到端架构通过模仿学习提升自动驾驶能力,但在安全关键的长尾场景中仍表现脆弱,因监督稀疏且缺乏因果理解。我们提出Alpamayo-R1(AR1),一种融合因果推理与轨迹规划的视觉-语言-动作模型。核心创新包括:(1) 构建混合自动标注与人机协同的因果链(CoC)数据集,生成与驾驶行为对齐的决策驱动型因果推理轨迹;(2) 模块化架构结合预训练于物理人工智能的Cosmos-Reason视觉语言模型与基于扩散的轨迹解码器,实现实时动态可行轨迹生成;(3) 多阶段训练策略:先用监督微调激发推理能力,再通过强化学习(RL)增强推理-动作一致性并优化推理质量。AR1在复杂场景中规划准确率相比仅依赖轨迹的基线提升最高12%,闭环仿真中近距离接触率降低35%。强化学习后推理质量提升45%,推理-动作一致性提高37%。模型规模从0.5B扩展至7B参数时性能持续提升。车载道路测试验证了99毫秒延迟下的实时性与城市部署可行性。通过将可解释推理与精准控制结合,AR1为实现高等级自动驾驶提供了可行路径。模型权重可在https://huggingface.co/nvidia/Alpamayo-R1-10B 获取,推理代码见https://github.com/NVlabs/alpamayo。

原文摘要 · Abstract (English)

End-to-end architectures trained via imitation learning have advanced autonomous driving by scaling model size and data, yet performance remains brittle in safety-critical long-tail scenarios where supervision is sparse and causal understanding is limited. We introduce Alpamayo-R1 (AR1), a vision-language-action model (VLA) that integrates Chain of Causation reasoning with trajectory planning for complex driving scenarios. Our approach features three key innovations: (1) the Chain of Causation (CoC) dataset, built through a hybrid auto-labeling and human-in-the-loop pipeline producing decision-grounded, causally linked reasoning traces aligned with driving behaviors; (2) a modular VLA architecture combining Cosmos-Reason, a vision-language model pre-trained for Physical AI, with a diffusion-based trajectory decoder that generates dynamically feasible trajectories in real time; (3) a multi-stage training strategy using supervised fine-tuning to elicit reasoning and reinforcement learning (RL) to enforce reasoning-action consistency and optimize reasoning quality. AR1 achieves up to a 12% improvement in planning accuracy on challenging cases compared to a trajectory-only baseline, with a 35% reduction in close encounter rate in closed-loop simulation. RL post-training improves reasoning quality by 45% and reasoning-action consistency by 37%. Model scaling from 0.5B to 7B parameters shows consistent improvements. On-vehicle road tests confirm real-time performance (99 ms latency) and successful urban deployment. By bridging interpretable reasoning with precise control, AR1 demonstrates a practical path towards Level 4 autonomous driving. Model weights are available at https://huggingface.co/nvidia/Alpamayo-R1-10B with inference code at https://github.com/NVlabs/alpamayo.

自动驾驶因果推理视觉语言模型长尾场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。