DriveZero让自动驾驶超越人类驾驶数据,实现更智能的规划决策。
DriveZero: End-to-End Driving Beyond Human Demonstrations

- 将驾驶拆分为感知与决策模型,分别用视觉大模型和强化学习训练。
- 在nuPlan上达到93.57分,优于人类示范基线,在多个基准测试中领先。
- 无需人类轨迹监督,适合追求高鲁棒性的自动驾驶系统研究者。
现有端到端自动驾驶系统依赖模仿人类驾驶日志,行为受限于数据质量与覆盖范围。本文提出DriveZero,一种超越人类示范的端到端驾驶系统。它将驾驶分解为感知与动作模型:感知部分采用DriveVFM,融合DINOv3、SigLIP2、SAM和Depth Anything V2等冻结视觉基础模型,仅需原始图像即可构建统一主干,无需任务标注;动作部分引入DriveRL,一种混合智能体闭环强化学习框架,将真实驾驶日志转化为交互环境,通过PPO训练特权教师策略,并支持闭环采样。最终,DriveZero以纯摄像头输入,通过蒸馏教师策略的滚动轨迹实现端到端规划。该目标条件教师可响应增强驾驶意图,提供日志无法获得的多样化、目标一致监督。在nuPlan上,结合价值引导的测试时动作搜索,DriveRL在Val14、Test14-hard与Test14-random三个社区划分中均取得93.57的平均分,超过日志回放专家。DriveZero在NAVSIMv1、NAVSIMv2及闭环HUGSIM基准上均达当前最优,且无需人类轨迹监督。
原文摘要 · Abstract (English)
Most end-to-end autonomous-driving systems learn by imitating human driving logs, leaving their learned behavior constrained by the quality and behavioral coverage of the recorded trajectories. This report presents DriveZero, an end-to-end system that learns driving behavior beyond human demonstrations. It decomposes driving into a perception model and an action model, pretrains each in the regime best suited to it, and combines them into one end-to-end planner. The two models call for different learning recipes: perception must understand the world, and benefits from massive and diverse visual data; action must interact with it, and requires closed-loop feedback. On the action side, we introduce DriveRL, a mixed-agent closed-loop reinforcement-learning framework. It converts real driving logs into interactive worlds, where a privileged teacher policy is trained with PPO through closed-loop rollouts. For the perception model, DriveVFM consolidates multiple frozen vision foundation models, including DINOv3, SigLIP2, SAM and Depth Anything V2, into a single backbone from raw images alone, requiring no task-specific annotations. DriveZero then unifies the two: a camera-only planner that distills the frozen DriveRL teacher through its rolled-out trajectories. The goal-conditioned teacher can moreover be queried under augmented driving intents, yielding diverse, goal-consistent supervision that logged data cannot provide. On nuPlan, DriveRL with value-guided test-time action search achieves a mean score of 93.57 across the Val14, Test14-hard, and Test14-random community splits in both non-reactive and reactive modes, exceeding the Log-Replay expert on all three splits. DriveZero achieves state-of-the-art performance on NAVSIMv1, NAVSIMv2 and the closed-loop HUGSIM benchmark without any human trajectory supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。