用中间特征提前退出,让视频扩散模型更高效地规划驾驶轨迹。
Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Features

- 从扩散模型中间层提取轨迹,动态决定何时停止计算
- 在NAVSIM上达90.8 PDMS,比固定深度方案快47%
- 无需微调即可跨域迁移,碰撞率仅0.08%
大型视频扩散模型为自动驾驶提供丰富的时空先验,但现有世界-动作模型仍继承未来视频生成的迭代成本,而部署只需自车轨迹。我们提出:多少扩散过程才足以做出可靠决策?通过控制实验发现,规划性能对视频去噪步数不敏感,且早期层已可解码出优质轨迹。基于此,我们提出Adaptive-WAM,一个基于Wan2.2-5B骨干的品质感知多出口规划器。在选定DiT块上附加轨迹扩散头,轻量级质量评分器判断当前最优轨迹是否达标;达标则终止推理,否则从缓存隐状态继续至更深出口。该设计避免了未来视频合成所需的迭代无分类器去噪和VAE解码,按轨迹品质动态分配骨干深度。在NAVSIM上,自适应单轨迹规划器达90.8 PDMS;固定出口版本(64提案)达92.6 PDMS。在NAVSIM v2上获89.9 EPDMS,为当前最佳。未微调下迁移至nuScenes,平均L2误差0.88 m,碰撞率0.08%。A100上,自适应路由使PDMS从90.62提升至90.79,端到端延迟平均170 ms,分别低于固定块15方案(190 ms)与全深方案(320 ms)约10%与47%。代码将开源。
原文摘要 · Abstract (English)
Large video diffusion models provide rich spatiotemporal priors for autonomous driving, but existing world-action models often inherit the cost of iterative future-video generation even though deployment only requires an ego trajectory. We ask a more basic question: how much of a video diffusion model must be executed to make a reliable driving decision? Through a controlled study of video denoising timesteps and Diffusion Transformer (DiT) depth, we find that planning performance is largely insensitive to the tested video-noise levels, whereas strong trajectories can already be decoded from intermediate layers. Based on this observation, we introduce Adaptive-WAM, a quality-aware multi-exit planner built on a Wan2.2-5B backbone. Trajectory diffusion heads are attached to selected DiT blocks, and a lightweight trajectory-quality scorer terminates inference once the best trajectory decoded so far satisfies a quality threshold; otherwise, computation continues from the cached hidden state to a deeper exit. The deployed planner therefore avoids the iterative classifier-free denoising loop and VAE decoding required for future-video synthesis, while dynamically allocating backbone depth according to trajectory quality. On NAVSIM, the adaptive single-trajectory planner achieves 90.8 PDMS; a separate fixed-exit variant reaches 92.6 PDMS with 64 proposals. It further obtains 89.9 EPDMS on NAVSIM v2, yielding the best reported results among the compared front-view video world-model planners. Without target-domain fine-tuning, Adaptive-WAM transfers to nuScenes with 0.88 m average L2 error and a 0.08\% collision rate. On an A100, adaptive routing improves PDMS from 90.62 to 90.79 while averaging 170 ms end-to-end planning latency, approximately 10\% below the 190 ms fixed block-15 planner and 47\% below the 320 ms fixed full-depth planner. Code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。