用扩散模型高效生成交通场景并控制行为,提升自动驾驶仿真真实性和效率。
SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout
- 采用摊销扩散机制,降低每步推理开销16倍
- 在Waymo数据集上实现扩散模型最佳闭环性能
- 支持语言指令控制场景生成,适合仿真系统开发者
真实且可交互的场景模拟是自动驾驶开发的关键前提。本文提出SceneDiffuser,一种面向交通仿真的场景级扩散先验,统一处理场景初始化(生成初始交通布局)与场景滚动(闭环模拟智能体行为)两大阶段。尽管扩散模型已证明能学习真实且多模态的智能体分布,但可控性、闭环仿真中的真实性维持及推理效率仍是挑战。为此,我们引入模拟扩散范式,将去噪计算成本分摊至未来仿真步骤,使每步推理步骤减少16倍,同时缓解闭环误差。通过引入广义硬约束机制和少量示例提示大语言模型,实现基于语言的场景可控生成。模型扩展实验表明,增加算力显著提升整体仿真真实性。我们在Waymo Open Sim Agents Challenge中验证了方法有效性,取得最佳开环表现及扩散模型中领先的闭环性能。
原文摘要 · Abstract (English)
Realistic and interactive scene simulation is a key prerequisite for autonomous vehicle (AV) development. In this work, we present SceneDiffuser, a scene-level diffusion prior designed for traffic simulation. It offers a unified framework that addresses two key stages of simulation: scene initialization, which involves generating initial traffic layouts, and scene rollout, which encompasses the closed-loop simulation of agent behaviors. While diffusion models have been proven effective in learning realistic and multimodal agent distributions, several challenges remain, including controllability, maintaining realism in closed-loop simulations, and ensuring inference efficiency. To address these issues, we introduce amortized diffusion for simulation. This novel diffusion denoising paradigm amortizes the computational cost of denoising over future simulation steps, significantly reducing the cost per rollout step (16x less inference steps) while also mitigating closed-loop errors. We further enhance controllability through the introduction of generalized hard constraints, a simple yet effective inference-time constraint mechanism, as well as language-based constrained scene generation via few-shot prompting of a large language model (LLM). Our investigations into model scaling reveal that increased computational resources significantly improve overall simulation realism. We demonstrate the effectiveness of our approach on the Waymo Open Sim Agents Challenge, achieving top open-loop performance and the best closed-loop performance among diffusion models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。