arXiv:2503.22496cs.ROcs.CV2025-03CVPR被引 38

用向量扩散模型生成逼真自动驾驶仿真场景,效率更高、更真实。

Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environments

  • 用向量化的潜在扩散模型直接生成道路图和车辆位置
  • 参数少2倍、生成延迟低6倍、训练耗时少10倍
  • 适合强化学习训练的复杂对抗性驾驶场景生成

我们提出Scenario Dreamer,一种全数据驱动的自动驾驶规划生成式仿真器,可同时生成初始交通场景(包括车道图和智能体边界框)及闭环智能体行为。现有方法将初始场景编码为栅格图像,导致网络参数多、计算冗余(因大量空白像素)。此外,基于规则的智能体行为缺乏多样性和真实性。Scenario Dreamer采用新型向量化潜在扩散模型生成初始场景,直接处理矢量元素,并使用自回归Transformer实现数据驱动的智能体行为模拟。该方法还支持通过扩散修复实现场景外推,生成无限扩展的仿真环境。大量实验表明,Scenario Dreamer在真实性和效率上均优于现有生成式仿真器:其基础场景生成模型参数量减少约2倍,生成延迟降低6倍,训练所需GPU时长减少10倍。我们验证了其实用性:强化学习规划智能体在Scenario Dreamer生成的长距离、对抗性环境中面临更大挑战。

原文摘要 · Abstract (English)

We introduce Scenario Dreamer, a fully data-driven generative simulator for autonomous vehicle planning that generates both the initial traffic scene - comprising a lane graph and agent bounding boxes - and closed-loop agent behaviours. Existing methods for generating driving simulation environments encode the initial traffic scene as a rasterized image and, as such, require parameter-heavy networks that perform unnecessary computation due to many empty pixels in the rasterized scene. Moreover, we find that existing methods that employ rule-based agent behaviours lack diversity and realism. Scenario Dreamer instead employs a novel vectorized latent diffusion model for initial scene generation that directly operates on the vectorized scene elements and an autoregressive Transformer for data-driven agent behaviour simulation. Scenario Dreamer additionally supports scene extrapolation via diffusion inpainting, enabling the generation of unbounded simulation environments. Extensive experiments show that Scenario Dreamer outperforms existing generative simulators in realism and efficiency: the vectorized scene-generation base model achieves superior generation quality with around 2x fewer parameters, 6x lower generation latency, and 10x fewer GPU training hours compared to the strongest baseline. We confirm its practical utility by showing that reinforcement learning planning agents are more challenged in Scenario Dreamer environments than traditional non-generative simulation environments, especially on long and adversarial driving environments.

自动驾驶生成式仿真扩散模型向量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。