arXiv:2605.08528cs.MAcs.RO2026-05被引 2

高并发物理仿真驱动自动驾驶训练,兼顾真实动力学与效率。

SceneFactory: GPU-Accelerated Multi-Agent Driving Simulation with Physics-Based Vehicle Dynamics

论文配图:SceneFactory: GPU-Accelerated Multi-Agent Driving Simulation with Physics-Based Vehicle Dynamics
图 1 · 摘自论文原文
  • 用GPU张量批量处理场景与车辆,实现物理引擎的并行化。
  • 单卡运行256场景×16车,每秒达19250步仿真,提速127倍。
  • 支持雨天路面摩擦等真实物理变化,适合追求高保真的研究者。

自动驾驶仿真器通常在物理精度与可扩展性之间权衡。基于物理的平台如CARLA和MetaDrive提供复杂的车辆动力学与接触交互,但其非向量化接口难以支持批量训练。而Waymax和GPUDrive等GPU批处理系统虽可扩展至数百场景,却采用简化的运动学模型,省略了轮胎-路面作用、悬挂系统、接触动力学及道路条件依赖的摩擦力。我们提出SceneFactory,一个基于NVIDIA Isaac Sim + Isaac Lab的GPU向量化平台,用于程序化场景构建、基于物理的多智能体仿真与强化学习。场景中世界与智能体以批量张量表示,控制、观测、奖励、重置与策略推断均通过Isaac Lab张量接口在GPU上执行。SceneFactory将Waymo Open Motion Dataset的道路拓扑转为可模拟的USD世界,在单张GPU上并发运行多个场景,每个场景注入多个带物理属性的PhysX车辆,并根据降水与路面类型映射至PhysX材料摩擦系数。借助GPU向量化,SceneFactory相较非向量化PhysX基线在同硬件下提升高达127倍吞吐量,实现256场景×16智能体下每秒19,250次受控智能体仿真步骤。跨仿真器迁移测试显示动态差异不对称:基于物理的强化学习策略迁移至简化运动学自行车模型成功率99.5%,反向迁移仅47.3%。在湿滑路面上,考虑摩擦的策略使平均峰值减速度从58.7降至27.8 m/s²,且不牺牲目标达成率。结果表明,高可扩展的自动驾驶训练无需舍弃刚体动力学或物理相关的道路条件变化。

原文摘要 · Abstract (English)

Autonomous-driving simulators typically trade physical fidelity for scalable parallelism. Physics-based platforms such as CARLA and MetaDrive provide articulated vehicle dynamics and contact, but their non-vectorized interfaces make batched training difficult. GPU-batched systems such as Waymax and GPUDrive scale to hundreds of scenarios by replacing rigid-body physics with simplified kinematic models, omitting tire--road interaction, suspension, contact dynamics, and road-condition-dependent friction. We introduce SceneFactory, a GPU-vectorized platform for procedural scene construction, physics-based multi-agent simulation, and RL in autonomous-driving environments. Built on NVIDIA Isaac Sim + Isaac Lab, SceneFactory represents worlds and agents as batched tensors: control, observations, rewards, resets, and policy inference run as GPU tensor operations over the Isaac Lab tensor API. SceneFactory converts Waymo Open Motion Dataset road topologies into simulation-ready USD worlds, runs many worlds concurrently on one GPU, populates each with multiple articulated PhysX vehicles, and maps precipitation and road-surface type to PhysX material friction coefficients. With GPU vectorization, SceneFactory achieves up to 127$\times$ higher throughput than a non-vectorized PhysX baseline on the same GPU and physics solver, reaching 19,250 controlled-agent simulation steps per second at 256 worlds $\times$ 16 agents. Cross-simulator transfer reveals an asymmetric dynamics gap: physics-grounded RL policies transfer to a simplified kinematic bicycle model with 99.5% success, whereas reverse transfer drops to 47.3%. Under wet-road friction, friction-aware policies reduce mean peak DRAC from 58.7 to 27.8,m/s$^2$ without sacrificing goal reach. SceneFactory shows that scalable autonomous-driving training need not discard articulated rigid-body dynamics or physically grounded road-condition variation.

自动驾驶物理仿真GPU加速多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。