用合成数据模拟自动驾驶未来状态,提升评估真实性和效率
Pseudo-Simulation for Autonomous Driving
- 基于3D高斯点云生成多样合成观测,增强真实数据
- 通过距离加权机制优先评估最可能的未来场景,相关性达R²=0.8
- 无需交互式仿真即可评估错误恢复能力,适合算法评测者
自动驾驶评估现有范式存在关键局限:真实世界测试受安全与可复现性制约,闭环仿真缺乏真实感或计算成本过高,开环评估则依赖忽略累积误差的指标。本文提出伪仿真(pseudo-simulation)新范式,基于真实数据,预先利用3D高斯点云生成合成观测,通过变化位置、朝向和速度构建多样化未来状态。采用基于距离的权重分配机制,突出最可能的场景。该方法在不进行序列交互仿真情况下,实现对错误恢复与因果混淆缓解的评估,与闭环仿真相关性达R²=0.8,优于现有最佳开环方法(R²=0.7)。我们建立了公开排行榜,代码已开源。
原文摘要 · Abstract (English)
Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient realism or high computational costs. Open-loop evaluation, while being efficient and data-driven, relies on metrics that generally overlook compounding errors. In this paper, we propose pseudo-simulation, a novel paradigm that addresses these limitations. Pseudo-simulation operates on real datasets, similar to open-loop evaluation, but augments them with synthetic observations generated prior to evaluation using 3D Gaussian Splatting. Our key idea is to approximate potential future states the AV might encounter by generating a diverse set of observations that vary in position, heading, and speed. Our method then assigns a higher importance to synthetic observations that best match the AV's likely behavior using a novel proximity-based weighting scheme. This enables evaluating error recovery and the mitigation of causal confusion, as in closed-loop benchmarks, without requiring sequential interactive simulation. We show that pseudo-simulation is better correlated with closed-loop simulations ($R^2=0.8$) than the best existing open-loop approach ($R^2=0.7$). We also establish a public leaderboard for the community to benchmark new methodologies with pseudo-simulation. Our code is available at https://github.com/autonomousvision/navsim.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。