arXiv:2511.23369cs.CVcs.RO2025-11被引 35

通过大规模仿真生成真实驾驶数据缺失的复杂场景,提升自动驾驶系统泛化能力。

SimScale: Learning to Drive via Real-World Simulation at Scale

  • 利用神经渲染与动态环境模拟真实世界未见状态,生成高保真多视角观测。
  • 在navhard和navtest上分别提升8.6和2.9 EPDMS,且性能随仿真数据增加持续优化。
  • 适合研究自动驾驶规划、强化学习及仿真-现实协同训练的科研人员。

实现完全自动驾驶需要在广泛场景中学习合理决策,包括安全关键和分布外情形。然而,人类专家采集的真实数据中此类情况稀缺。为此,我们提出一种可扩展的仿真框架SimScale,基于现有驾驶日志生成海量未见过的状态。该流程采用先进神经渲染与响应式环境,生成由扰动自车轨迹控制的高保真多视角观测,并设计伪专家机制为新生成状态提供动作监督。在合成数据上,仅使用真实与仿真数据联合训练即可显著提升多种规划方法的鲁棒性与泛化能力,在navhard和navtest上分别取得+8.6和+2.9 EPDMS的改进。更重要的是,策略性能可随仿真数据增加而平稳提升,无需额外真实数据。我们进一步揭示了伪专家设计及不同策略架构下的缩放特性。仿真数据与代码已开源于https://github.com/OpenDriveLab/SimScale。

原文摘要 · Abstract (English)

Achieving fully autonomous driving systems requires learning rational decisions in a wide span of scenarios, including safety-critical and out-of-distribution ones. However, such cases are underrepresented in real-world corpus collected by human experts. To complement for the lack of data diversity, we introduce a novel and scalable simulation framework capable of synthesizing massive unseen states upon existing driving logs. Our pipeline utilizes advanced neural rendering with a reactive environment to generate high-fidelity multi-view observations controlled by the perturbed ego trajectory. Furthermore, we develop a pseudo-expert trajectory generation mechanism for these newly simulated states to provide action supervision. Upon the synthesized data, we find that a simple co-training strategy on both real-world and simulated samples can lead to significant improvements in both robustness and generalization for various planning methods on challenging real-world benchmarks, up to +8.6 EPDMS on navhard and +2.9 on navtest. More importantly, such policy improvement scales smoothly by increasing simulation data only, even without extra real-world data streaming in. We further reveal several crucial findings of such a sim-real learning system, which we term SimScale, including the design of pseudo-experts and the scaling properties for different policy architectures. Simulation data and code have been released at https://github.com/OpenDriveLab/SimScale.

自动驾驶仿真训练神经渲染泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。