用合成高风险场景后训练模型,提升自动驾驶安全性。
World Engine: Towards the Era of Post-Training for Autonomous Driving

- 基于真实日志生成高保真交互环境,并扩展出安全关键变体
- 在nuPlan基准上显著减少罕见场景中的失败率,优于单纯扩充预训练数据
- 适合追求自动驾驶安全性的研究者与工业界团队
自动驾驶车辆必须在真实世界中安全运行,而错误可能带来严重后果。尽管现代端到端驾驶策略在常规场景中表现优异,但其可靠性受限于真实驾驶数据中稀缺的安全关键「长尾」事件。这些罕见交互定义了学习策略的实际安全边界,却难以大规模真实采集。本文提出通过在合成的高风险交互上对预训练驾驶模型进行后训练来解决这一根本限制。我们引入World Engine,一个生成式框架,可从真实世界日志重建高保真交互环境,并系统性地外推为真实的安全关键变体。该范式支持基于强化学习的后训练,使策略与安全约束对齐,避免真实世界探索中的物理风险。在基于nuPlan构建的公开基准上,World Engine显著降低罕见安全关键场景中的失败率,增益远超单纯扩大预训练数据。此外,在生产级自动驾驶系统部署中,该策略减少了模拟碰撞,并在实路测试中展现可测量的改进,证明在合成安全关键交互上后训练是实现更安全自动驾驶的可扩展有效路径。完整代码库(含训练流程)已开源。
原文摘要 · Abstract (English)
Autonomous vehicles must operate safely in the real world, where errors can have severe consequences. Although modern end-to-end driving policies excel in routine scenarios, their reliability is limited by the scarcity of safety-critical ``long-tail'' events in real driving datasets. These rare interactions define the practical safety boundary of the learned policy, yet they are difficult to collect at scale in the real world. Here we show that this fundamental limitation can be addressed by post-training pre-trained driving models on synthesized high-stakes interactions. We introduce World Engine, a generative framework that reconstructs high-fidelity interactive environments from real-world logs and systematically extrapolates them into realistic safety-critical variations. This paradigm enables reinforcement-based post-training to align policies with safety constraints, circumventing the physical risks inherent in real-world exploration. On a public benchmark built on nuPlan, World Engine substantially reduces failures in rare safety-critical scenarios and yields significantly larger gains than scaling pre-training data alone. Furthermore, when deployed on a production-scale autonomous driving system, the resulting policy reduces simulated collisions and demonstrates measurable improvements in on-road testing, showing that post-training on synthesized, safety-critical interactions offers a scalable and effective pathway to safer autonomous driving. The full codebase suite, including training, is released to the public.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。