构建可编辑的高保真驾驶世界,自动生成安全关键场景用于自动驾驶测试。
OmniSCS: Omni Safety-Critical Scenario Synthesis for Autonomous Driving via a Fully Editable Driving World

- 通过双策略重构与深度优化,编辑场景时保持车辆外观和背景真实度。
- 在nuScenes、Waymo等数据集上,编辑后场景保真度优于现有方法。
- 支持13Hz实时闭环测试,适用于自动驾驶算法验证与安全优化。
安全关键场景(SCS)的生成及其在闭环仿真中的评估,对提升自动驾驶系统鲁棒性至关重要。该过程需在现有场景中对智能体的状态(外观与轨迹)进行编辑,但现有方法在场景编辑后难以保持数据真实性,且生成高质量SCS效率低下。为此,我们提出OmniSCS,一个可生成高物理保真度、逼真的安全关键场景并支持合成环境闭环测试的新系统。OmniSCS包含两个核心模块:1)全可编辑驾驶世界构建模块,采用双策略智能体重构与深度优化背景重构方法,在编辑过程中维持高保真度的智能体外观与背景;2)SCS生成模块,支持物体插入与智能体轨迹编辑,以合成多样化的安全关键场景并保持数据一致性。在nuScenes、Waymo和KITTI数据集上的实验表明,OmniSCS在编辑后场景保真度方面优于当前最优方法。进一步验证显示其能有效增强自动驾驶算法性能,并支持13Hz实时闭环测试。总体而言,OmniSCS为自动驾驶的SCS优化与测试提供了更安全、高效、低成本的解决方案。
原文摘要 · Abstract (English)
The synthesis of safety-critical scenarios (SCS) and their evaluation through closed-loop simulations are crucial for developing robust autonomous driving systems. A key aspect of this process involves editing agent states in both appearance and trajectory levels within existing scenes. However, current methods struggle to preserve data fidelity after scene editing and fail to efficiently generate high-quality SCS through such modifications. To overcome these limitations, we propose OmniSCS, an innovative system that generates photorealistic SCS with high physical fidelity while enabling closed-loop testing in synthetic environments. OmniSCS comprises two key modules: 1) A Fully Editable Driving World Construction module that maintains high-fidelity agent appearance and background during scene editing via dual-strategy agent reconstruction and depth-refinement background reconstruction methods. 2) A SCS Synthesis module that facilitates object insertion and agent trajectory editing to synthesize diverse SCS while preserving data fidelity. Experiments on nuScenes, Waymo, and KITTI datasets show that OmniSCS outperforms state-of-the-art methods in edited scene fidelity. We further validate its ability to enhance autonomous driving algorithms and support real-time (13Hz) closed-loop testing. Overall, OmniSCS provides a safer, more effective, and cost-efficient solution for SCS optimization and testing in autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。