用AI生成逼真的自动驾驶危险场景,提升测试全面性。
Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles
- 通过大模型推理出合理且具挑战性的威胁行为,生成初始危险场景。
- 在仿真中引入复杂交通流,使威胁加剧,碰撞率提升31.96%。
- 生成的场景真实可信,适合用于训练和验证自动驾驶系统。
自动驾驶车辆在上路前的安全评估依赖于仿真中的安全临界场景生成。然而现有方法多基于预设威胁模式或规则策略,难以发现多样且未知的失效模式。为此,我们提出ScenGE框架,通过推理新型对抗性场景并结合复杂交通流放大威胁,生成大量安全临界场景。给定一个良性场景提示后,首先执行元场景生成:基于结构化驾驶知识的大语言模型推断出一个行为合理且具有挑战性的对抗代理。该元场景被转化为可执行代码,实现仿真环境中的精确控制。随后,复杂场景演化模块利用背景车辆放大核心威胁,构建对抗合作者图以优化关键路径,设计扰动同时压缩主车操作空间并制造关键遮挡。在多个基于强化学习的自动驾驶模型上进行的实验表明,ScenGE平均比当前最优基线发现更多严重碰撞案例(+31.96%)。此外,该框架适用于大模型驱动的自动驾驶系统,可在不同仿真器部署;在生成场景上进行对抗训练可显著提升模型鲁棒性。最后,通过真实车辆测试与人类评估验证,确认生成场景兼具合理性与临界性。本工作有望推动公众信任建立与自动驾驶安全落地。
原文摘要 · Abstract (English)
The generation of safety-critical scenarios in simulation has become increasingly crucial for safety evaluation in autonomous vehicles prior to road deployment in society. However, current approaches largely rely on predefined threat patterns or rule-based strategies, which limit their ability to expose diverse and unforeseen failure modes. To overcome these, we propose ScenGE, a framework that can generate plentiful safety-critical scenarios by reasoning novel adversarial cases and then amplifying them with complex traffic flows. Given a simple prompt of a benign scene, it first performs Meta-Scenario Generation, where a large language model, grounded in structured driving knowledge, infers an adversarial agent whose behavior poses a threat that is both plausible and deliberately challenging. This meta-scenario is then specified in executable code for precise in-simulator control. Subsequently, Complex Scenario Evolution uses background vehicles to amplify the core threat introduced by Meta-Scenario. It builds an adversarial collaborator graph to identify key agent trajectories for optimization. These perturbations are designed to simultaneously reduce the ego vehicle's maneuvering space and create critical occlusions. Extensive experiments conducted on multiple reinforcement learning based AV models show that ScenGE uncovers more severe collision cases (+31.96%) on average than SoTA baselines. Additionally, our ScenGE can be applied to large model based AV systems and deployed on different simulators; we further observe that adversarial training on our scenarios improves the model robustness. Finally, we validate our framework through real-world vehicle tests and human evaluation, confirming that the generated scenarios are both plausible and critical. We hope our paper can build up a critical step towards building public trust and ensuring their safe deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。