arXiv:2502.02145cs.AIcs.CL2025-02中稿 · IEEE ITSC 2025被引 8

用大模型自动评估生成自动驾驶危险场景,提升测试效率与覆盖面。

From Words to Collisions: LLM-Guided Evaluation and Adversarial Generation of Safety-Critical Driving Scenarios

  • 通过指令工程设计两类提示策略,让大模型理解驾驶场景
  • 能准确识别碰撞风险并生成真实感强的高危场景
  • 适合自动驾驶安全测试团队和算法研发人员使用

确保自动驾驶车辆的安全性依赖于基于虚拟场景的测试,而这类测试长期以来依赖人工设计的场景作为安全指标。为减少人工解读成本并克服传统方法可扩展性差的问题,本文结合大语言模型(LLMs)与结构化场景解析、提示工程,实现安全关键驾驶场景的自动化评估与生成。提出笛卡尔坐标系与自车中心两种提示策略用于场景评估,并设计对抗生成模块,通过修改高风险车辆轨迹(自车攻击者)构造临界场景。在2D仿真框架中使用多个预训练大模型验证,结果表明评估模块能有效检测碰撞场景并推断场景安全性;生成模块可识别高风险主体并合成真实可信的安全关键场景。结论显示,配备领域提示技术的大模型能高效完成场景评估与生成,降低对人工设计指标的依赖。代码与场景数据已开源:https://github.com/TUM-AVS/From-Words-to-Collisions。

原文摘要 · Abstract (English)

Ensuring the safety of autonomous vehicles requires virtual scenario-based testing, which depends on the robust evaluation and generation of safety-critical scenarios. So far, researchers have used scenario-based testing frameworks that rely heavily on handcrafted scenarios as safety metrics. To reduce the effort of human interpretation and overcome the limited scalability of these approaches, we combine Large Language Models (LLMs) with structured scenario parsing and prompt engineering to automatically evaluate and generate safety-critical driving scenarios. We introduce Cartesian and Ego-centric prompt strategies for scenario evaluation, and an adversarial generation module that modifies trajectories of risk-inducing vehicles (ego-attackers) to create critical scenarios. We validate our approach using a 2D simulation framework and multiple pre-trained LLMs. The results show that the evaluation module effectively detects collision scenarios and infers scenario safety. Meanwhile, the new generation module identifies high-risk agents and synthesizes realistic, safety-critical scenarios. We conclude that an LLM equipped with domain-informed prompting techniques can effectively evaluate and generate safety-critical driving scenarios, reducing dependence on handcrafted metrics. We release our open-source code and scenarios at: https://github.com/TUM-AVS/From-Words-to-Collisions.

自动驾驶大模型安全测试场景生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。