用对话式RAG框架自动生成合规自动驾驶测试场景脚本。
Chat2Scenic: An Iterative RAG-Based Framework for Scenario Generation in Autonomous Driving

- 通过迭代式RAG结合法规与领域语言,生成可执行场景脚本。
- 编译成功率76.42%,框架准确率58.17%,显著优于现有方法。
- 适合自动驾驶验证研究者使用,含公开数据集与开源代码。
验证自动驾驶系统需多样且符合法规的测试场景。在基于仿真的测试中,场景以可执行脚本形式定义。然而,从法规描述自动生成此类脚本仍是开放挑战,现有方法存在根本权衡:检索-组装方法编译率尚可但难扩展,而基于检索的全脚本生成编译成功率低。我们提出Chat2Scenic,首个用于领域特定语言(DSL)场景脚本生成的迭代式检索增强框架。该框架提供聊天机器人界面支持交互式场景优化,并集成检索增强生成(RAG),将生成过程锚定于法规知识与DSL语法。此外,我们构建了一个开放基准,包含123个来自NHTSA、联合国车辆法规及其他来源的场景。基于最先进大模型的大量评估表明,Chat2Scenic实现76.42%的编译成功率(CSR)和58.17%的框架准确率(FA),显著优于现有方法(检索-组装:30.08% CSR, 11.03% FA;检索全脚本生成:16.26% CSR, 10.86% FA)。为促进后续研究,代码已开源:https://github.com/TUM-AVS/chat2scenic。
原文摘要 · Abstract (English)
Validating autonomous driving systems requires diverse, regulation-compliant test scenarios. In simulation-based testing, scenarios are defined as executable scripts. Yet automatically generating such scripts from regulatory descriptions remains an open challenge, and existing approaches face fundamental trade-offs. Retrieval-assemble methods achieve reasonable compilation rates but lack scalability, whereas retrieval-based full-script generation suffers from low compilation success rates. We present Chat2Scenic, the first iterative retrieval-augmented framework to generate scenario scripts in Domain Specific Language (DSL). Specifically, Chat2Scenic provides a chatbot interface that supports interactive scenario refinement and integrates Retrieval-augmented Generation (RAG) to ground scenario generation in regulatory knowledge and DSL syntax. Furthermore, we propose an open benchmark for scenario generation comprising 123 scenarios from various regulations, including NHTSA and United Nations Vehicle Regulations, as well as other sources. Extensive evaluation with State-of-the-Art (SOTA) Large Language Models (LLMs) demonstrates that Chat2Scenic achieves 76.42% Compilation Success Rate (CSR) and 58.17% Framework Accuracy (FA), outperforming existing methods (Retrieval Assemble with 30.08% CSR, 11.03% FA and Retrieval full script generation with 16.26% CSR, 10.86% FA). To facilitate future research, we release our code as open source at https://github.com/TUM-AVS/chat2scenic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。