用大模型智能生成复杂交通场景,提升自动驾驶测试效率。
AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Framework
- 基于大模型代理框架,通过自然语言描述自动扩增真实交通场景。
- 专家评估显示生成场景质量媲美人工设计,且控制精度高。
- 适合自动驾驶系统测试、算法验证等需要大量挑战性场景的场景。
罕见但关键的交通场景在自动驾驶规划器的测试与评估中构成重大挑战。仅依赖真实道路数据需收集海量样本以覆盖这些场景。尽管自动生成交通场景具有潜力,但数据驱动模型需大量训练数据,且难以精细控制输出。此外,从零生成新场景可能引入分布偏移,削弱基于学习的规划器评估的有效性。现有方法通过扩展现有测试集中的场景来应对,但依赖领域专家手动扩增,难以满足自动驾驶系统评估所需的规模。本文提出一种基于大模型代理框架的新型场景扩增方法,利用自然语言描述实现自动化生成,克服了上述局限。核心创新在于采用代理式设计,可在小而经济的大模型上实现精细控制与高性能。大规模专家评估表明,该框架能精准遵循用户意图,生成的质量与人工设计相当。
原文摘要 · Abstract (English)
Rare, yet critical, scenarios pose a significant challenge in testing and evaluating autonomous driving planners. Relying solely on real-world driving scenes requires collecting massive datasets to capture these scenarios. While automatic generation of traffic scenarios appears promising, data-driven models require extensive training data and often lack fine-grained control over the output. Moreover, generating novel scenarios from scratch can introduce a distributional shift from the original training scenes which undermines the validity of evaluations especially for learning-based planners. To sidestep this, recent work proposes to generate challenging scenarios by augmenting original scenarios from the test set. However, this involves the manual augmentation of scenarios by domain experts. An approach that is unable to meet the demands for scale in the evaluation of self-driving systems. Therefore, this paper introduces a novel LLM-agent based framework for augmenting real-world traffic scenarios using natural language descriptions, addressing the limitations of existing methods. A key innovation is the use of an agentic design, enabling fine-grained control over the output and maintaining high performance even with smaller, cost-effective LLMs. Extensive human expert evaluation demonstrates our framework's ability to accurately adhere to user intent, generating high quality augmented scenarios comparable to those created manually.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。