arXiv:2506.11124cs.CVcs.SE2025-06被引 8

用迭代纠错和空间提示提升大模型在自动驾驶数据中挖场景的准确率

Technical Report for Argoverse2 Scenario Mining Challenges on Iterative Error Correction and Spatially-Aware Prompting

  • 通过错误反馈循环重生成代码,提升大模型生成代码的稳定性
  • 在Argoverse2上用Gemini 2.5 Pro达到52.37的HOTA-Temporal得分
  • 适合需要高精度挖掘复杂交通场景的研究者与工程团队

从大规模自动驾驶数据集(如Argoverse 2)中进行场景挖掘对自驾车系统开发与验证至关重要。RefAV框架利用大语言模型(LLMs)将自然语言查询转化为可执行代码以识别相关场景,但存在因模型生成代码引发的运行时错误,以及对描述多对象空间关系函数参数理解不准的问题。本技术报告提出两项改进:(1) 基于错误反馈的容错迭代代码生成机制,通过反复提示优化代码;(2) 针对空间关系函数的专用提示工程,提升模型理解与正确使用能力。在Argoverse 2验证集上,使用Qwen2.5-VL-7B、Gemini 2.5 Flash和Gemini 2.5 Pro等多款LLM的实验显示,各项指标均有提升;尤其在官方测试集上,使用Gemini 2.5 Pro的系统取得52.37的HOTA-Temporal分数。结果表明所提方法在实现可靠、高精度场景挖掘方面具有显著有效性。

原文摘要 · Abstract (English)

Scenario mining from extensive autonomous driving datasets, such as Argoverse 2, is crucial for the development and validation of self-driving systems. The RefAV framework represents a promising approach by employing Large Language Models (LLMs) to translate natural-language queries into executable code for identifying relevant scenarios. However, this method faces challenges, including runtime errors stemming from LLM-generated code and inaccuracies in interpreting parameters for functions that describe complex multi-object spatial relationships. This technical report introduces two key enhancements to address these limitations: (1) a fault-tolerant iterative code-generation mechanism that refines code by re-prompting the LLM with error feedback, and (2) specialized prompt engineering that improves the LLM's comprehension and correct application of spatial-relationship functions. Experiments on the Argoverse 2 validation set with diverse LLMs-Qwen2.5-VL-7B, Gemini 2.5 Flash, and Gemini 2.5 Pro-show consistent gains across multiple metrics; most notably, the proposed system achieves a HOTA-Temporal score of 52.37 on the official test set using Gemini 2.5 Pro. These results underline the efficacy of the proposed techniques for reliable, high-precision scenario mining.

场景挖掘大模型自动驾驶提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。