用大模型让自动驾驶车能互动学习,跨场景协作更智能。
Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework
- 大模型结合环境模块,避免直接控制导致的位置计算错误。
- 四阶段推理链提升多步决策稳定性,支持全场景协同驾驶。
- 记忆与检索增强生成让车辆能从过往经验中持续学习。
当前联网自动驾驶汽车(CAVs)已在多地开展道路测试,但在复杂场景下的安全与效率表现仍不理想。协同驾驶通过利用CAVs的连接能力实现协同效应,是提升复杂场景性能的可行路径。然而,现有系统缺乏交互与持续学习能力,限制了其在单一场景和特定协同驾驶自动化(CDA)层级的应用。为此,本文提出CoDrivingLLM框架,实现全场景、全CDA层级的可交互、可学习协同驾驶。首先,针对大语言模型(LLMs)不擅长数学计算的问题,引入环境模块基于语义决策更新车辆位置,避免直接控制带来的误差。其次,依据SAE J3216标准定义的四级CDA,设计基于思维链(COT)的推理模块,包含状态感知、意图共享、协商与决策,并通过冲突协调器集中处理冲突,提升多步推理稳定性。最后,引入记忆模块并采用检索增强生成技术,使CAVs具备从历史经验中学习的能力。通过消融实验验证了协商模块的有效性、不同样本量下的推理表现,以及相比其他协同驾驶方法的优势。
原文摘要 · Abstract (English)
At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity ability of CAVs to achieve synergies greater than the sum of their parts, making it a promising approach to improving CAV performance in complex scenarios. However, the lack of interaction and continuous learning ability limits current cooperative driving to single-scenario applications and specific Cooperative Driving Automation (CDA). To address these challenges, this paper proposes CoDrivingLLM, an interactive and learnable LLM-driven cooperative driving framework, to achieve all-scenario and all-CDA. First, since Large Language Models(LLMs) are not adept at handling mathematical calculations, an environment module is introduced to update vehicle positions based on semantic decisions, thus avoiding potential errors from direct LLM control of vehicle positions. Second, based on the four levels of CDA defined by the SAE J3216 standard, we propose a Chain-of-Thought (COT) based reasoning module that includes state perception, intent sharing, negotiation, and decision-making, enhancing the stability of LLMs in multi-step reasoning tasks. Centralized conflict resolution is then managed through a conflict coordinator in the reasoning process. Finally, by introducing a memory module and employing retrieval-augmented generation, CAVs are endowed with the ability to learn from their past experiences. We validate the proposed CoDrivingLLM through ablation experiments on the negotiation module, reasoning with different shots experience, and comparison with other cooperative driving methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。