arXiv:2503.08683cs.CVcs.AI2025-03ICCV被引 20

用大模型实现车辆间语言协商,提升自动驾驶协作效率

CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving

  • 基于大模型的双向协商机制,动态优化合作策略
  • 在复杂交互场景中达成11%更高成功率
  • 适合研究智能交通与多车协同的开发者

车对车(V2V)协同自动驾驶有望通过解决单智能体系统中的感知与预测不确定性来提升安全性。然而,传统协同方法受限于僵化的协作协议,且难以泛化到未见交互场景。尽管大模型具备通用推理能力,但其在空间规划和不稳定推理延迟方面的挑战阻碍了其在协同驾驶中的直接应用。为此,我们提出CoLMDriver,首个全流程基于大模型的协同驾驶系统,支持基于语言的协商与实时驾驶控制。CoLMDriver采用并行驱动架构,包含两个关键组件:(i) 基于演员-评论家范式的LLM协商模块,通过各车辆历史决策反馈持续优化合作策略;(ii) 意图引导的航点生成器,将协商结果转化为可执行航点。此外,我们构建了InterDrive,一个基于CARLA的仿真基准,包含10个具有挑战性的交互驾驶场景,用于评估V2V协同。实验表明,CoLMDriver在多样化高交互性场景中显著优于现有方法,成功率提升11%。代码将在https://github.com/cxliu0314/CoLMDriver发布。

原文摘要 · Abstract (English)

Vehicle-to-vehicle (V2V) cooperative autonomous driving holds great promise for improving safety by addressing the perception and prediction uncertainties inherent in single-agent systems. However, traditional cooperative methods are constrained by rigid collaboration protocols and limited generalization to unseen interactive scenarios. While LLM-based approaches offer generalized reasoning capabilities, their challenges in spatial planning and unstable inference latency hinder their direct application in cooperative driving. To address these limitations, we propose CoLMDriver, the first full-pipeline LLM-based cooperative driving system, enabling effective language-based negotiation and real-time driving control. CoLMDriver features a parallel driving pipeline with two key components: (i) an LLM-based negotiation module under an actor-critic paradigm, which continuously refines cooperation policies through feedback from previous decisions of all vehicles; and (ii) an intention-guided waypoint generator, which translates negotiation outcomes into executable waypoints. Additionally, we introduce InterDrive, a CARLA-based simulation benchmark comprising 10 challenging interactive driving scenarios for evaluating V2V cooperation. Experimental results demonstrate that CoLMDriver significantly outperforms existing approaches, achieving an 11% higher success rate across diverse highly interactive V2V driving scenarios. Code will be released on https://github.com/cxliu0314/CoLMDriver.

自动驾驶大模型协同驾驶语言协商

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。