让自动驾驶汽车用自然语言协作,提升安全与效率。
CoopReflect: Towards Natural Language Communication for Cooperative Autonomous Driving via Multi-Agent Learning
- 基于大模型的多智能体学习框架,通过试错和集体复盘提升协作能力。
- 生成更符合人类理解的通信内容,显著改善交通协同效果。
- 可跨场景通用且降低决策延迟,适合真实道路应用。
以往研究证明,自动驾驶车辆间通信能提升行驶安全性。然而,现有通信方式通常难以被人类理解。采用自然语言作为车对车(V2V)通信协议,有望使自动驾驶车辆不仅彼此协作,还能与人类驾驶员协同。为此,我们构建了基于大语言模型(LLM)的驾驶智能体,并在新仿真环境TalkingVehiclesGym中研究其交互,该环境包含可通过沟通避免碰撞或提升通行效率的交通场景。仅依赖思维链推理的LLM智能体协作效果不佳,为此我们提出CoopReflect,一种多智能体学习框架,通过试错与多智能体复盘,赋予智能体自然语言生成与高层决策能力。实验表明,CoopReflect生成的消息更具意义且更易理解,显著增强合作性能。最后,我们将特定场景知识提炼为统一语言模型策略,实现跨场景泛化并大幅降低决策延迟。代码与演示视频见https://talking-vehicles.github.io/。
原文摘要 · Abstract (English)
Past work has demonstrated that autonomous vehicles can drive more safely if they communicate with each other. However, this communication is usually not human-understandable. Using natural language as a vehicle-to-vehicle (V2V) communication protocol offers the potential for autonomous vehicles to drive cooperatively not only with each other but also with human drivers. To explore the potential use of natural language for V2V communication, we develop LLM-based driving agents and study their interactions in a new simulation environment, TalkingVehiclesGym, which features traffic scenarios where communication can potentially help avoid imminent collisions and/or support efficient traffic flow. While LLM agents relying solely on chain-of-thought reasoning struggle to coordinate effectively, we introduce CoopReflect, a multi-agent learning framework that equips agents with knowledge for both natural language message generation and high-level decision-making through trial and error and multi-agent debriefing. Experiments show that CoopReflect produces more meaningful and human-understandable messages than existing baselines, enabling stronger cooperation. Finally, we distill scenario-specific knowledge into a unified language model policy, achieving cross-scenario generalization and substantially reducing decision-making latency. Our code and demo videos are available at https://talking-vehicles.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。