arXiv:2503.09035cs.ROcs.AI2025-03

用大模型生成车辆极限操控动作,实现安全高动态避险

ManeuverGPT Agentic Control for Safe Autonomous Stunt Maneuvers

  • 用三个专业代理协作,让大模型理解指令并生成控制参数
  • 无需重训练,在CARLA仿真中成功完成多车型的J转弯
  • 适合研究智能驾驶高动态控制或人机交互的开发者

下一代自动驾驶主动安全功能应能安全执行类似专业特技驾驶员的避险操作,以在车辆操控极限下实现高敏捷运动。本文提出一种新框架ManeuverGPT,利用基于大语言模型(LLM)的智能体作为控制器,生成并执行高动态特技操作。在CARLA仿真环境中,针对如J转弯等激进动作,采用迭代式提示方法,从零开始优化车辆控制参数,无需重新训练模型权重。提出一种由三个专用智能体组成的代理架构:(1)查询增强代理,用于丰富用户指令的上下文;(2)驾驶员代理,负责生成操纵参数;(3)参数验证代理,强制实施基于物理和安全约束。实验结果表明,通过文本提示即可在多种车辆模型上成功执行J转弯,且能适应不同车辆动力学特性。性能通过既定成功标准评估,并讨论了数值精度与场景复杂性带来的局限。研究证实了大模型驱动控制在灵活、高动态操作中的潜力,同时强调了结合语言推理与算法验证的混合方法的重要性。

原文摘要 · Abstract (English)

The next generation of active safety features in autonomous vehicles should be capable of safely executing evasive hazard-avoidance maneuvers akin to those performed by professional stunt drivers to achieve high-agility motion at the limits of vehicle handling. This paper presents a novel framework, ManeuverGPT, for generating and executing high-dynamic stunt maneuvers in autonomous vehicles using large language model (LLM)-based agents as controllers. We target aggressive maneuvers, such as J-turns, within the CARLA simulation environment and demonstrate an iterative, prompt-based approach to refine vehicle control parameters, starting tabula rasa without retraining model weights. We propose an agentic architecture comprised of three specialized agents (1) a Query Enricher Agent for contextualizing user commands, (2) a Driver Agent for generating maneuver parameters, and (3) a Parameter Validator Agent that enforces physics-based and safety constraints. Experimental results demonstrate successful J-turn execution across multiple vehicle models through textual prompts that adapt to differing vehicle dynamics. We evaluate performance via established success criteria and discuss limitations regarding numeric precision and scenario complexity. Our findings underscore the potential of LLM-driven control for flexible, high-dynamic maneuvers, while highlighting the importance of hybrid approaches that combine language-based reasoning with algorithmic validation.

自动驾驶大模型控制智能体高动态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。