用大模型让自动驾驶汽车自己解困,还能让乘客帮忙决策。
Large Language Model-assisted Autonomous Vehicle Recovery from Immobilization
- 用大语言模型分析环境,自动或通过乘客指导生成解困指令。
- 在基准测试中表现接近顶尖水平,乘客协助后效果更优。
- 可无缝接入现有系统,无需改动底层架构,适合实际部署。
尽管近年来自动驾驶技术取得显著进展,但在某些交通场景中,自动驾驶汽车仍难以应对人类司机轻松处理的情况,常导致车辆陷入停滞,影响整体交通流。现有解决方案如远程干预(成本高、效率低)和手动接管(排斥非驾驶员,限制可访问性)均不理想。本文提出 StuckSolver,一种基于大语言模型的新型自主恢复框架,使自动驾驶汽车能通过自我推理或乘客引导实现解困。StuckSolver 作为插件模块运行于现有感知-规划-控制架构之上,无需修改内部结构,仅需接入标准传感器数据流以检测停滞状态、理解环境上下文,并生成可由原生规划器执行的高层恢复指令。我们在 Bench2Drive 基准和自定义不确定性场景中评估了 StuckSolver,结果表明,仅靠自主推理即达到近状态领先水平,加入乘客引导后性能进一步提升。
原文摘要 · Abstract (English)
Despite significant advancements in recent decades, autonomous vehicles (AVs) continue to face challenges in navigating certain traffic scenarios where human drivers excel. In such situations, AVs often become immobilized, disrupting overall traffic flow. Current recovery solutions, such as remote intervention (which is costly and inefficient) and manual takeover (which excludes non-drivers and limits AV accessibility), are inadequate. This paper introduces StuckSolver, a novel Large Language Model (LLM) driven recovery framework that enables AVs to resolve immobilization scenarios through self-reasoning and/or passenger-guided decision-making. StuckSolver is designed as a plug-in add-on module that operates on top of the AV's existing perception-planning-control stack, requiring no modification to its internal architecture. Instead, it interfaces with standard sensor data streams to detect immobilization states, interpret environmental context, and generate high-level recovery commands that can be executed by the AV's native planner. We evaluate StuckSolver on the Bench2Drive benchmark and in custom-designed uncertainty scenarios. Results show that StuckSolver achieves near-state-of-the-art performance through autonomous self-reasoning alone and exhibits further improvements when passenger guidance is incorporated.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。