arXiv:2506.20531cs.AIcs.CY2025-06被引 7

用过往驾驶案例增强大模型,让自动驾驶在高危场景下做出更可靠决策。

Case-based Reasoning Augmented Large Language Model Framework for Decision Making in Realistic Safety-Critical Driving Scenarios

  • 结合视频理解与历史案例检索,提升大模型决策的上下文敏感性。
  • 在多个数据集上,决策准确率和人类专家行为对齐度显著提升。
  • 适合需要可解释、高可靠性决策的智能驾驶系统研发者使用。

在安全关键型驾驶场景中,快速且具情境感知的决策需依赖情境理解与经验推理。尽管大语言模型(LLMs)具备强大的通用推理能力,但其在自动驾驶中的直接应用受限于领域适配性差、情境锚定不足,以及缺乏应对动态高风险环境所需的经验知识。本文提出一种基于案例推理增强的大语言模型框架(CBR-LLM),用于复杂风险场景下的避险操作决策。该方法融合行车记录仪视频输入的语义场景理解与相关历史驾驶案例的检索,使LLM生成既具上下文敏感性又符合人类偏好的操作建议。多组实验表明,该框架在多个开源LLM上提升了决策准确性、理由质量及与人类专家行为的一致性。风险感知提示策略进一步增强了对多种风险类型的适应能力,而基于相似性的案例检索始终优于随机采样,有效引导上下文学习。案例研究验证了框架在真实复杂条件下的鲁棒性,凸显其作为自适应、可信决策支持工具在智能驾驶系统中的潜力。

原文摘要 · Abstract (English)

Driving in safety-critical scenarios requires quick, context-aware decision-making grounded in both situational understanding and experiential reasoning. Large Language Models (LLMs), with their powerful general-purpose reasoning capabilities, offer a promising foundation for such decision-making. However, their direct application to autonomous driving remains limited due to challenges in domain adaptation, contextual grounding, and the lack of experiential knowledge needed to make reliable and interpretable decisions in dynamic, high-risk environments. To address this gap, this paper presents a Case-Based Reasoning Augmented Large Language Model (CBR-LLM) framework for evasive maneuver decision-making in complex risk scenarios. Our approach integrates semantic scene understanding from dashcam video inputs with the retrieval of relevant past driving cases, enabling LLMs to generate maneuver recommendations that are both context-sensitive and human-aligned. Experiments across multiple open-source LLMs show that our framework improves decision accuracy, justification quality, and alignment with human expert behavior. Risk-aware prompting strategies further enhance performance across diverse risk types, while similarity-based case retrieval consistently outperforms random sampling in guiding in-context learning. Case studies further demonstrate the framework's robustness in challenging real-world conditions, underscoring its potential as an adaptive and trustworthy decision-support tool for intelligent driving systems.

自动驾驶大模型案例推理决策支持

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。