用置信区间保障大模型自动驾驶路径安全,降低70%碰撞率
SafePath: Conformal Prediction for Safe LLM-Based Autonomous Navigation
- 通过置信预测筛选路径,确保至少一条安全
- 在nuScenes和Highway-env上碰撞率降70%,不确定性降77%
- 可调节人工接管比例,兼顾自主与安全
大型语言模型(LLMs)在复杂交通场景中推理生成路径规划展现出巨大潜力,但其过度自信和幻觉问题带来严重安全风险。本文提出SafePath,一个基于置信预测的模块化框架,为基于LLM的路径规划提供形式化安全保证。该框架分三阶段:首先,利用LLM生成多样化候选路径;其次,通过多选问答形式融合置信预测,过滤高风险轨迹,同时以用户设定概率保证至少存在一条安全路径;最后,在不确定性低时选择预期碰撞风险最低路径,在不确定性高时交由人类接管。理论证明了安全路径的保障概率可调。在nuScenes和Highway-env上的实验表明,SafePath将规划不确定性降低77%,碰撞率最高降低70%,显著提升了基于LLM的路径规划安全性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) show growing promise in autonomous driving by reasoning over complex traffic scenarios to generate path plans. However, their tendencies toward overconfidence, and hallucinations raise critical safety concerns. We introduce SafePath, a modular framework that augments LLM-based path planning with formal safety guarantees using conformal prediction. SafePath operates in three stages. In the first stage, we use an LLM that generates a set of diverse candidate paths, exploring possible trajectories based on agent behaviors and environmental cues. In the second stage, SafePath filters out high-risk trajectories while guaranteeing that at least one safe option is included with a user-defined probability, through a multiple-choice question-answering formulation that integrates conformal prediction. In the final stage, our approach selects the path with the lowest expected collision risk when uncertainty is low or delegates control to a human when uncertainty is high. We theoretically prove that SafePath guarantees a safe trajectory with a user-defined probability, and we show how its human delegation rate can be tuned to balance autonomy and safety. Extensive experiments on nuScenes and Highway-env show that SafePath reduces planning uncertainty by 77\% and collision rates by up to 70\%, demonstrating effectiveness in making LLM-driven path planning more safer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。