用大模型指导强化学习,让自动驾驶更可靠高效
TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning
- 大模型生成驾驶策略,强化学习融合探索加速收敛
- 多场景测试中成功率与回报率均优于现有方法
- 适合研究自动驾驶决策与智能系统融合的开发者
尽管深度强化学习(DRL)和大型语言模型(LLMs)在自动驾驶决策中各有潜力,但DRL存在高样本复杂性问题,而LLMs难以保证实时决策。为此,我们提出TeLL-Drive,一种融合教师级LLM与注意力机制学生DRL策略的混合框架。通过将风险度量、历史场景检索和领域启发式信息融入上下文丰富的提示,LLM基于思维链推理生成高层驾驶策略。自注意力机制将这些策略与DRL代理的探索行为融合,加速策略收敛并提升多样驾驶条件下的鲁棒性。实验在多个交通场景下评估显示,TeLL-Drive在成功率、平均回报和实时可行性方面均优于现有基线方法,包括其他基于LLM的方案。消融实验表明各组件至关重要,尤其强调注意力机制与LLM引导之间的协同作用。最后,我们构建了虚实融合实验平台,通过车在环实验验证了算法在真实车辆上的实时性能、鲁棒性和可靠性。
原文摘要 · Abstract (English)
Although Deep Reinforcement Learning (DRL) and Large Language Models (LLMs) each show promise in addressing decision-making challenges in autonomous driving, DRL often suffers from high sample complexity, while LLMs have difficulty ensuring real-time decision making. To address these limitations, we propose TeLL-Drive, a hybrid framework that integrates a Teacher LLM to guide an attention-based Student DRL policy. By incorporating risk metrics, historical scenario retrieval, and domain heuristics into context-rich prompts, the LLM produces high-level driving strategies through chain-of-thought reasoning. A self-attention mechanism then fuses these strategies with the DRL agent's exploration, accelerating policy convergence and boosting robustness across diverse driving conditions. The experimental results, evaluated across multiple traffic scenarios, show that TeLL-Drive outperforms existing baseline methods, including other LLM-based approaches, in terms of success rates, average returns, and real-time feasibility. Ablation studies underscore the importance of each model component, especially the synergy between the attention mechanism and LLM-driven guidance. Finally, we build a virtual-real fusion experimental platform to verify the real-time performance, robustness, and reliability of the algorithm running on real vehicles through vehicle-in-loop experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。