用大模型理解用户指令,结合强化学习实现个性化安全驾驶。
Towards Human-Centric Autonomous Driving: A Fast-Slow Architecture Integrating Large Language Model Guidance with Reinforcement Learning
- 大模型解析指令作决策,强化学习实时控制车辆
- 碰撞率降低,驾驶行为更贴合用户偏好
- 适合追求个性与安全并重的智能驾驶场景
自动驾驶虽在标准任务中表现稳健,但常忽视用户个性化需求,缺乏交互与适应能力。为此,我们提出一种“快-慢”决策架构:大语言模型(LLM)作为“慢”模块,将用户指令转化为结构化引导;强化学习(RL)代理作为“快”模块,在严格延迟约束下执行实时操控。通过解耦高层决策与底层控制,该框架在保障安全的前提下实现个性化驾驶。多场景实验表明,相比基线算法,本方法不仅降低碰撞率,还使驾驶行为更贴近用户偏好,有效弥合个体需求与复杂交通环境下的安全可靠驾驶之间的差距。
原文摘要 · Abstract (English)
Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for interaction and adaptation with users. To address these challenges, we propose a "fast-slow" decision-making framework that integrates a Large Language Model (LLM) for high-level instruction parsing with a Reinforcement Learning (RL) agent for low-level real-time decision. In this dual system, the LLM operates as the "slow" module, translating user directives into structured guidance, while the RL agent functions as the "fast" module, making time-critical maneuvers under stringent latency constraints. By decoupling high-level decision making from rapid control, our framework enables personalized user-centric operation while maintaining robust safety margins. Experimental evaluations across various driving scenarios demonstrate the effectiveness of our method. Compared to baseline algorithms, the proposed architecture not only reduces collision rates but also aligns driving behaviors more closely with user preferences, thereby achieving a human-centric mode. By integrating user guidance at the decision level and refining it with real-time control, our framework bridges the gap between individual passenger needs and the rigor required for safe, reliable driving in complex traffic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。