用分层规划让大模型推理与实时控制高效协同,提升自动驾驶鲁棒性。
Bridging Large-Model Reasoning and Real-Time Control via Agentic Fast-Slow Planning
- 构建快慢结合的分层框架,分离感知、决策、规划与控制环节
- 实验显示横向偏差降低45%,任务完成时间缩短12%以上
- 适合需要高可靠性的自动驾驶系统研发与算法验证
大型基础模型虽能实现强大推理,但将语义意图映射为可靠实时控制仍具挑战。现有方法或由大语言模型直接生成轨迹(脆弱、难验证、延迟高),或在线调整模型预测控制(MPC)目标(慢思考与快控制混杂,接口模糊)。本文提出代理式快-慢规划(Agentic Fast-Slow Planning)框架,通过自然时间尺度解耦感知、推理、规划与控制。该框架包含两个桥梁:Perception2Decision 利用车载视觉-语言模型检测器压缩场景为本体中心拓扑,并由云端大模型决策器转化为符号化驾驶指令,降低带宽与延迟同时保持可解释性;Decision2Trajectory 将指令转为可执行路径:语义引导A*将语言生成的软成本嵌入经典搜索以偏向可行轨迹,代理优化模块则基于反馈与记忆动态调整规划超参。最终由MPC实时跟踪轨迹,复杂情况可选云端引导参考。在CARLA上的实验表明,该方法在扰动下显著提升鲁棒性,横向偏差最高降低45%,任务完成时间缩短超过12%。代码已开源。
原文摘要 · Abstract (English)
Large foundation models enable powerful reasoning for autonomous systems, but mapping semantic intent to reliable real-time control remains challenging. Existing approaches either (i) let Large Language Models (LLMs) generate trajectories directly - brittle, hard to verify, and latency-prone - or (ii) adjust Model Predictive Control (MPC) objectives online - mixing slow deliberation with fast control and blurring interfaces. We propose Agentic Fast-Slow Planning, a hierarchical framework that decouples perception, reasoning, planning, and control across natural timescales. The framework contains two bridges. Perception2Decision compresses scenes into ego-centric topologies using an on-vehicle Vision-Language Model (VLM) detector, then maps them to symbolic driving directives in the cloud with an LLM decision maker - reducing bandwidth and delay while preserving interpretability. Decision2Trajectory converts directives into executable paths: Semantic-Guided A* embeds language-derived soft costs into classical search to bias solutions toward feasible trajectories, while an Agentic Refinement Module adapts planner hyperparameters using feedback and memory. Finally, MPC tracks the trajectories in real time, with optional cloud-guided references for difficult cases. Experiments in CARLA show that Agentic Fast-Slow Planning improves robustness under perturbations, reducing lateral deviation by up to 45% and completion time by over 12% compared to pure MPC and an A*-guided MPC baseline. Code is available at https://github.com/cjychenjiayi/icra2026_AFSP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。