提出双系统框架,让自动驾驶像人一样快慢结合决策。
FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedback
- 快系统实时规划路径,慢系统处理复杂场景推理
- 在nuScenes新基准上达当前最优,提升罕见场景应对能力
- 适合追求安全与人性化的自动驾驶研发团队
确保自动驾驶系统安全、舒适且高效导航是关键目标。尽管基于大规模数据集训练的端到端模型在常见驾驶场景中表现优异,但在罕见的长尾事件中仍显不足。近年来大语言模型(LLMs)的发展带来了更强的推理能力,但其计算开销限制了实时决策与精确规划。本文提出FASIONAD,一种受‘快思考与慢思考’认知模型启发的双系统框架:快系统通过快速数据驱动路径规划处理常规任务,慢系统则聚焦于复杂或陌生情境下的深度推理与决策。基于评分分布与反馈的动态切换机制实现两系统无缝转换。快系统生成的视觉提示使慢系统具备类人推理能力,并反向提供高质量反馈以优化快系统决策。为评估FASIONAD,我们基于nuScenes数据集构建新基准,专门区分快慢场景。FASIONAD在此基准上达到当前最优性能,确立了融合快慢认知过程的自动驾驶框架新标准,为更自适应、类人的自动驾驶系统铺平道路。
原文摘要 · Abstract (English)
Ensuring safe, comfortable, and efficient navigation is a critical goal for autonomous driving systems. While end-to-end models trained on large-scale datasets excel in common driving scenarios, they often struggle with rare, long-tail events. Recent progress in large language models (LLMs) has introduced enhanced reasoning capabilities, but their computational demands pose challenges for real-time decision-making and precise planning. This paper presents FASIONAD, a novel dual-system framework inspired by the cognitive model "Thinking, Fast and Slow." The fast system handles routine navigation tasks using rapid, data-driven path planning, while the slow system focuses on complex reasoning and decision-making in challenging or unfamiliar situations. A dynamic switching mechanism based on score distribution and feedback allows seamless transitions between the two systems. Visual prompts generated by the fast system enable human-like reasoning in the slow system, which provides high-quality feedback to enhance the fast system's decision-making. To evaluate FASIONAD, we introduce a new benchmark derived from the nuScenes dataset, specifically designed to differentiate fast and slow scenarios. FASIONAD achieves state-of-the-art performance on this benchmark, establishing a new standard for frameworks integrating fast and slow cognitive processes in autonomous driving. This approach paves the way for more adaptive, human-like autonomous driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。