用视觉语言模型直接预测驾驶路径,性能提升超30%
Less is More: Lean yet Powerful Vision-Language Model for Autonomous Driving
- 将驾驶规划转为单阶段语言模型生成任务
- nuScenes上性能比基线提升30%以上
- 适合研究端到端自动驾驶与多车适配
本文将自动驾驶重新定义为广义语言问题,将轨迹规划任务建模为下一步目标点预测。提出Max-V1框架,一种单阶段端到端自动驾驶新方法,致敬著名荷兰赛车手马克斯·维斯塔潘。该框架采用单次生成范式,契合驾驶的序列特性,利用视觉语言模型(VLM)的生成能力,直接从前视摄像头输入生成完整轨迹。其有效性基于源自统计建模的合理监督策略,提供明确学习目标,使模型能通过大规模专家演示的模仿学习高效掌握复杂驾驶策略。实证结果显示,在nuScenes数据集上,本方法整体性能超越先前基线超过30%。此外,该方法在不同车辆采集的跨域数据集上表现出优异泛化能力,展现出显著的跨车辆鲁棒性与适应性。凭借这些实证优势,本工作构建了支持基础驾驶行为的模型,为更强大自动驾驶智能体的发展奠定基础。代码将在发表后公开。
原文摘要 · Abstract (English)
In this work, we reconceptualize autonomous driving as a generalized language problem and formulate the trajectory planning task as next waypoint prediction. We introduce Max-V1, a novel framework for one-stage end-to-end autonomous driving, named in tribute to the renowned Dutch racing driver Max Verstappen. Our framework presents a single-pass generation paradigm that aligns with the inherent sequentiality of driving. This approach leverages the generative capacity of the Vision-Language Model (VLM) to enable end-to-end trajectory prediction directly from front-view camera input. The efficacy of this method is underpinned by a principled supervision strategy derived from statistical modeling. This provides a well-defined learning objective, which makes the framework highly amenable to mastering complex driving policies through imitation learning from large-scale expert demonstrations. Empirically, our method achieves state-of-the-art performance on the nuScenes dataset, delivering an overall improvement of over 30% compared to prior baselines. Furthermore, it exhibits superior generalization performance on cross-domain datasets acquired from diverse vehicles, demonstrating notable potential for cross-vehicle robustness and adaptability. With these empirical strengths, this work introduces a model that enables fundamental driving behaviors, laying the foundation for the development of more capable self-driving agents. Code will be available upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。