arXiv:2511.01334cs.ROcs.AI2025-11NeurIPS被引 2

用脑电数据增强自动驾驶决策,让模型学人类驾驶思维。

Embodied Cognition Augmented End2End Autonomous Driving

  • 对比视觉网络与脑电大模型,挖掘人类驾驶认知
  • 在公开数据集上显著提升基线模型的规划性能
  • 首个将脑认知数据用于端到端自动驾驶的研究

近年来,基于视觉的端到端自动驾驶成为新范式。然而,主流方法依赖标签监督下的视觉特征提取网络,限制了模型的泛化能力。本文提出新型范式E³AD,通过对比视觉特征提取网络与通用脑电大模型,学习潜在的人类驾驶认知以增强端到端规划。研究收集了用于对比学习的认知数据集,并在公开自动驾驶数据集上,以主流驾驶模型为基线,探究利用人类驾驶认知提升规划性能的方法与机制。通过开环与闭环测试进行综合评估。实验结果表明,E³AD显著提升基线模型的规划表现;消融实验证实了驾驶认知和对比学习过程的有效性。据我们所知,这是首个将人类驾驶认知引入端到端自动驾驶规划的工作,首次尝试将具身认知数据融入端到端自动驾驶系统,为未来类脑自动驾驶提供了重要启示。代码将开源于GitHub。

原文摘要 · Abstract (English)

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision framework restricts the generality and applicability of driving models. In this paper, we propose a novel paradigm termed $E^{3}AD$, which advocates for comparative learning between visual feature extraction networks and the general EEG large model, in order to learn latent human driving cognition for enhancing end-to-end planning. In this work, we collected a cognitive dataset for the mentioned contrastive learning process. Subsequently, we investigated the methods and potential mechanisms for enhancing end-to-end planning with human driving cognition, using popular driving models as baselines on publicly available autonomous driving datasets. Both open-loop and closed-loop tests are conducted for a comprehensive evaluation of planning performance. Experimental results demonstrate that the $E^{3}AD$ paradigm significantly enhances the end-to-end planning performance of baseline models. Ablation studies further validate the contribution of driving cognition and the effectiveness of comparative learning process. To the best of our knowledge, this is the first work to integrate human driving cognition for improving end-to-end autonomous driving planning. It represents an initial attempt to incorporate embodied cognitive data into end-to-end autonomous driving, providing valuable insights for future brain-inspired autonomous driving systems. Our code will be made available at Github

自动驾驶具身认知脑机接口端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。