arXiv:2511.13079cs.CV2025-11AAAI被引 4

解耦环境感知与自身状态,提升端到端自动驾驶泛化能力

Decoupling Scene Perception and Ego Status: A Multi-Context Fusion Approach for Enhanced Generalization in End-to-End Autonomous Driving

  • 双分支结构分离环境与自身状态的推理路径
  • 在nuScenes上实现领先规划性能,减少对自身状态依赖
  • 适合追求鲁棒性与泛化能力的自动驾驶系统研究者

面向规划导向的自动驾驶模块化设计已显著推动端到端系统发展,但现有架构仍过度依赖自身状态,制约泛化能力与场景理解。根源在于上游鸟瞰图(BEV)编码器过早融合自身状态,导致强先验信息主导下游规划模块。为此,我们提出AdaptiveAD,一种基于多上下文融合的架构级解决方案。其核心为双分支结构:一分支通过多任务学习进行纯场景驱动推理,刻意在BEV编码器中移除自身状态;另一分支仅基于规划任务进行自身状态驱动推理。随后,场景感知融合模块自适应整合两分支互补决策,生成最终规划轨迹。为保障多任务学习效果,引入路径注意力机制实现自身状态与BEV交互,并增设两个辅助任务:BEV单向蒸馏与自回归在线建图。在nuScenes数据集上的大量实验表明,AdaptiveAD实现最先进的开环规划性能,关键在于显著降低对自身状态的依赖,并展现出优异的跨场景泛化能力。

原文摘要 · Abstract (English)

Modular design of planning-oriented autonomous driving has markedly advanced end-to-end systems. However, existing architectures remain constrained by an over-reliance on ego status, hindering generalization and robust scene understanding. We identify the root cause as an inherent design within these architectures that allows ego status to be easily leveraged as a shortcut. Specifically, the premature fusion of ego status in the upstream BEV encoder allows an information flow from this strong prior to dominate the downstream planning module. To address this challenge, we propose AdaptiveAD, an architectural-level solution based on a multi-context fusion strategy. Its core is a dual-branch structure that explicitly decouples scene perception and ego status. One branch performs scene-driven reasoning based on multi-task learning, but with ego status deliberately omitted from the BEV encoder, while the other conducts ego-driven reasoning based solely on the planning task. A scene-aware fusion module then adaptively integrates the complementary decisions from the two branches to form the final planning trajectory. To ensure this decoupling does not compromise multi-task learning, we introduce a path attention mechanism for ego-BEV interaction and add two targeted auxiliary tasks: BEV unidirectional distillation and autoregressive online mapping. Extensive evaluations on the nuScenes dataset demonstrate that AdaptiveAD achieves state-of-the-art open-loop planning performance. Crucially, it significantly mitigates the over-reliance on ego status and exhibits impressive generalization capabilities across diverse scenarios.

自动驾驶端到端多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。