arXiv:2509.11090cs.CV2025-09被引 3

让停车控制信号指导视觉注意力,提升端到端泊车的精准与鲁棒性。

End-to-End Visual Autonomous Parking via Control-Aided Attention

  • 用控制信号反向引导视觉注意力,聚焦影响动作的关键视觉特征。
  • 在CARLA仿真中超越基线模型,实现更高精度与更稳定控制。
  • 适合研究端到端自动驾驶、视觉注意力机制的开发者与工程师。

精确泊车需要一个端到端系统,使感知能自适应地提供对决策关键的细节,尤其是在需要精细控制的区域。端到端学习通过直接将传感器输入映射为控制动作,提供统一框架,但现有方法缺乏感知与控制的有效协同。为此,我们提出CAA-Policy,一种基于模仿学习的端到端系统,利用新型控制辅助注意力(CAA)机制,使控制信号引导视觉注意力的学习。该注意力模块通过控制输出的反向传播梯度进行自监督训练,而非依赖训练损失,促使注意力关注引发动作高方差的视觉特征,而非仅最小化损失——这一策略显著提升了策略的鲁棒性与泛化能力。为进一步增强框架,CAA-Policy引入短时程航点预测作为辅助任务以提升控制输出的时间一致性,采用可学习运动预测模块以鲁棒追踪目标车位,以及改进的目标标记化方案以实现更有效的特征融合。大量实验表明,在CARLA模拟器中,CAA-Policy持续优于端到端学习基线和模块化BEV分割+混合A*流水线,展现出更优的准确性、鲁棒性和可解释性。代码与训练数据集将公开,详见https://github.com/ai4ce/CAAPolicy。

原文摘要 · Abstract (English)

Precise parking requires an end-to-end system where perception adaptively provides policy-relevant details - especially in critical areas where fine control decisions are essential. End-to-end learning offers a unified framework by directly mapping sensor inputs to control actions, but existing approaches lack effective synergy between perception and control. Instead, we propose CAA-Policy, an end-to-end imitation learning system that allows control signal to guide the learning of visual attention via a novel Control-Aided Attention (CAA) mechanism. We train such an attention module in a self-supervised manner, using backpropagated gradients from the control outputs instead of from the training loss. This strategy encourages attention to focus on visual features that induce high variance in action outputs, rather than merely minimizing the training loss - a shift we demonstrate leads to a more robust and generalizable policy. To further strengthen the framework, CAA-Policy incorporates short-horizon waypoint prediction as an auxiliary task to improve temporal consistency of control outputs, a learnable motion prediction module to robustly track target slots over time, and a modified target tokenization scheme for more effective feature fusion. Extensive experiments in the CARLA simulator show that CAA-Policy consistently surpasses both the end-to-end learning baseline and the modular BEV segmentation + hybrid A* pipeline, achieving superior accuracy, robustness, and interpretability. Code and Collected Training datasets will be released. Code is released at https://github.com/ai4ce/CAAPolicy.

端到端视觉注意力自动驾驶模仿学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。