arXiv:2512.23635cs.CV2025-12AAAI被引 3

提出自适应时空对齐模块,提升自动驾驶3D感知的时序建模能力。

Rethinking the Spatio-Temporal Alignment of End-to-End 3D Perception

  • 通过多运动模型生成候选对齐方案,由对象自适应选择最优解。
  • 在nuScenes上使跟踪指标AMOTA达46.0%,碰撞率降低32%。
  • 适合需要鲁棒时序建模的端到端自动驾驶系统使用。

时空对齐对于自动驾驶中端到端感知的时序建模至关重要,能提供有价值的结构与纹理先验信息。现有方法通常依赖注意力机制进行跨帧对齐,简化运动模型为统一显式物理模型(如恒定速度)。这些方法偏好使用语义特征实现隐式对齐,弱化了传统感知范式中显式运动建模的重要性。然而,不同类别与帧间运动状态和对象特征的差异导致对齐效果不佳。为此,我们提出HAT,一个允许每个对象从多个假设中自适应解码最优对齐方案的时空对齐模块,无需直接监督。HAT首先利用多个显式运动模型生成空间锚点和运动感知特征提案;随后结合缓存对象查询中的语义与运动线索,进行多假设解码,最终输出目标帧的最优对齐方案。在nuScenes数据集上,HAT持续提升多种3D时序检测器与追踪器性能。与DETR3D检测器结合时,其在测试集上达到46.0% AMOTA的最先进追踪结果。在以对象为中心的端到端自动驾驶方法中,HAT使感知准确率提升1.3% mAP、AMOTA提升3.1%,碰撞率下降32%。当语义受损(nuScenes-C)时,HAT增强的运动建模能力使感知与规划更具鲁棒性。

原文摘要 · Abstract (English)

Spatio-temporal alignment is crucial for temporal modeling of end-to-end (E2E) perception in autonomous driving (AD), providing valuable structural and textural prior information. Existing methods typically rely on the attention mechanism to align objects across frames, simplifying the motion model with a unified explicit physical model (constant velocity, etc.). These approaches prefer semantic features for implicit alignment, challenging the importance of explicit motion modeling in the traditional perception paradigm. However, variations in motion states and object features across categories and frames render this alignment suboptimal. To address this, we propose HAT, a spatio-temporal alignment module that allows each object to adaptively decode the optimal alignment proposal from multiple hypotheses without direct supervision. Specifically, HAT first utilizes multiple explicit motion models to generate spatial anchors and motion-aware feature proposals for historical instances. It then performs multi-hypothesis decoding by incorporating semantic and motion cues embedded in cached object queries, ultimately providing the optimal alignment proposal for the target frame. On nuScenes, HAT consistently improves 3D temporal detectors and trackers across diverse baselines. It achieves state-of-the-art tracking results with 46.0% AMOTA on the test set when paired with the DETR3D detector. In an object-centric E2E AD method, HAT enhances perception accuracy (+1.3% mAP, +3.1% AMOTA) and reduces the collision rate by 32%. When semantics are corrupted (nuScenes-C), the enhancement of motion modeling by HAT enables more robust perception and planning in the E2E AD.

3D感知时空对齐自动驾驶端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。