arXiv:2603.09420cs.CVcs.AI2026-03被引 1

让自动驾驶模型持续学习新交通参与者,不遗忘旧知识。

Class-Incremental Motion Forecasting

  • 用图像直接预测轨迹,通过关键点投票筛选可靠预测
  • 在nuScenes和Argoverse 2上对新类别准确率提升18.7%
  • 适合需要长期迭代更新的自动驾驶系统

运动预测使自动驾驶车辆能够预测动态物体的未来轨迹。然而,现有方法通常假设封闭世界,即对象类别固定且感知质量高,限制了其在真实场景中的应用。本文提出类增量运动预测,新类别随时间逐步引入,直接从摄像头图像预测未来轨迹。我们提出首个端到端框架,在适应新类别时有效缓解灾难性遗忘。该方法为已知类别生成运动预测伪标签,并与开放词汇分割模型的2D实例掩码匹配,通过3D到2D关键点投票机制过滤不一致和过度自信的预测;同时采用基于查询特征方差的重放策略,选择有信息量的历史序列以保留先验知识。在nuScenes和Argoverse 2上的大量实验表明,本方法在保持已知类别性能的同时,有效适应新类别。进一步验证了零样本迁移至真实驾驶场景的可行性,并证明该框架可自然扩展至nuScenes和NeuroNCAP的开环与闭环端到端类增量规划。代码与模型将公开于https://omen.cs.uni-freiburg.de。

原文摘要 · Abstract (English)

Motion forecasting enables autonomous vehicles to anticipate scene evolution by predicting the future trajectories of dynamic agents. However, existing approaches typically assume a closed-world setting with a fixed object taxonomy and access to high-quality perception, limiting their applicability in the real world where perception is imperfect, and new object classes may emerge over time. In this work, we introduce class-incremental motion forecasting, a novel setting in which new object classes are sequentially introduced over time and future object trajectories are predicted directly from camera images. We propose the first end-to-end framework for this setting, which adapts to newly introduced classes while mitigating catastrophic forgetting of previously learned ones. Our method generates motion forecasting pseudo-labels for known classes and matches them with 2D instance masks from an open-vocabulary segmentation model. This 3D-to-2D keypoint voting mechanism filters inconsistent and overconfident predictions, while a query feature variance-based replay strategy samples informative past sequences to preserve prior knowledge. Extensive evaluations on nuScenes and Argoverse 2 show that our approach successfully preserves performance on known classes while effectively adapting to novel ones. We further demonstrate zero-shot transfer to real-world driving and show that the framework extends naturally to open- and closed-loop end-to-end class-incremental planning on nuScenes and NeuroNCAP. Code and models will be made publicly available at https://omen.cs.uni-freiburg.de.

运动预测增量学习自动驾驶视觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。