arXiv:2604.13789cs.CV2026-04中稿 · CVPR

解决3D目标追踪长期记忆不一致问题,实现高效实时追踪

Temporally Consistent Long-Term Memory for 3D Single Object Tracking

论文配图:Temporally Consistent Long-Term Memory for 3D Single Object Tracking
图 1 · 摘自论文原文
  • 用可学习记忆令牌构建长期记忆,通过双目标优化特征一致性
  • 在多个基准上达新最优,42帧/秒实现实时运行
  • 适合需要长序列稳定追踪的自动驾驶场景

3D单目标追踪(3D-SOT)旨在给定首帧3D边界框后,对连续激光雷达点云中的目标进行定位。现有方法虽采用记忆机制利用目标历史特征,但仅限于少量近期帧。本文揭示其长期能力受限于严重的时间特征不一致和过高内存开销。为此,提出名为ChronoTrack的鲁棒长时3D-SOT框架,通过紧凑的可学习记忆令牌,在保持时间特征一致性的同时高效聚合多样化目标特征。该框架基于两个互补目标:时间一致性损失强制跨帧特征对齐,缓解时间漂移;记忆循环一致性损失通过记忆-点-记忆循环遍历,促使每个令牌编码序列中多样且区分性强的目标表示。结果表明,ChronoTrack在多个3D-SOT基准上达到新最优性能,以紧凑记忆实现长时建模,单张RTX 4090 GPU下运行速度达42 FPS。

原文摘要 · Abstract (English)

3D Single Object Tracking (3D-SOT) aims to localize a target object across a sequence of LiDAR point clouds, given its 3D bounding box in the first frame. Recent methods have adopted a memory-based approach to utilize previously observed features of the target object, but remain limited to only a few recent frames. This work reveals that their temporal capacity is fundamentally constrained to short-term context due to severe temporal feature inconsistency and excessive memory overhead. To this end, we propose a robust long-term 3D-SOT framework, ChronoTrack, which preserves the temporal feature consistency while efficiently aggregating the diverse target features via long-term memory. Based on a compact set of learnable memory tokens, ChronoTrack leverages long-term information through two complementary objectives: a temporal consistency loss and a memory cycle consistency loss. The former enforces feature alignment across frames, alleviating temporal drift and improving the reliability of proposed long-term memory. In parallel, the latter encourages each token to encode diverse and discriminative target representations observed throughout the sequence via memory-point-memory cyclic walks. As a result, ChronoTrack achieves new state-of-the-art performance on multiple 3D-SOT benchmarks, demonstrating its effectiveness in long-term target modeling with compact memory while running at real-time speed of 42 FPS on a single RTX 4090 GPU. The code is available at https://github.com/ujaejoon/ChronoTrack

3D追踪长时记忆激光雷达实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。