arXiv:2605.16922cs.CV2026-05

用图像点追踪提供稠密运动线索,提升激光雷达场景流估计精度

Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation

论文配图:Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation
图 1 · 摘自论文原文
  • 通过图像空间点追踪获取稠密运动轨迹,替代稀疏几何观测
  • 动态标签精确度与F1分数显著提升,带动自监督场景流性能优化
  • 适合自动驾驶中需高精度动态物体感知的场景流任务

激光雷达场景流估计对自动驾驶至关重要,可为每个点提供三维运动信息。自监督方法利用静态-动态分类缓解静态与动态点之间的不平衡,获得针对性监督。然而,现有方法依赖稀疏几何观测进行分类,易受数据稀疏和遮挡影响,导致标签噪声,进而误导运动学习。为此,我们提出TrackCue框架,利用点追踪生成锚定于激光雷达点的稠密图像空间轨迹,提供超越稀疏几何观测的运动线索。进一步设计视觉一致运动补偿策略,将追踪轨迹与自身运动引起的刚性轨迹在图像平面比较,有效分离真实物体运动与自身运动带来的表观运动。通过视觉运动线索提升,将补偿后的图像轨迹关联至激光雷达点,实现静态-动态标签精炼。实验表明,TrackCue显著提升动态标签的精确率与F1分数,推动自监督场景流估计性能提升。

原文摘要 · Abstract (English)

LiDAR scene flow estimation is essential for autonomous driving, as it provides 3D motion for each point. Self-supervised approaches use static-dynamic classification to mitigate the imbalance between static and dynamic points, deriving targeted supervision. However, existing methods rely on sparse geometric observations for this classification, making them vulnerable to data sparsity and occlusions. The resulting noisy labels provide incorrect motion guidance and degrade scene flow learning. To address this, we introduce TrackCue, a tracking-guided framework for improving dynamic object representation in LiDAR scene flow estimation. In particular, TrackCue repurposes point tracking to obtain dense image-space trajectories anchored to LiDAR points, providing motion cues beyond sparse geometric observations. Furthermore, we present a visually consistent motion compensation strategy that compares the tracked trajectories with ego-induced rigid trajectories in the image plane, effectively isolating true object motion from ego-induced apparent motion. To transfer these isolated motion cues back to the LiDAR domain, we perform visual motion cue lifting, which associates ego-compensated image trajectories with LiDAR points for static-dynamic label refinement. As a result, TrackCue produces more accurate static-dynamic classification and provides more reliable supervision for scene flow learning. Experimental results show that TrackCue significantly improves the precision and F1 score of dynamic labels, leading to performance gains in self-supervised scene flow estimation.

场景流点追踪自动驾驶自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。