首个端到端点云序列长期运动估计框架,解决动态变化下的运动一致性问题。
PCSTracker: Long-Term Scene Flow Estimation for Point Cloud Sequences
- 通过联合优化几何与运动,缓解动态变化导致的匹配不一致。
- 在真实和合成数据集上达到最高精度,实时运行速度达32.5 FPS。
- 适合需要长期稳定3D运动分析的自动驾驶与机器人场景。
点云场景流估计是实现长期精细三维运动分析的基础。然而,现有方法多局限于成对设置,在序列较长时因几何变化、遮挡出现及误差累积难以保持时间一致性。本文提出PCSTracker,首个专为点云序列设计的端到端一致性场景流估计框架。提出迭代几何运动联合优化模块(IGMO),显式建模点特征随时间演化,缓解动态几何变化引起的对应不一致。引入时空点轨迹更新模块(STTU),利用广泛的时间上下文推断被遮挡点的合理位置,保障运动估计连贯性。为应对长序列,采用重叠滑动窗口推理策略,交替进行跨窗传播与窗内精炼,有效抑制误差累积,维持长期运动一致性。在合成数据集PointOdyssey3D和真实数据集ADT3D上的大量实验表明,PCSTracker在长期场景流估计中精度最优,实时性能达32.5 FPS,且相比基于RGB-D的方法展现出更优的3D运动理解能力。
原文摘要 · Abstract (English)
Point cloud scene flow estimation is fundamental to long-term and fine-grained 3D motion analysis. However, existing methods are typically limited to pairwise settings and struggle to maintain temporal consistency over long sequences as geometry evolves, occlusions emerge, and errors accumulate. In this work, we propose PCSTracker, the first end-to-end framework specifically designed for consistent scene flow estimation in point cloud sequences. Specifically, we introduce an iterative geometry motion joint optimization module (IGMO) that explicitly models the temporal evolution of point features to alleviate correspondence inconsistencies caused by dynamic geometric changes. In addition, a spatio-temporal point trajectory update module (STTU) is proposed to leverage broad temporal context to infer plausible positions for occluded points, ensuring coherent motion estimation. To further handle long sequences, we employ an overlapping sliding-window inference strategy that alternates cross-window propagation and in-window refinement, effectively suppressing error accumulation and maintaining stable long-term motion consistency. Extensive experiments on the synthetic PointOdyssey3D and real-world ADT3D datasets show that PCSTracker achieves the best accuracy in long-term scene flow estimation and maintains real-time performance at 32.5 FPS, while demonstrating superior 3D motion understanding compared to RGB-D-based approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。