arXiv:2412.01543cs.CVcs.RO2024-12ICCV被引 11

用高斯点阵实现快速6自由度物体姿态估计,实时追踪更准更快。

6DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting

  • 基于高斯点阵的可微渲染,边重建边优化姿态。
  • 在HO3D和YCBInEOAT上达到顶尖性能,速度提升5倍。
  • 适合真实场景下的动态物体实时跟踪与重建。

高效准确的物体姿态估计是增强现实、自动驾驶和机器人等领域的重要技术。尽管基于模型的方法已取得良好效果,但无模型方法在实时RGB-D视频流中因渲染与姿态推断计算量大而受限。为此,我们提出6DOPE-GS,一种仅使用单个RGB-D相机的在线6自由度物体姿态估计与跟踪新方法,充分利用高斯点阵的快速可微渲染优势。该方法能同时优化6自由度物体姿态与3D重建结果。为实现实时性与准确性,采用增量式2D高斯点阵与智能动态关键帧选择策略,提升空间覆盖并避免错误姿态更新;同时提出基于透明度统计的剪枝机制,自适应控制高斯密度,保障训练稳定与效率。在HO3D与YCBInEOAT数据集上的实验表明,6DOPE-GS在无模型的同时6自由度姿态跟踪与重建任务中表现媲美最先进基线,且速度提升5倍。进一步验证了其在真实动态场景中的适用性。

原文摘要 · Abstract (English)

Efficient and accurate object pose estimation is an essential component for modern vision systems in many applications such as Augmented Reality, autonomous driving, and robotics. While research in model-based 6D object pose estimation has delivered promising results, model-free methods are hindered by the high computational load in rendering and inferring consistent poses of arbitrary objects in a live RGB-D video stream. To address this issue, we present 6DOPE-GS, a novel method for online 6D object pose estimation \& tracking with a single RGB-D camera by effectively leveraging advances in Gaussian Splatting. Thanks to the fast differentiable rendering capabilities of Gaussian Splatting, 6DOPE-GS can simultaneously optimize for 6D object poses and 3D object reconstruction. To achieve the necessary efficiency and accuracy for live tracking, our method uses incremental 2D Gaussian Splatting with an intelligent dynamic keyframe selection procedure to achieve high spatial object coverage and prevent erroneous pose updates. We also propose an opacity statistic-based pruning mechanism for adaptive Gaussian density control, to ensure training stability and efficiency. We evaluate our method on the HO3D and YCBInEOAT datasets and show that 6DOPE-GS matches the performance of state-of-the-art baselines for model-free simultaneous 6D pose tracking and reconstruction while providing a 5$\times$ speedup. We also demonstrate the method's suitability for live, dynamic object tracking and reconstruction in a real-world setting.

6D姿态估计高斯点阵实时跟踪三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。