arXiv:2411.03807cs.CVcs.AI2024-11被引 3

无需高质量模型,仅用彩色深度图即可高精度估计物体6D位姿。

GS2Pose: Two-stage 6D Object Pose Estimation Guided by Gaussian Splatting

  • 两阶段框架:先粗估再精调,利用3D高斯溅射重建结果。
  • 在LineMod数据集上优于同类方法,对光照变化和遮挡鲁棒。
  • 适合无完整CAD模型的工业场景或实时应用。

本文提出一种名为GS2Pose的新方法,用于精确且鲁棒地估计新物体的6D位姿。通过引入3D高斯溅射(3DGS),该方法可直接利用重建结果,无需高质量的CAD模型,仅需分割后的RGBD图像作为输入。整体采用两阶段结构:第一阶段为粗估计,设计轻量级带极化注意力机制的U-Net网络Pose-Net,基于3DGS模型进行监督训练,生成NOCS图像以计算粗略位姿;第二阶段为精调,提出基于重投影或束调整思想的GS-Refiner算法。通过李代数扩展3DGS,构建可微渲染流程,将输入图像与渲染图像对比,迭代优化位姿。同时,GS-Refiner选择性更新3DGS参数,实现环境自适应,增强对光照变化、遮挡等挑战因素的鲁棒性。在LineMod数据集上的实验表明,其性能优于现有方法。代码即将开源。

原文摘要 · Abstract (English)

This paper proposes a new method for accurate and robust 6D pose estimation of novel objects, named GS2Pose. By introducing 3D Gaussian splatting, GS2Pose can utilize the reconstruction results without requiring a high-quality CAD model, which means it only requires segmented RGBD images as input. Specifically, GS2Pose employs a two-stage structure consisting of coarse estimation followed by refined estimation. In the coarse stage, a lightweight U-Net network with a polarization attention mechanism, called Pose-Net, is designed. By using the 3DGS model for supervised training, Pose-Net can generate NOCS images to compute a coarse pose. In the refinement stage, GS2Pose formulates a pose regression algorithm following the idea of reprojection or Bundle Adjustment (BA), referred to as GS-Refiner. By leveraging Lie algebra to extend 3DGS, GS-Refiner obtains a pose-differentiable rendering pipeline that refines the coarse pose by comparing the input images with the rendered images. GS-Refiner also selectively updates parameters in the 3DGS model to achieve environmental adaptation, thereby enhancing the algorithm's robustness and flexibility to illuminative variation, occlusion, and other challenging disruptive factors. GS2Pose was evaluated through experiments conducted on the LineMod dataset, where it was compared with similar algorithms, yielding highly competitive results. The code for GS2Pose will soon be released on GitHub.

6D位姿估计3D高斯溅射两阶段鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。