用平面引导的高斯点云重建,提升无纹理物体6D位姿估计精度
Generalizable 6D Pose Estimation of Textureless Objects with Planar-based Gaussian Splatting

- 基于平面先验构建高斯点云,增强几何约束
- 在低纹理数据集上达到94.2%的平均精度,优于最新方法2.1%
- 适用于工业机器人抓取,支持未见过的无纹理物体
无纹理物体的6D位姿估计在缺乏先验CAD模型的情况下仍具挑战性。现有通用方法因底层表征中几何约束不足,对低纹理物体表现受限。本文提出PG-Pose,结合平面引导的高斯点云重建(PGS)与几何驱动的位姿优化。离线阶段,从多视角参考图像中提取三种物体表征:重建3D高斯表示并生成高保真深度图,通过反投影生成3D点云;在线推理阶段,通过输入图像与点云的2D-3D对应匹配获取初始位姿,并使用PGS-Refiner进行迭代优化。在OnePose-LowTexture数据集上,平均精度达94.2% ADD(S)@0.1d,比当前最优的基于高斯的SOTA方法提升2.1%。进一步在双臂工业机器人上部署,成功完成对未见物体的抓取任务。
原文摘要 · Abstract (English)
Estimating the 6D pose of textureless objects without prior CAD models remains a critical challenge due to the lack of appearance features. While recent generalizable approaches alleviate the dependence on object-specific models, their performance on low-texture objects is often limited by insufficient geometric constraints in the underlying representations. In this work, we propose PG-Pose, a geometry-aware framework combining Planar-based Gaussian Splatting (PGS) reconstruction and Geometry-driven pose optimization. In the offline representation extraction stage, three distinct representations of the object are extracted from multi-view reference RGB images with known poses. PG-Pose reconstructs a 3D Gaussian representation and renders high-fidelity depth maps to generate 3D point clouds through back projection. In the online pose inference stage, the initial pose of the input image is estimated by 2D-3D correspondence matching between the input image and the reconstructed 3D point clouds, followed by a PGS-Refiner for iterative pose optimization. Evaluations on the OnePose-LowTexture datasets, PG-Pose achieves an average accuracy of 94.2% ADD(S)@0.1d, with a 2.1% improvement average accuracy compared with the state-of-the-art (SOTA) GS-based approach. To further demonstrate the effectiveness of PG-Pose for industrial robots in grasping tasks, we deploy it on a dual-arm industrial robot and successfully realize the grasping task on an unseen object.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。