用不确定性感知提升部分参考下的6D姿态估计与在线补全效果
UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial References
- 基于部分参考图像构建带不确定性的不完整3D模型
- 在YCB-Video等数据集上显著优于现有方法,尤其在观测不全时
- 适合机器人抓取、视觉导航等需处理不完整物体的场景
6D物体姿态估计在新物体上表现出强泛化能力,但现有方法通常需要完整的3D模型或大量覆盖物体的参考图像。从部分参考(仅捕捉物体外观和几何的片段)中估计6D姿态仍具挑战。为此,我们提出UA-Pose,一种专为部分参考设计的不确定性感知6D姿态估计与在线物体补全方法。假设可获得有限数量的已知姿态的RGBD图像,或单张2D图像。第一种情况,基于图像和姿态初始化部分3D模型;第二种情况,使用image-to-3D技术生成初始3D模型。方法将不确定性融入不完整3D模型,区分可见与不可见区域,实现姿态估计置信度评估,并指导不确定性感知采样策略进行在线补全,从而提升姿态估计精度与物体完整性。在YCB-Video、YCBInEOAT和HO3D数据集上评估,包含机器人与人手操作的YCB物体的RGBD序列。实验表明,在物体观测不全或部分捕获时,性能显著优于现有方法。
原文摘要 · Abstract (English)
6D object pose estimation has shown strong generalizability to novel objects. However, existing methods often require either a complete, well-reconstructed 3D model or numerous reference images that fully cover the object. Estimating 6D poses from partial references, which capture only fragments of an object's appearance and geometry, remains challenging. To address this, we propose UA-Pose, an uncertainty-aware approach for 6D object pose estimation and online object completion specifically designed for partial references. We assume access to either (1) a limited set of RGBD images with known poses or (2) a single 2D image. For the first case, we initialize a partial object 3D model based on the provided images and poses, while for the second, we use image-to-3D techniques to generate an initial object 3D model. Our method integrates uncertainty into the incomplete 3D model, distinguishing between seen and unseen regions. This uncertainty enables confidence assessment in pose estimation and guides an uncertainty-aware sampling strategy for online object completion, enhancing robustness in pose estimation accuracy and improving object completeness. We evaluate our method on the YCB-Video, YCBInEOAT, and HO3D datasets, including RGBD sequences of YCB objects manipulated by robots and human hands. Experimental results demonstrate significant performance improvements over existing methods, particularly when object observations are incomplete or partially captured. Project page: https://minfenli.github.io/UA-Pose/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。