arXiv:2409.15727cs.CV2024-09ECCV被引 24

用拉普拉斯混合模型建模形状不确定性,解决无深度时的位姿估计难题

LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation

  • 将每个点表示为概率分布,显式建模形状不确定性
  • 引入无尺度表示,解决仅用图像时的尺度模糊问题
  • 在NOCS数据集上达到当前最佳效果,适合机器人抓取场景

基于RGBD的方法虽有潜力,但依赖深度数据限制了其适用性。现有纯RGB方法因缺乏深度信息面临两大挑战:类内形状差异导致形状预测不确定性增加,以及图像输入引发固有的尺度模糊,使物体大小和位移估计成为病态问题。为此,本文提出LaPose框架,将物体形状建模为拉普拉斯混合模型。通过将每个点表示为概率分布,显式量化形状不确定性。LaPose利用通用3D信息流与专用特征流分别预测各点的拉普拉斯分布,捕捉不同几何特性,再融合为拉普拉斯混合模型以建立2D-3D对应关系,并通过PnP模块求解位姿。为缓解尺度模糊,引入无尺度表示,提升训练效率与整体鲁棒性。在NOCS数据集上的大量实验验证了该方法的有效性,达到当前最优性能。代码已开源。

原文摘要 · Abstract (English)

While RGBD-based methods for category-level object pose estimation hold promise, their reliance on depth data limits their applicability in diverse scenarios. In response, recent efforts have turned to RGB-based methods; however, they face significant challenges stemming from the absence of depth information. On one hand, the lack of depth exacerbates the difficulty in handling intra-class shape variation, resulting in increased uncertainty in shape predictions. On the other hand, RGB-only inputs introduce inherent scale ambiguity, rendering the estimation of object size and translation an ill-posed problem. To tackle these challenges, we propose LaPose, a novel framework that models the object shape as the Laplacian mixture model for Pose estimation. By representing each point as a probabilistic distribution, we explicitly quantify the shape uncertainty. LaPose leverages both a generalized 3D information stream and a specialized feature stream to independently predict the Laplacian distribution for each point, capturing different aspects of object geometry. These two distributions are then integrated as a Laplacian mixture model to establish the 2D-3D correspondences, which are utilized to solve the pose via the PnP module. In order to mitigate scale ambiguity, we introduce a scale-agnostic representation for object size and translation, enhancing training efficiency and overall robustness. Extensive experiments on the NOCS datasets validate the effectiveness of LaPose, yielding state-of-the-art performance in RGB-based category-level object pose estimation. Codes are released at https://github.com/lolrudy/LaPose

位姿估计形状建模无深度拉普拉斯

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。