仅用一张参考图即可精准估计任意物体的6自由度姿态。
One2Any: One-Reference 6D Pose Estimation for Any Object
- 通过单张参考图生成物体姿态嵌入,再解码出新视角下的姿态坐标。
- 在多个数据集上对未知物体实现领先精度,性能媲美需多视图或3D模型的方法。
- 无需物体类别或3D模型先验,适合快速部署于新物体场景。
6D物体姿态估计在许多应用中仍具挑战性,因其通常依赖完整的3D模型、多视角图像或特定类别训练数据,导致难以泛化到无3D模型或多视图数据的新物体。为此,我们提出One2Any方法,仅需单张参考-查询RGB-D图像,即可估计物体相对6自由度姿态,无需事先知道其3D模型、多视角数据或类别信息。我们将姿态估计建模为编码-解码过程:首先从单参考视图中提取包含形状、方向与纹理信息的参考物体姿态嵌入(ROPE);再通过基于U-Net的姿态解码模块生成参考物体坐标(ROC),用于新视角的姿态预测。该框架可基于任意成对姿态数据训练,支持大规模训练并展现卓越可扩展性。在多个基准数据集上的实验表明,模型对新物体具有强泛化能力,在精度与鲁棒性上达到当前最优,且计算开销远低于需多视图或CAD输入的方法。
原文摘要 · Abstract (English)
6D object pose estimation remains challenging for many applications due to dependencies on complete 3D models, multi-view images, or training limited to specific object categories. These requirements make generalization to novel objects difficult for which neither 3D models nor multi-view images may be available. To address this, we propose a novel method One2Any that estimates the relative 6-degrees of freedom (DOF) object pose using only a single reference-single query RGB-D image, without prior knowledge of its 3D model, multi-view data, or category constraints. We treat object pose estimation as an encoding-decoding process, first, we obtain a comprehensive Reference Object Pose Embedding (ROPE) that encodes an object shape, orientation, and texture from a single reference view. Using this embedding, a U-Net-based pose decoding module produces Reference Object Coordinate (ROC) for new views, enabling fast and accurate pose estimation. This simple encoding-decoding framework allows our model to be trained on any pair-wise pose data, enabling large-scale training and demonstrating great scalability. Experiments on multiple benchmark datasets demonstrate that our model generalizes well to novel objects, achieving state-of-the-art accuracy and robustness even rivaling methods that require multi-view or CAD inputs, at a fraction of compute.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。