无需参考图和匹配,单张图直接推6维姿态,靠扩散模型生成物体轴向。
AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation
- 用扩散模型学习物体轴向潜在分布,直接生成三轴方向
- 单视图输入下跨实例泛化,无需多视角或3D模型
- 不依赖特征匹配,适合未见过的新物体,适合机器人等场景
6D物体姿态估计在机器人、增强现实和自动驾驶中至关重要。现有方法多需多阶段回归或2D-3D特征匹配,依赖外观信息,需复杂输入(如多视图参考、深度图或CAD模型)和繁琐流程(特征提取-SfM-2D到3D匹配-PnP)。我们提出AxisPose,一种无模型、无匹配、单次推理的6D姿态估计方法,彻底脱离传统范式。不同于依赖SfM、PnP等2D-3D或2D-2D匹配的方法,AxisPose通过扩散模型直接从单张图像推断鲁棒6D姿态,无需参考视图。具体地,构建轴生成模块(AGM)利用扩散模型捕捉物体轴的潜在几何分布;扩散过程通过注入几何一致性损失梯度引导噪声估计,以保持生成三轴的几何一致性。结合三轴投影,进一步设计三轴反投影模块(TBM)恢复6D姿态。该方法仅需单视图输入,在跨实例层面(一个模型适用于多个物体)表现稳健,具备良好的未见物体泛化潜力。
原文摘要 · Abstract (English)
Object pose estimation, which plays a vital role in robotics, augmented reality, and autonomous driving, has been of great interest in computer vision. Existing studies either require multi-stage pose regression or rely on 2D-3D feature matching. Though these approaches have shown promising results, they rely heavily on appearance information, requiring complex input (i.e., multi-view reference input, depth, or CAD models) and intricate pipeline (i.e., feature extraction-SfM-2D to 3D matching-PnP). We propose AxisPose, a model-free, matching-free, single-shot solution for robust 6D pose estimation, which fundamentally diverges from the existing paradigm. Unlike existing methods that rely on 2D-3D or 2D-2D matching using 3D techniques, such as SfM and PnP, AxisPose directly infers a robust 6D pose from a single view by leveraging a diffusion model to learn the latent axis distribution of objects without reference views. Specifically, AxisPose constructs an Axis Generation Module (AGM) to capture the latent geometric distribution of object axes through a diffusion model. The diffusion process is guided by injecting the gradient of geometric consistency loss into the noise estimation to maintain the geometric consistency of the generated tri-axis. With the generated tri-axis projection, AxisPose further adopts a Triaxial Back-projection Module (TBM) to recover the 6D pose from the object tri-axis. The proposed AxisPose achieves robust performance at the cross-instance level (i.e., one model for N instances) using only a single view as input without reference images, with great potential for generalization to unseen-object level.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。