用单张参考图精准估计未知物体6D姿态,无需完整3D模型。
CoordAR: One-Reference 6D Pose Estimation of Novel Objects via Autoregressive Coordinate Map Generation
- 将3D坐标对应关系建模为离散令牌序列,逐个生成更准确。
- 在多个基准上超越现有方法,对遮挡和对称物体更鲁棒。
- 适合机器人抓取、增强现实等需快速姿态估计的场景。
6D物体姿态估计是机器人和增强现实的关键任务,尤其在缺乏完整3D模型的新物体上更具挑战性。为减少对3D模型的依赖,近期研究提出基于单参考视图的方法。然而,现有基于实数值坐标回归的方法受卷积结构局部性影响,全局一致性差,且在对称或遮挡场景中因缺乏不确定性建模而表现不佳。本文提出CoordAR,一种新型自回归框架,用于未见物体的单参考6D姿态估计。CoordAR将参考视图与查询视图间的3D-3D对应关系建模为离散令牌的映射,通过自回归概率方式生成。为实现精准对应回归,CoordAR引入:1)新颖的坐标地图分块机制,支持在离散3D空间上概率预测;2)模态解耦编码策略,分别处理RGB外观与坐标线索;3)条件于位置对齐查询特征和部分生成令牌序列的自回归变换器解码器。这些机制使CoordAR在多个基准上显著优于现有方法,并在真实测试中表现出对对称性、遮挡等复杂情况的强大鲁棒性。
原文摘要 · Abstract (English)
Object 6D pose estimation, a crucial task for robotics and augmented reality applications, becomes particularly challenging when dealing with novel objects whose 3D models are not readily available. To reduce dependency on 3D models, recent studies have explored one-reference-based pose estimation, which requires only a single reference view instead of a complete 3D model. However, existing methods that rely on real-valued coordinate regression suffer from limited global consistency due to the local nature of convolutional architectures and face challenges in symmetric or occluded scenarios owing to a lack of uncertainty modeling. We present CoordAR, a novel autoregressive framework for one-reference 6D pose estimation of unseen objects. CoordAR formulates 3D-3D correspondences between the reference and query views as a map of discrete tokens, which is obtained in an autoregressive and probabilistic manner. To enable accurate correspondence regression, CoordAR introduces 1) a novel coordinate map tokenization that enables probabilistic prediction over discretized 3D space; 2) a modality-decoupled encoding strategy that separately encodes RGB appearance and coordinate cues; and 3) an autoregressive transformer decoder conditioned on both position-aligned query features and the partially generated token sequence. With these novel mechanisms, CoordAR significantly outperforms existing methods on multiple benchmarks and demonstrates strong robustness to symmetry, occlusion, and other challenges in real-world tests.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。