arXiv:2609.06726cs.CV2026-09

无需训练,用视觉模型直接估计未知物体的6自由度姿态。

Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Features

论文配图:Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Features
图 1 · 摘自论文原文
  • 基于DINOv3提取密集局部特征,不需微调即可跨域泛化。
  • 在BOP基准上未优化时均值精度达40.7,优化后提升至56.4。
  • 适合无标注数据、快速部署的零样本姿态估计场景。

我们提出B2TFPose,一种无需训练的零样本方法,可从RGB图像中估计未见物体的6自由度姿态。该方法仅使用一个冻结的DINOv3视觉变压器作为预训练组件,在姿态估计流程中提取稠密的片段级特征,可在真实与合成域之间实现良好泛化,且无需任务特定微调,重新激活了基于大规模自监督基础模型的局部特征匹配范式。三个贡献推动了无训练方法的性能边界:采用测地线非极大抑制策略,获取视角多样化的模板集,用于粗到精的对应匹配;渲染引导的重对应(RRC)在估计姿态下合成对象特定视图,并重建稠密2D-3D对应关系以精炼初始估计,无需额外学习参数;多掩码假设选择策略联合评分多个分割候选,解决分割模糊性问题。在BOP基准的七个核心数据集上,B2TFPose在未优化情况下达到40.7的平均准确率(AR),优化后提升至56.4,超越其他无训练方法,并优于包括GigaPose和GenFlow在内的训练模型,在推理速度上也具竞争力。

原文摘要 · Abstract (English)

We present B2TFPose, a training-free zero-shot method for 6DoF pose estimation of unseen objects from RGB images. Using a single frozen DINOv3 vision transformer as its only pretrained component within the pose estimation pipeline, B2TFPose extracts dense patch-level features that generalize across the synthetic-to-real domain gap without any task-specific fine-tuning, revisiting the classical local feature matching paradigm through the lens of large-scale self-supervised foundation models. Three contributions advance the training-free state of the art. A geodesic non-maximum suppression strategy retrieves a viewpoint-diverse template set for coarse-to-fine correspondence matching. Render-guided Re-Correspondence (RRC) synthesizes object-specific views at the estimated pose and re-establishes dense 2D-3D correspondences to sharpen the initial estimate without additional learned parameters. A multi-mask hypothesis selection strategy jointly scores competing segmentation candidates to resolve segmentation ambiguity. On the seven core datasets of the BOP Benchmark, B2TFPose achieves 40.7 mean AR without refinement and 56.4 with refinement, establishing state-of-the-art performance among training-free RGB methods and outperforming trained counterparts including GigaPose and GenFlow, at competitive inference speed.

姿态估计零样本视觉模型DINOv3

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。