arXiv:2601.13565cs.CVcs.RO2026-01中稿 · ICRA

通过局部匹配提升机器人对未知物体的6D姿态识别精度。

Learning Fine-Grained Correspondence with Cross-Perspective Perception for Open-Vocabulary 6D Object Pose Estimation

  • 用局部区域替代全局匹配,减少背景干扰
  • 双视角融合与块级关联图提升匹配精度
  • 适合开放世界中需自然语言控制的机器人场景

开放词汇6D物体姿态估计使机器人能仅凭自然语言操控任意未见物体。然而现有方法依赖无约束的全局匹配策略,在开放世界中易受背景干扰,导致目标特征混淆。为此,本文提出细粒度对应姿态估计(FiCoP)框架,从噪声敏感的全局匹配转向空间受限的块级对应。首先通过物体中心解耦分离目标与环境噪声;在此基础上,提出交叉视角全局感知(CPGP)模块,融合双视角特征,通过显式上下文推理与文本引导语义注入建立结构一致性;同时设计块相关性预测器(PCP),利用块间相关矩阵作为结构先验,生成精确的块级关联图,作为空间滤波器实现细粒度、抗噪匹配。在REAL275和Toyota-Light数据集上的实验表明,相比当前最优方法,平均召回率分别提升8.0%和6.1%,验证了该方法在复杂开放环境中的鲁棒性与泛化能力。源代码将公开于https://github.com/zjjqinyu/FiCoP。

原文摘要 · Abstract (English)

Open-vocabulary 6D object pose estimation empowers robots to manipulate arbitrary unseen objects guided solely by natural language. However, a critical limitation of existing approaches is their reliance on unconstrained global matching strategies. In open-world scenarios, trying to match anchor features against the entire query image space introduces excessive ambiguity, as target features are easily confused with background distractors. To resolve this, we propose Fine-grained Correspondence Pose Estimation (FiCoP), a framework that transitions from noise-prone global matching to spatially-constrained patch-level correspondence. To systematically eliminate background interference, FiCoP first employs an object-centric disentanglement step to isolate the target from macro-level environmental noise. Building upon this localized region, our core methodological innovations are twofold. Firstly, a Cross-Perspective Global Perception (CPGP) module is proposed to fuse dual-view features, establishing structural consensus through explicit context reasoning and text-guided semantic injection. Secondly, we design a Patch Correlation Predictor (PCP) that leverages a patch-to-patch correlation matrix as a structural prior. This generates a precise block-wise association map, acting as a spatial filter to enforce fine-grained, noise-resilient matching. Experiments on the REAL275 and Toyota-Light datasets demonstrate that FiCoP improves Average Recall by 8.0% and 6.1%, respectively, compared to the state-of-the-art method, highlighting its capability to deliver robust and generalized perception for robotic agents operating in complex, unconstrained open-world environments. The source code will be made publicly available at https://github.com/zjjqinyu/FiCoP.

6D姿态估计开放词汇机器人感知细粒度匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。