通过语义锚点实现零样本操作技能跨物体迁移
SemAnCorr: Semantic Anchored Correspondence for Zero-Shot Manipulation Skill Transfer

- 联合姿态与对应关系优化,选取语义一致的锚点区域
- 在物体表面传播约束,提升对应关系几何一致性
- 无需训练,显著提升真实场景下的操作成功率
跨几何差异但功能相同的物体实例间转移操作技能是机器人学习中的核心挑战。现有对应方法虽利用密集视觉描述符和3D特征场,但最近邻特征匹配常导致空间不连贯的对应关系,无法恢复可靠的局部几何框架。我们提出SemAnCorr,一种无需训练的框架,通过联合姿态-对应关系优化选择语义一致的锚点区域,并利用功能映射在物体表面传播这些约束,生成既具语义一致性又保持几何连贯性的密集对应关系。该方法使以物体为中心的操作技能可跨几何多样物体迁移。我们在PartNet-Mobility基础上构建的密集对应基准上评估,达到90.8%的语义准确率,且几何一致性优于近期最先进基线。最终实验表明,仅需一次示范,SemAnCorr即可在未见物体上实现比现有方法更可靠的零样本操作技能迁移。
原文摘要 · Abstract (English)
Transferring manipulation skills across object instances that share functionality but differ in geometry remains a fundamental challenge in robot learning. While recent correspondence methods leverage dense visual descriptors and 3D feature fields, nearest-neighbor feature matching often produces spatially incoherent correspondences that fail to recover the local geometric frames required for reliable skill transfer. We introduce SemAnCorr, a training-free framework that establishes dense correspondence by selecting semantically consistent anchor regions through joint pose-correspondence optimization and propagating these constraints over the object surface using functional maps. The resulting correspondences preserve both semantic consistency and geometric coherence, enabling object-centric manipulation skills to transfer across geometrically diverse instances. We evaluate SemAnCorr on a dense correspondence benchmark built on PartNet-Mobility, achieving 90.8% semantic accuracy in our benchmark evaluation while improving geometric coherence over recent state-of-the-art baselines. Finally, we show that these improvements translate directly into real-world manipulation performance: using a single demonstration, SemAnCorr enables substantially more reliable zero-shot manipulation skill transfer to previously unseen objects than existing correspondence methods. Videos and additional visualizations are available at [https://semancorr.github.io](https://semancorr.github.io) .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。