基于对称性与球面卷积,实现无需形状先验的9自由度物体位姿估计。
Symmetry-Aware 9D Pose Estimation with Sim(3)-Consistent Feature and Spherical Inception Convolution

- 利用视觉大模型识别对称点,辅助估算平移与尺度,降低旋转估计难度。
- 在Category-Level Pose Benchmark上达到最新最佳性能,真实场景下成功驱动机器人抓取。
- 适用于需要泛化到未见物体的机器人操作任务,尤其适合复杂形变物体。
物体位姿估计是智能体系统感知或操作图像/视频中物体的基础问题。现有实例级方法难以泛化至未见物体;类别级方法虽试图解决,但仍受限于非线性Sim(3)空间中的学习复杂性及类内差异。为此,本文提出一种类别级物体位姿估计新方法,包含两项关键创新:(1) 平移/尺度估计算法,引入语义引导的对称性感知模块,借助大视觉模型(LVM)鲁棒地推断对称点,从而在无形状先验条件下准确估计平移与尺度,作为旋转估计的预计算提示,显著降低在非线性Sim(3)空间中学习的难度,为更具挑战性的旋转估计奠定坚实基础;(2) 基于提出的球面大核Inception卷积的特征融合模块,将来自LVM的语义特征与系统计算的几何特征融合,通过建模长程依赖关系,在不增加过多计算成本的前提下,有效提取类内变化中的关键位姿特征。基于上述创新,本方法在多个基准和真实场景中均达到最先进水平,并构建出可处理多样化物体的鲁棒机器人抓取系统。代码将公开于项目页面:https://panfei-cheng.github.io/SSH-Pose。
原文摘要 · Abstract (English)
Object pose estimation is a fundamental problem for an agent system to perceive or manipulate objects in images or videos. However, current instance-level methods struggle with generalization to unseen objects. Category-level methods seek to address this, but remain constrained by the complexities of learning in the non-linear Sim(3) space and intra-class variations. To address these challenges, We propose an effective method for category-level object pose estimation with two key innovations: (1) A translation/size estimator, featuring a semantic-guided symmetry-aware module that leverages robust generalization capabilities of a large vision model (LVM) to infer symmetry points, resulting in accurate translation and size without shape priors. This result serves as a precomputed cue for rotation estimation, thereby reducing the difficulty of learning in the non-linear Sim(3) space and laying a robust foundation for tackling the inherently more challenging rotation estimation. (2) A feature fusion module, based on our proposed spherical large-kernel inception convolution, fuses semantic features from the LVM with systematically computed geometric features to extract essential pose features from intra-class variations by modeling long-range dependencies without excessive computational cost. Built on these innovations, we achieve SOTA on benchmarks and real-world scenes, while developing a robust robotic picking system capable of handling diverse objects. Our code will be available at the project page: {\hypersetup{urlcolor=blue}https://panfei-cheng.github.io/SSH-Pose}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。