通过姿态连续性学习点云表示,提升深度图像下的6D物体位姿估计精度。
Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation
- 分离旋转与平移编码,利用对比学习保持姿态连续性
- 在REAL275和CAMERA25上优于现有深度仅方法,实时运行
- 适合需要高泛化能力的机器人抓取与3D重建场景
类别级物体位姿估计旨在预测给定类别中物体的6D位姿和3D尺寸。现有方法仅依赖6D位姿作为监督信号,未显式捕捉姿态的内在连续性,导致预测不一致且对未见位姿泛化能力差。为此,我们提出HRC-Pose,一种基于深度图像的新型类别级位姿估计框架,利用对比学习学习保持6D姿态连续性的点云表示。该方法将物体位姿解耦为旋转与平移分量,分别进行编码并在网络中全程使用。具体地,我们设计了基于6D姿态感知的分层排序策略,针对多任务、多类别场景实施对比学习,通过考虑旋转、平移差异及类别信息来对比来自多个类别的点云。此外,我们设计了分别处理旋转感知与平移感知嵌入的位姿估计模块。实验表明,HRC-Pose成功学习到连续的特征空间。在REAL275和CAMERA25基准测试中,本方法持续优于现有深度仅最先进方法,并实现实时运行,验证了其有效性与实际应用潜力。代码已开源:https://github.com/zhujunli1993/HRC-Pose。
原文摘要 · Abstract (English)
Category-level object pose estimation aims to predict the 6D pose and 3D size of objects within given categories. Existing approaches for this task rely solely on 6D poses as supervisory signals without explicitly capturing the intrinsic continuity of poses, leading to inconsistencies in predictions and reduced generalization to unseen poses. To address this limitation, we propose HRC-Pose, a novel depth-only framework for category-level object pose estimation, which leverages contrastive learning to learn point cloud representations that preserve the continuity of 6D poses. HRC-Pose decouples object pose into rotation and translation components, which are separately encoded and leveraged throughout the network. Specifically, we introduce a contrastive learning strategy for multi-task, multi-category scenarios based on our 6D pose-aware hierarchical ranking scheme, which contrasts point clouds from multiple categories by considering rotational and translational differences as well as categorical information. We further design pose estimation modules that separately process the learned rotation-aware and translation-aware embeddings. Our experiments demonstrate that HRC-Pose successfully learns continuous feature spaces. Results on REAL275 and CAMERA25 benchmarks show that our method consistently outperforms existing depth-only state-of-the-art methods and runs in real-time, demonstrating its effectiveness and potential for real-world applications. Our code is at https://github.com/zhujunli1993/HRC-Pose.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。