通过自适应关键点与全局几何聚合,提升复杂物体的6D姿态估计精度。
Instance-Adaptive Keypoint Learning with Local-to-Global Geometric Aggregation for Category-Level Object Pose Estimation
- 自适应检测关键点并分层聚合局部与全局几何特征。
- 在三个数据集上达到当前最优性能,参数量1670万,推理速度36帧/秒。
- 适合需要高精度姿态估计的机器人抓取与虚实交互场景。
类别级物体姿态估计旨在从预定义类别中预测未见过物体的6D姿态与尺寸,需具备强泛化能力以应对类内差异。尽管已有方法尝试缓解类内变化,但对具有复杂几何结构或显著偏离标准形状的物体仍表现不佳。为此,本文提出 INKL-Pose 框架,实现实例自适应关键点学习与局部到全局几何聚合。首先,使用实例自适应关键点检测器预测语义一致且几何信息丰富的关键点;随后通过两个模块进行精炼:(1) 局部关键点特征聚合器捕捉细粒度几何特征;(2) 基于双向 Mamba 的全局关键点特征聚合器增强结构一致性。为实现 Mamba 的双向建模,引入简单有效的特征序列翻转策略,在保持空间连贯性的同时构建反向特征序列。此外,设计表面损失与分离损失,促使关键点分布均匀且空间分散。最终,将关键点映射至规范空间完成6D姿态与尺寸回归。在 CAMERA25、REAL275 与 HouseCat6D 上的大量实验表明,INKL-Pose 达到当前最优性能,模型参数量为16.7M,于 NVIDIA RTX 4090D GPU 上运行速度达36 FPS。
原文摘要 · Abstract (English)
Category-level object pose estimation aims to predict the 6D pose and size of previously unseen instances from predefined categories, requiring strong generalization across diverse object instances. Although many previous methods attempt to mitigate intra-class variations, they often struggle with instances exhibiting complex geometries or significant deviations from canonical shapes. To address this issue, we propose INKL-Pose, a novel category-level object pose estimation framework that enables INstance-adaptive Keypoint Learning with local-to-global geometric aggregation. Specifically, our method first predicts semantically consistent and geometrically informative keypoints using an Instance-Adaptive Keypoint Detector, then refines them: (1) a Local Keypoint Feature Aggregator capturing fine-grained geometries, and (2) a Global Keypoint Feature Aggregator using bidirectional Mamba for structural consistency. To enable bidirectional modeling in Mamba, we introduce a simple yet effective Feature Sequence Flipping strategy that preserves spatial coherence while constructing backward feature sequence. Additionally, we design a surface loss and a separation loss to encourage uniform coverage and spatial diversity in keypoint distribution. The resulting keypoints are mapped to a canonical space for 6D pose and size regression. Extensive experiments on CAMERA25, REAL275, and HouseCat6D show that INKL-Pose achieves state-of-the-art performance with 16.7M parameters and runs at 36 FPS on an NVIDIA RTX 4090D GPU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。