用模拟数据训练统一模型,实现高精度物体抓握姿态估计。
UniTac2Pose: A Unified Approach Learned in Simulation for Category-level Visuotactile In-hand Pose Estimation
- 基于能量扩散模型分三阶段优化姿态猜测。
- 在真实场景中误差低于1.5°和10mm,优于传统方法。
- 支持未见过的物体类别,适合工业抓取与机器人操作。
准确估计基于CAD模型的物体抓握姿态,在工业应用和日常任务中至关重要,涵盖工件定位、组件装配及设备插入等场景。现有方法多依赖回归、特征匹配或配准技术,但难以兼顾高精度与对未见CAD模型的泛化能力。本文提出一种三阶段统一框架:首先采样并预排序姿态候选;其次通过迭代优化细化候选;最后进行后排序确定最优姿态。整个过程由仅在模拟数据上训练的能量基扩散模型驱动,该模型同时提供梯度用于姿态精修,并输出能量值评估姿态质量。借鉴计算机视觉思想,在评分网络中引入渲染-对比结构,显著提升模拟到真实场景的迁移性能(实验证明)。大量实验表明,本方法在精度上超越基于回归、匹配和注册的基准方法,并具备强类别内泛化能力。此外,该框架统一整合触觉姿态估计、姿态追踪与不确定性估计,可在多种真实条件下保持鲁棒表现。
原文摘要 · Abstract (English)
Accurate estimation of the in-hand pose of an object based on its CAD model is crucial in both industrial applications and everyday tasks, ranging from positioning workpieces and assembling components to seamlessly inserting devices like USB connectors. While existing methods often rely on regression, feature matching, or registration techniques, achieving high precision and generalizability to unseen CAD models remains a significant challenge. In this paper, we propose a novel three-stage framework for in-hand pose estimation. The first stage involves sampling and pre-ranking pose candidates, followed by iterative refinement of these candidates in the second stage. In the final stage, post-ranking is applied to identify the most likely pose candidates. These stages are governed by a unified energy-based diffusion model, which is trained solely on simulated data. This energy model simultaneously generates gradients to refine pose estimates and produces an energy scalar that quantifies the quality of the pose estimates. Additionally, borrowing the idea from the computer vision domain, we incorporate a render-compare architecture within the energy-based score network to significantly enhance sim-to-real performance, as demonstrated by our ablation studies. We conduct comprehensive experiments to show that our method outperforms conventional baselines based on regression, matching, and registration techniques, while also exhibiting strong intra-category generalization to previously unseen CAD models. Moreover, our approach integrates tactile object pose estimation, pose tracking, and uncertainty estimation into a unified framework, enabling robust performance across a variety of real-world conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。