arXiv:2602.17101cs.ROcs.CV2026-02

检验3D重建质量如何影响机器人抓取成功率

Benchmarking the Effects of Object Pose Estimation and Reconstruction on Robotic Grasping Success

  • 用物理仿真基准评估不同3D重建模型的抓取适配性
  • 重建误差虽减少抓取候选数,但对抓取成功率影响小
  • 平移误差比旋转误差更关键,尤其对对称物体

3D重建是众多机器人感知任务的基础,包括6维物体位姿估计和抓取位姿生成。现代多视角图像重建方法可生成视觉与几何上逼真的网格模型,但标准几何评估无法反映重建质量对下游任务(如机器人操作性能)的影响。本文提出一个大规模、基于物理的基准,评估6维位姿估计器和3D网格模型在抓取任务中的功能性表现。通过在不同重建网格上生成抓取位姿,并在真实模型上执行,模拟使用不完美模型生成的抓取位姿对真实物体交互的影响,从而评估位姿误差、抓取鲁棒性与几何失真三者共同作用的效果。结果表明,重建伪影显著减少抓取候选数量,但若位姿估计准确,对抓取成功率影响微乎其微。此外,抓取成功与位姿误差的关系主要受空间误差主导,即使简单的平移误差也能为对称物体的抓取成功提供有效预测。本研究揭示了感知系统与机器人操作之间的关联。

原文摘要 · Abstract (English)

3D reconstruction serves as the foundational layer for numerous robotic perception tasks, including 6D object pose estimation and grasp pose generation. Modern 3D reconstruction methods for objects can produce visually and geometrically impressive meshes from multi-view images, yet standard geometric evaluations do not reflect how reconstruction quality influences downstream tasks such as robotic manipulation performance. This paper addresses this gap by introducing a large-scale, physics-based benchmark that evaluates 6D pose estimators and 3D mesh models based on their functional efficacy in grasping. We analyze the impact of model fidelity by generating grasps on various reconstructed 3D meshes and executing them on the ground-truth model, simulating how grasp poses generated with an imperfect model affect interaction with the real object. This assesses the combined impact of pose error, grasp robustness, and geometric inaccuracies from 3D reconstruction. Our results show that reconstruction artifacts significantly decrease the number of grasp pose candidates but have a negligible effect on grasping performance given an accurately estimated pose. Our results also reveal that the relationship between grasp success and pose error is dominated by spatial error, and even a simple translation error provides insight into the success of the grasping pose of symmetric objects. This work provides insight into how perception systems relate to object manipulation using robots.

机器人抓取3D重建位姿估计物理仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。