arXiv:2506.09491cs.ROcs.CV2025-06被引 2

提升透明反光物体深度估计,助力机械臂精准抓取

DCIRNet: Depth Completion with Iterative Refinement for Dexterous Grasping of Transparent and Reflective Objects

  • 融合RGB与不完整深度图,迭代优化深度补全
  • 在公开数据集上使透明反光物抓取成功率提升44%
  • 适合机器人抓取、三维重建等需要精准深度的应用

日常环境中透明和反射性物体因镜面反射与透光特性,导致深度传感器难以获取完整准确的深度信息,严重影响物体识别、场景重建与机器人操作等下游任务。为解决该问题,本文提出DCIRNet——一种多模态深度补全网络,通过整合RGB图像与不完整深度图,有效提升深度估计质量。方法引入创新的多模态特征融合模块,提取两者互补信息;并设计多阶段监督与深度精修策略,逐步改善补全结果,显著缓解物体边界模糊问题。将模型集成至灵巧抓取框架后,在透明和反射性物体上的抓取成功率提升44%。在多个公开数据集上的大量实验验证了该方法的有效性与强泛化能力。

原文摘要 · Abstract (English)

Transparent and reflective objects in everyday environments pose significant challenges for depth sensors due to their unique visual properties, such as specular reflections and light transmission. These characteristics often lead to incomplete or inaccurate depth estimation, which severely impacts downstream geometry-based vision tasks, including object recognition, scene reconstruction, and robotic manipulation. To address the issue of missing depth information in transparent and reflective objects, we propose DCIRNet, a novel multimodal depth completion network that effectively integrates RGB images and depth maps to enhance depth estimation quality. Our approach incorporates an innovative multimodal feature fusion module designed to extract complementary information between RGB images and incomplete depth maps. Furthermore, we introduce a multi-stage supervision and depth refinement strategy that progressively improves depth completion and effectively mitigates the issue of blurred object boundaries. We integrate our depth completion model into dexterous grasping frameworks and achieve a $44\%$ improvement in the grasp success rate for transparent and reflective objects. We conduct extensive experiments on public datasets, where DCIRNet demonstrates superior performance. The experimental results validate the effectiveness of our approach and confirm its strong generalization capability across various transparent and reflective objects.

深度补全灵巧抓取多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。