arXiv:2409.19490cs.ROcs.CV2024-09被引 2

用单目相机+机器人运动,实时算出真实距离,让机器看得准。

KineDepth: Utilizing Robot Kinematics for Online Metric Depth Estimation

  • 利用机器人自身运动当尺子,把模糊深度变真实距离
  • 实验中深度误差降22.1%,任务成功率提升52%
  • 适合想低成本部署真实距离感知的机器人研究者

深度感知对机器人理解环境的空间结构至关重要。传统依赖RGB-D或双目摄像头等硬件传感器的方法存在透明/反光物体识别难、成本高、校准复杂、能耗大等问题。单目深度估计虽成本低,但输出为相对深度,难以用于机器人任务。本文提出一种新方法:仅需单个标定过的摄像头,通过机器人自身运动作为“测量工具”,在线将相对深度转化为真实距离。采用基于LSTM的度量深度回归器,结合概率滤波在线训练与优化,精准恢复近距区域的度量深度。真实机器人实验证明,该方法显著优于现有主流单目度量深度技术,深度误差降低22.1%,下游任务成功率达52%提升。

原文摘要 · Abstract (English)

Depth perception is essential for a robot's spatial and geometric understanding of its environment, with many tasks traditionally relying on hardware-based depth sensors like RGB-D or stereo cameras. However, these sensors face practical limitations, including issues with transparent and reflective objects, high costs, calibration complexity, spatial and energy constraints, and increased failure rates in compound systems. While monocular depth estimation methods offer a cost-effective and simpler alternative, their adoption in robotics is limited due to their output of relative rather than metric depth, which is crucial for robotics applications. In this paper, we propose a method that utilizes a single calibrated camera, enabling the robot to act as a "measuring stick" to convert relative depth estimates into metric depth in real-time as tasks are performed. Our approach employs an LSTM-based metric depth regressor, trained online and refined through probabilistic filtering, to accurately restore the metric depth across the monocular depth map, particularly in areas proximal to the robot's motion. Experiments with real robots demonstrate that our method significantly outperforms current state-of-the-art monocular metric depth estimation techniques, achieving a 22.1% reduction in depth error and a 52% increase in success rate for a downstream task.

深度估计机器人单目视觉在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。