arXiv:2502.19169cs.RO2025-02被引 1

用视觉6D姿态估计实现重型机械臂精准定位,提升柔性臂任务灵活性。

Increasing the Task Flexibility of Heavy-Duty Manipulators Using Visual 6D Pose Estimation of Objects

  • 通过相机直接估算工具与目标物的6D姿态,实现视觉引导定位。
  • 实测平均定位误差低于2毫米(非深度方向),在5米长机械臂上验证。
  • 仅用合成数据训练模型,适合工业级柔性重载机械臂自动化升级。

基于深度神经网络的视觉6D姿态估计技术为重型机器人应用提供了新的视觉控制途径。本文提出一种针对长臂重载(HDLR)机械臂的高精度工具定位流程,采用眼在手上配置的相机,直接估算工具与目标物体(OOI)的位姿。结合工具与目标间的位姿误差,以及基于运动的相机-机器人标定,可借助工业通用的建模与控制方法实现可靠定位。该方法通过图像算法规避了结构柔性导致的刚体运动学误差。使用合成数据训练用于OOI姿态估计的深度神经网络。在5米臂长的真实场景中验证,实验结果表明非深度方向平均工具定位误差小于2毫米,为非刚性长臂机械臂的作业灵活性和自动化水平提升提供了新路径。

原文摘要 · Abstract (English)

Recent advances in visual 6D pose estimation of objects using deep neural networks have enabled novel ways of vision-based control for heavy-duty robotic applications. In this study, we present a pipeline for the precise tool positioning of heavy-duty, long-reach (HDLR) manipulators using advanced machine vision. A camera is utilized in the so-called eye-in-hand configuration to estimate directly the poses of a tool and a target object of interest (OOI). Based on the pose error between the tool and the target, along with motion-based calibration between the camera and the robot, precise tool positioning can be reliably achieved using conventional robotic modeling and control methods prevalent in the industry. The proposed methodology comprises orientation and position alignment based on the visually estimated OOI poses, whereas camera-to-robot calibration is conducted based on motion utilizing visual SLAM. The methods seek to avert the inaccuracies resulting from rigid-body--based kinematics of structurally flexible HDLR manipulators via image-based algorithms. To train deep neural networks for OOI pose estimation, only synthetic data are utilized. The methods are validated in a real-world setting using an HDLR manipulator with a 5 m reach. The experimental results demonstrate that an image-based average tool positioning error of less than 2 mm along the non-depth axes is achieved, which facilitates a new way to increase the task flexibility and automation level of non-rigid HDLR manipulators.

6D姿态估计重载机械臂视觉定位工业自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。