arXiv:2502.12406cs.ROcs.CV2025-02被引 6

多视觉定位提升采摘机器人果实抓取精度,减少损毁。

Multi-vision-based Picking Point Localisation of Target Fruit for Harvesting Robots

  • 用双RGB-D相机获取果实表面点,结合解析与模型方法定位中心点。
  • 基于Adaboost的模型法达88.8%成功率,误差仅4.40毫米。
  • 适合研究农业机器人、智能采摘系统的人参考。

本文提出基于多视觉的果实采摘点定位策略。准确识别采摘点对机器人采摘至关重要,因抓握不稳会导致果实损伤或掉落造成经济损失。研究采用两种多视觉定位方法:解析法与基于模型的算法。通过运动捕捉系统(mocap)采集果实真实几何中心点,并利用两台红绿蓝-深度(RGB-D)相机提取两个固定表面点Cfix和Ceih。首先使用解析法检测目标果实的采摘点;其次,采用多种主成分与集成学习方法,以表面点为输入预测果实几何中心。其中,Adaboost回归算法表现最佳,实现88.8%的采摘成功率,均欧氏距离(MED)为4.40毫米;解析法达81.4%成功率,MED为14.25毫米,均优于单摄像头方案(77.7%成功率,MED为24.02毫米)。通过协作机器人(cobot)开展系列采摘实验,验证多视觉系统显著提升定位精度,从而提高采摘成功率。

原文摘要 · Abstract (English)

This paper presents multi-vision-based localisation strategies for harvesting robots. Identifying picking points accurately is essential for robotic harvesting because insecure grasping can lead to economic loss through fruit damage and dropping. In this study, two multi-vision-based localisation methods, namely the analytical approach and model-based algorithms, were employed. The actual geometric centre points of fruits were collected using a motion capture system (mocap), and two different surface points Cfix and Ceih were extracted using two Red-Green-Blue-Depth (RGB-D) cameras. First, the picking points of the target fruit were detected using analytical methods. Second, various primary and ensemble learning methods were employed to predict the geometric centre of target fruits by taking surface points as input. Adaboost regression, the most successful model-based localisation algorithm, achieved 88.8% harvesting accuracy with a Mean Euclidean Distance (MED) of 4.40 mm, while the analytical approach reached 81.4% picking success with a MED of 14.25 mm, both demonstrating better performance than the single-camera, which had a picking success rate of 77.7% with a MED of 24.02 mm. To evaluate the effect of picking point accuracy in collecting fruits, a series of robotic harvesting experiments were performed utilising a collaborative robot (cobot). It is shown that multi-vision systems can improve picking point localisation, resulting in higher success rates of picking in robotic harvesting.

农业机器人多视觉定位果实采摘机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。