arXiv:2604.06341cs.RO2026-04被引 8

用机械臂推开遮挡果实的枝叶,提升农业机器人识别成功率。

Occlusion Handling by Pushing for Enhanced Fruit Detection

  • 通过深度学习估计被遮挡果实位置,结合3D霍夫变换检测树枝。
  • 在苹果、柠檬、橙子上测试,成功清除遮挡并提高可见性。
  • 适合农业机器人视觉系统开发与实际采摘场景应用。

在农业机器人中,树冠的枝叶遮挡导致果实观测与定位困难,易引发误检或无法采摘。本文提出一种推枝策略:利用RGB-D相机与机械臂,先通过深度学习生成模型在深度空间估计被遮挡果实区域,再用经典图像处理确定推枝方向。引入3D霍夫变换扩展算法,在点云中检测直线段以识别主要遮挡枝条。最后由机械臂执行推枝动作以清除遮挡。实验在不同光照条件和多种水果(苹果、柠檬、橙子)下验证,有效提升了果实可见性,并完成真实机器人推枝演示。方法融合深度学习、图像处理与3D几何分析,具备实际部署潜力。

原文摘要 · Abstract (English)

In agricultural robotics, effective observation and localization of fruits present challenges due to occlusions caused by other parts of the tree, such as branches and leaves. These occlusions can result in false fruit localization or impede the robot from picking the fruit. The objective of this work is to push away branches that block the fruit's view to increase their visibility. Our setup consists of an RGB-D camera and a robot arm. First, we detect the occluded fruit in the RGB image and estimate its occluded part via a deep learning generative model in the depth space. The direction to push to clear the occlusions is determined using classic image processing techniques. We then introduce a 3D extension of the 2D Hough transform to detect straight line segments in the point cloud. This extension helps detect tree branches and identify the one mainly responsible for the occlusion. Finally, we clear the occlusion by pushing the branch with the robot arm. Our method uses a combination of deep learning for fruit appearance estimation, classic image processing for push direction determination, and 3D Hough transform for branch detection. We validate our perception methods through real data under different lighting conditions and various types of fruits (i.e. apple, lemon, orange), achieving improved visibility and successful occlusion clearance. We demonstrate the practical application of our approach through a real robot branch pushing demonstration.

农业机器人遮挡处理视觉感知机械臂控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。