用视觉追踪实现机器人精准修剪,解决果园复杂环境定位难题。
An Integrated Visual Servoing Framework for Precise Robotic Pruning Operations in Modern Commercial Orchard
- 用相机+点追踪算法实时定位目标,控制机械臂精准移动
- 仿真中90%以上操作误差小于5毫米,10毫米内成功率100%
- 适合想做农业自动化、机器人视觉定位的开发者参考
本研究提出一种用于果树自动修剪的视觉引导机器人控制系统。传统修剪依赖人工,效率低且难规模化,核心挑战在于复杂果园环境中对切割工具的精确稳定定位,密集枝叶和遮挡导致目标难以触及。为此,将Intel RealSense D435相机安装在UR5e机械臂末端,并采用基于Transformer的CoTracker3点追踪算法,实现视觉伺服控制,使追踪点始终位于摄像头视野中心。系统结合比例控制与迭代逆运动学,完成末端执行器的精准定位。在Gazebo仿真中,系统在5毫米容差下成功率达77.77%,10毫米容差下成功率为100%,平均末端误差为4.28 ± 1.36毫米。视觉控制器在像素工作空间内不同目标位置均表现鲁棒。结果验证了视觉追踪与运动控制融合在精密农业任务中的有效性。未来工作将聚焦于真实场景部署及引入力传感以实现实际切割。
原文摘要 · Abstract (English)
This study presents a vision-guided robotic control system for automated fruit tree pruning applications. Traditional pruning practices are labor-intensive and limit agricultural efficiency and scalability, highlighting the need for advanced automation. A key challenge is the precise, robust positioning of the cutting tool in complex orchard environments, where dense branches and occlusions make target access difficult. To address this, an Intel RealSense D435 camera is mounted on the flange of a UR5e robotic arm and CoTracker3, a transformer-based point tracker, is utilized for visual servoing control that centers tracked points in the camera view. The system integrates proportional control with iterative inverse kinematics to achieve precise end-effector positioning. The system was validated in Gazebo simulation, achieving a 77.77% success rate within 5mm positional tolerance and 100% success rate within 10mm tolerance, with a mean end-effector error of 4.28 +/- 1.36 mm. The vision controller demonstrated robust performance across diverse target positions within the pixel workspace. The results validate the effectiveness of integrating vision-based tracking with kinematic control for precision agricultural tasks. Future work will focus on real-world implementation and the integration of force sensing for actual cutting operations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。