T-Rex机器人自动识别并抓取植物叶片,用于智能农业采样。
T-REX: Vision-Based System for Autonomous Leaf Detection and Grasp Estimation
- 结合立体视觉与YOLOv8实现叶片实时定位与3D重建
- 在模拟环境中实现66.6%的抓取成功率
- 适合需要自动化植物采样的科研与农业场景
T-Rex(用于提取叶样本的机器人)是一种基于龙门架的机器人系统,专为温室环境中自主定位、选择和抓取叶片而设计。该系统集成六自由度机械臂与立体视觉流水线,利用YOLOv8实现实时叶片分割,RAFT-Stereo生成密集深度图,重建出3D叶片掩码。通过叶片抓取算法,根据遮挡程度、可见性及距离筛选最优目标,并基于局部表面平坦度、俯视可达性及边缘距离确定抓取点。选定的抓取点由基于ROS的运动控制器执行轨迹规划,驱动配备微针的末端执行器夹持叶片,模拟组织采样。在不同姿态的人工植物实验中,T-Rex系统能稳定完成检测、规划与物理交互,抓取成功率达到66.6%。本文展示了T-Rex的系统架构、实现与测试,是向受控环境农业(CEA)中植物采样自动化迈出的重要一步。
原文摘要 · Abstract (English)
T-Rex (The Robot for Extracting Leaf Samples) is a gantry-based robotic system developed for autonomous leaf localization, selection, and grasping in greenhouse environments. The system integrates a 6-degree-of-freedom manipulator with a stereo vision pipeline to identify and interact with target leaves. YOLOv8 is used for real-time leaf segmentation, and RAFT-Stereo provides dense depth maps, allowing the reconstruction of 3D leaf masks. These observations are processed through a leaf grasping algorithm that selects the optimal leaf based on clutter, visibility, and distance, and determines a grasp point by analyzing local surface flatness, top-down approachability, and margin from edges. The selected grasp point guides a trajectory executed by ROS-based motion controllers, driving a custom microneedle-equipped end-effector to clamp the leaf and simulate tissue sampling. Experiments conducted with artificial plants under varied poses demonstrate that the T-Rex system can consistently detect, plan, and perform physical interactions with plant-like targets, achieving a grasp success rate of 66.6\%. This paper presents the system architecture, implementation, and testing of T-Rex as a step toward plant sampling automation in Controlled Environment Agriculture (CEA).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。