arXiv:2606.28555cs.ROeess.SP2026-06

用机械臂+光谱传感非破坏性测草莓甜度,定位精准成功率超88%

Robotic Arm-Based Spectral Sensing for Strawberry Positioning and Non-Destructive Sweetness Measurement

论文配图:Robotic Arm-Based Spectral Sensing for Strawberry Positioning and Non-Destructive Sweetness Measurement
图 1 · 摘自论文原文
  • 机械臂结合视觉与深度感知,实现草莓实时检测与精确定位
  • 42次试验成功率达88.10%,检测准确率95.24%,接近全成功接近
  • 适合农业自动化质检场景,为智能采摘与品质评估提供可扩展方案

精确评估甜度对农业质量控制至关重要,但传统方法依赖破坏性采样且难于规模化。本论文提出一种基于机械臂的光谱传感系统,实现草莓的检测、定位、接近及非破坏性甜度估计。系统构建了感知-校准-控制闭环流程:采用YOLOv11s实现实时草莓检测;通过RGB-ToF校准与掩码-深度对齐获得几何一致的目标定位;设计自定义眼在手手眼标定流程,估算夹爪与前摄相机间的刚性变换,实现果实目标向机器人基座坐标系的可靠转换。基于此,机器人执行基于航点的搜索与增量闭环接近策略,将传感器置于最优测量距离。实验表明,端到端性能优异(42次试验中88.10%成功),检测鲁棒(95.24%),一旦检测到目标则接近成功率达100%(条件成功率)。手眼标定对比显示,虽然Andreff方法在单次运行中平移范数最小,但Park方法具更优跨样本一致性,因而带来更稳定的下游机器人行为。残余失败集中于传感阶段,尤其在复杂深度/反射条件下甜度估计的有效区域提取困难。总体而言,本工作验证了融合RGB-ToF感知、机器人操控与非破坏性传感在草莓品质评估中的可行性,并为未来集成基于学习的视觉-语言-动作模型等策略提供了可扩展基准。

原文摘要 · Abstract (English)

Accurate assessment of sweetness is essential for quality control in agriculture, yet conventional methods rely on destructive sampling and are difficult to scale. This thesis presents a robotic arm-based spectral sensing system for strawberry detection, localization, approach, and non-destructive sweetness estimation. The system integrates perception, calibration, and robotic control in a closed-loop pipeline. A YOLOv11s detector is adopted for real-time strawberry detection, while RGB-ToF calibration and mask-to-depth alignment are used to obtain geometrically consistent target localization. A custom eye-in-hand hand-eye calibration workflow is developed to estimate the rigid transform between gripper_link and cam_front, enabling reliable transformation of fruit targets into the robot base frame. Based on these estimates, the robot executes a waypoint-based search and an incremental closed-loop approach strategy to position the sensor at optimal working distance for sweetness sensing. Experimental results show strong end-to-end performance (88.10% success over 42 trials), with robust detection (95.24%) and successful approach execution once a target is detected (100% conditional success). Hand-eye calibration comparisons indicate that although Andreff yields the smallest translation norm in single-run results, the Park method provides better cross-sample consistency and therefore more stable downstream robot behavior. The residual failures are concentrated in the sensing stage, especially valid-region extraction for sweetness estimation under difficult depth/reflectance conditions. Overall, this work demonstrates the feasibility of integrating RGB-ToF perception, robotic manipulation, and non-destructive sensing for practical strawberry quality assessment, and provides a scalable baseline for future integration of learning-based policies such as Vision-Language-Action models.

机器人光谱传感非破坏检测草莓甜度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。