用普通摄像头估算葡萄糖度,让机器人也能‘尝’出甜度。
Can Robots "Taste" Grapes? Estimating SSC with Simple RGB Sensors
- 用直方图和深度神经网络两种方法,从彩色图片推算糖度。
- 最先进模型误差仅1.05°Brix,接近高成本光谱设备表现。
- 适合农业机器人部署,跨季节跨设备仍稳定有效。
在葡萄种植中,采摘依赖于果实品质的准确评估。虽然颜色等特征可见,但可溶性固形物(SSC,以°Brix为单位)等关键指标需专用工具测量,且与颜色无直接因果关系。虽高光谱相机可在实验室条件下高精度估计SSC,但在田间环境实用性受限。本研究探讨了在非受控光照下使用简单RGB传感器估算SSC与颜色的可行性,推动低成本、机器人辅助采摘。2021与2022年夏季,采集带标签的葡萄图像用于评估算法在跨季节与跨设备场景下的鲁棒性。提出两种方法:适用于资源受限机器人的轻量级直方图法,以及用于复杂应用的深度神经网络(DNN)模型。结果表明,DNN模型在挑战性的跨设备测试集上实现最低1.05°Brix的平均绝对误差(MAE),直方图法亦达1.46°Brix。该性能与同类田间应用中高光谱系统报告的1.27–2.20°Brix误差范围相当,具有显著竞争力。
原文摘要 · Abstract (English)
In table grape cultivation, harvesting depends on accurately assessing fruit quality. While some characteristics, like color, are visible, others, such as Soluble Solid Content (SSC), or sugar content measured in degrees Brix (°Brix), require specific tools. SSC is a key quality factor that correlates with ripeness, but lacks a direct causal relationship with color. Hyperspectral cameras can estimate SSC with high accuracy under controlled laboratory conditions, but their practicality in field environments is limited. This study investigates the potential of simple RGB sensors under uncontrolled lighting to estimate SSC and color, enabling cost-effective, robot-assisted harvesting. Over the 2021 and 2022 summer seasons, we collected grape images with corresponding SSC and color labels to evaluate algorithmic solutions for SSC estimation, specifically testing for cross-seasonal and cross-device robustness. We propose two approaches: a computationally efficient histogram-based method for resource-constrained robots and a Deep Neural Network (DNN) model for more complex applications. Our results demonstrate high performance, with the DNN model achieving a Mean Absolute Error (MAE) as low as $1.05$ °Brix on a challenging cross-device test set. The lightweight histogram-based method also proved effective, reaching an MAE of $1.46$ °Brix. These results are highly competitive with those from hyperspectral systems, which report errors in the $1.27$--$2.20$ °Brix range in similar field applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。