arXiv:2412.02642cs.CV2024-12被引 4

用机器人拍视频+深度学习,高效估算大豆产量

Robust soybean seed yield estimation using high-throughput ground robot videos

  • 用广角相机拍摄田间视频,通过深度模型自动计数种子
  • 三年数据验证,品种排序准确率达83%,耗时减少32%
  • 适合育种和农业增产研究,无需复杂设备搬运

本文提出一种基于计算机视觉与深度学习的高通量大豆(Glycine max (L.) Merr.)产量估算新方法。传统产量数据采集费时费力,易受设备故障影响,且需跨地块运输设备。本研究利用搭载鱼眼镜头的地面机器人,在多个生育期采集大豆田块的完整视频,从中提取图像,并通过P2PNet-Yield模型进行处理。该模型结合特征提取模块(P2PNet-Soy骨干网络)与产量回归模块,实现种子计数与产量预测。实验基于三年产量试验数据:2021年8500个样本,2022年2275个,2023年650个。通过鱼眼图像校正与随机传感器效应的数据增强等创新,提升了模型精度与泛化能力。最终模型在品种排名任务中达到最高83%的准确率,相较传统方法可节省32%的采集时间与成本,为育种与农业生产力提升提供可扩展方案。

原文摘要 · Abstract (English)

We present a novel method for soybean (Glycine max (L.) Merr.) yield estimation leveraging high throughput seed counting via computer vision and deep learning techniques. Traditional methods for collecting yield data are labor-intensive, costly, prone to equipment failures at critical data collection times, and require transportation of equipment across field sites. Computer vision, the field of teaching computers to interpret visual data, allows us to extract detailed yield information directly from images. By treating it as a computer vision task, we report a more efficient alternative, employing a ground robot equipped with fisheye cameras to capture comprehensive videos of soybean plots from which images are extracted in a variety of development programs. These images are processed through the P2PNet-Yield model, a deep learning framework where we combined a Feature Extraction Module (the backbone of the P2PNet-Soy) and a Yield Regression Module to estimate seed yields of soybean plots. Our results are built on three years of yield testing plot data - 8500 in 2021, 2275 in 2022, and 650 in 2023. With these datasets, our approach incorporates several innovations to further improve the accuracy and generalizability of the seed counting and yield estimation architecture, such as the fisheye image correction and data augmentation with random sensor effects. The P2PNet-Yield model achieved a genotype ranking accuracy score of up to 83%. It demonstrates up to a 32% reduction in time to collect yield data as well as costs associated with traditional yield estimation, offering a scalable solution for breeding programs and agricultural productivity enhancement.

大豆产量机器人视觉深度学习高通量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。