对比YOLO与Transformer模型在农田杂草实时识别中的表现。
Assessing the Capability of YOLO- and Transformer-based Object Detectors for Real-time Weed Detection
- 用YOLOv8/v9/v10和RT-DETR在真实田间图像上训练对比
- YOLOv9在召回率和mAP上领先,RT-DETR精度最高
- 小型YOLO模型推理快至7.58毫秒,适合嵌入式设备
精准识别作物与杂草,尤其在实时条件下区分不同杂草种类,是实现精准喷洒、减少农药使用的关键。本研究评估了当前最先进的目标检测模型在真实田间场景下的适用性。对YOLOv8、YOLOv9、YOLOv10及RT-DETR的所有可用模型进行训练与评估,使用两个数据集:第一个按物种单独训练;第二个区分单子叶、双子叶杂草与三种作物。结果表明,所有模型性能相近,但YOLOv9s和YOLOv9e在数据集2中召回率分别为66.58%和72.36%,mAP50达73.52%和79.86%,mAP50-95为43.82%和47.00%。而RT-DETR-l在数据集1和2的精度分别达到82.44%和81.46%,适合低误报场景。最小型号的YOLO模型(YOLOv8n、YOLOv9t、YOLOv10n)在NVIDIA GeForce RTX 4090上单帧推理时间最低达7.58毫秒,兼顾速度与准确度,具备部署于资源受限嵌入式设备的潜力。
原文摘要 · Abstract (English)
Spot spraying represents an efficient and sustainable method for reducing the amount of pesticides, particularly herbicides, used in agricultural fields. To achieve this, it is of utmost importance to reliably differentiate between crops and weeds, and even between individual weed species in situ and under real-time conditions. To assess suitability for real-time application, different object detection models that are currently state-of-the-art are compared. All available models of YOLOv8, YOLOv9, YOLOv10, and RT-DETR are trained and evaluated with images from a real field situation. The images are separated into two distinct datasets: In the initial data set, each species of plants is trained individually; in the subsequent dataset, a distinction is made between monocotyledonous weeds, dicotyledonous weeds, and three chosen crops. The results demonstrate that while all models perform equally well in the metrics evaluated, the YOLOv9 models, particularly the YOLOv9s and YOLOv9e, stand out in terms of their strong recall scores (66.58 % and 72.36 %), as well as mAP50 (73.52 % and 79.86 %), and mAP50-95 (43.82 % and 47.00 %) in dataset 2. However, the RT-DETR models, especially RT-DETR-l, excel in precision with reaching 82.44 \% on dataset 1 and 81.46 % in dataset 2, making them particularly suitable for scenarios where minimizing false positives is critical. In particular, the smallest variants of the YOLO models (YOLOv8n, YOLOv9t, and YOLOv10n) achieve substantially faster inference times down to 7.58 ms for dataset 2 on the NVIDIA GeForce RTX 4090 GPU for analyzing one frame, while maintaining competitive accuracy, highlighting their potential for deployment in resource-constrained embedded computing devices as typically used in productive setups.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。