用自监督学习提升农田杂草检测,跨年份数据表现更优。
DINOv3 Meets YOLO26 for Weed Detection in Vegetable Crops
- 融合多源数据并用DINOv3自监督预训练,优化视觉主干
- 在2025年数据上提升5.4% mAP50,跨域泛化超10%以上
- 适合农业自动化、智能农机研发人员参考
精准蔬菜除草亟需鲁棒模型,但受限于大规模标注的作物-杂草数据集稀缺。为此,本研究通过整合异构数据集并利用自监督学习,构建基础作物-杂草检测模型。初始收集618,642张图像,经逐级筛选后保留199,388张用于微调DINOv3视觉变换器(ViT-small)。该模型作为主干嵌入YOLO26,可作单一或双主干架构。双主干框架引入特征对齐损失,实现高效特征融合且计算开销小。实验表明,基于微调DINOv3-ViT-small的YOLO26-large在2025年域内数据上达+5.4% mAP50提升;跨域泛化能力显著,相较标准YOLO26-large,2021-2023年数据集上提升+14.0%,2024年数据集上提升+11.9%。尽管参数量增加45.6%,推理延迟增至2.9倍,仍保持约28.5帧/秒的实时性能。研究中构建的数据集与软件将公开共享。
原文摘要 · Abstract (English)
Developing robust models for precision vegetable weeding is currently constrained by the scarcity of large-scale, annotated weed-crop datasets. To address this limitation, this study proposes a foundational crop-weed detection model by integrating heterogeneous datasets and leveraging self-supervised learning. A total of 618,642 crop-weed images were initially collected and subsequently refined to 199,388 filtered images for fine-tuning a DINOv3 vision transformer (ViT-small) through a sequential curation strategy. The fine-tuned DINOv3 backbone was then integrated into YOLO26, serving either as a primary backbone or part of a dual-backbone architecture. A feature alignment loss was introduced in the dual backbone framework to enhance feature fusion with minimal computational overhead. Experimental results show that the proposed DINOv3-finetuned ViT-small-based YOLO26-large achieved up to a +5.4% mAP50 gain on in-domain images collected in the 2025 season. Moreover, it demonstrated strong cross-domain generalization with mAP50 improvements of +14.0% on the 2021-2023 season dataset and +11.9% on the 2024 season dataset, compared to the standard YOLO26-large. Although the DINOv3-YOLO26-large model has 45.6% more parameters and a 2.9x increase in inference latency, it maintains real-time performance at ~28.5 frames per second (fps). The curated dataset and software programs developed in this study will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。