WeedNet 实现千种杂草实时识别,支持本地化精准适配。
WeedNet: A Foundation Model-Based Global-to-Local AI Approach for Real-Time Weed Species Identification and Classification
- 基于自监督学习与全局-局部策略,构建端到端识别流程。
- 全球模型达91.02%准确率,本地微调后84种杂草达97.38%准确率。
- 适用于无人机、地爬机器人及农业咨询智能系统。
早期杂草识别对有效管理至关重要,计算机视觉与人工智能正被用于自动化该过程;然而,专家验证数据有限及形态特征多变阻碍了模型发展。为此,我们提出WeedNet,一种可识别广泛杂草种类的全局性识别模型。WeedNet是端到端的实时识别流程,采用自监督学习、微调及增强可信度策略。在1,593种杂草上实现91.02%准确率,其中41%的物种达到100%准确率。通过微调,本地Iowa WeedNet模型在84种本地杂草上实现97.38%整体准确率。跨种内差异与种间相似性的测试表明,涵盖所有生长阶段和植物特性的图像多样性对模型性能至关重要。全局WeedNet作为基础模型,其全局-局部策略支持针对区域杂草群落的精准微调。无人机与地面巡检车图像的额外验证表明WeedNet具备集成至机器人平台的潜力。此外,与人工智能结合的对话功能可为农民、研究人员及政府部门提供智能农业与生态保育咨询工具,适用于多样地貌。
原文摘要 · Abstract (English)
Early weed identification is crucial for effective management and control, and researchers, agronomists, and technology developers are increasingly interested in automating this process using computer vision and artificial intelligence; however, limited expert-verified data and variable morphological features have hindered the development of AI-based weed identification models. To address these issues, we present WeedNet, a global-scale weed identification model that can recognize an extensive set of weed species. WeedNet is an end-to-end real-time weed identification pipeline that uses self-supervised learning, fine-tuning, and enhanced trustworthiness strategies. WeedNet achieved 91.02% accuracy across 1,593 weed species, with 41% of species achieving 100% accuracy. Using a fine-tuning approach, the local Iowa WeedNet model achieved 97.38% overall accuracy for 84 Iowa weeds. Testing across intra-species dissimilarity and inter-species similarity suggests that diversity in the collected image, spanning all growth stages and distinct plant characteristics, is crucial to driving model performance. The global WeedNet model serves as a foundation, and the global-to-local strategy enables targeted fine-tuning to improve performance in regional weed communities. Additional validation of drone- and ground-rover-based images highlights WeedNet's potential for integration into robotic platforms. Furthermore, integration with artificial intelligence for conversational use provides intelligent agricultural and ecological conservation consulting tools for farmers, researchers, and government agencies across diverse landscapes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。