构建农业害虫结构化数据集并优化小模型,实现田间精准害虫识别与决策支持。
AgriPestDatabase-v1.0: A Structured Insect Dataset for Training Agricultural Large Language Model
- 基于专家审核的9种害虫数据构建结构化Q/A对,保障信息准确性。
- 微调后Mistral 7B模型在专业问答任务中达88.9%通过率,显著优于同类模型。
- 适合农村无网环境部署,为农户提供轻量高效智能害虫管理工具。
农业害虫管理越来越依赖及时准确的专业知识,但高质量标注数据和持续专家支持仍有限,尤其在互联网不稳定或无网络的农村地区。与此同时,人工智能与大模型的快速发展为将实用决策支持工具直接交付给农业用户提供了新可能,可通过轻量化、可部署的系统实现。本文解决两个问题:(i) 构建结构化的昆虫信息数据集;(ii) 通过微调将轻量级LLM(≤7B)适配用于边缘设备的农业害虫管理。文本数据从选定的9种害虫相关数据库及发表文献中收集,并经领域专家审核验证。据此生成用于模型训练与评估的Q/A对。采用基于LoRA的微调方法,在多个轻量级LLM上进行测试。初步评估显示,Mistral 7B在领域特定Q/A任务中达到88.9%的通过率,显著优于Qwen 2.5 7B(63.9%)和LLaMA 3.1 8B(58.7%)。值得注意的是,尽管Mistral的词汇重叠率较低(BLEU: 0.097),其语义对齐度更高(嵌入相似性:0.865),表明在专业领域中,语义理解与推理能力比表面一致性更关键。通过结合专家组织数据、结构化Q/A对、语义质量控制与高效模型适配,本工作推动了面向农户的农业决策支持工具发展,并验证了在田间部署紧凑高性能语言模型的可行性。
原文摘要 · Abstract (English)
Agricultural pest management increasingly relies on timely and accurate access to expert knowledge, yet high quality labeled data and continuous expert support remain limited, particularly for farmers operating in rural regions with unstable/no internet connectivity. At the same time, the rapid growth of AI and LLMs has created new opportunities to deliver practical decision support tools directly to end users in agriculture through compact and deployable systems. This work addresses (i) generating a structured insect information dataset, and (ii) adapting a lightweight LLM model ($\leq$ 7B) by fine tuning it for edge device uses in agricultural pest management. The textual data collection was done by reviewing and collecting information from available pest databases and published manuscripts on nine selected pest species. These structured reports were then reviewed and validated by a domain expert. From these reports, we constructed Q/A pairs to support model training and evaluation. A LoRA-based fine-tuning approach was applied to multiple lightweight LLMs and evaluated. Initial evaluation shows that Mistral 7B achieves an 88.9\% pass rate on the domain-specific Q/A task, substantially outperforming Qwen 2.5 7B (63.9\%), and LLaMA 3.1 8B (58.7\%). Notably, Mistral demonstrates higher semantic alignment (embedding similarity: 0.865) despite lower lexical overlap (BLEU: 0.097), indicating that semantic understanding and robust reasoning are more predictive of task success than surface-level conformity in specialized domains. By combining expert organized data, well-structured Q/A pairs, semantic quality control, and efficient model adaptation, this work contributes towards providing support for farmer facing agricultural decision support tools and demonstrates the feasibility of deploying compact, high-performing language models for practical field-level pest management guidance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。