arXiv:2505.21544cs.CVcs.CL2025-05被引 2

用视觉语言模型结合检测与生成,帮农民精准识别咖啡叶病并推荐环保防治方案。

Vision Meets Language: A RAG-Augmented YOLOv8 Framework for Coffee Disease Diagnosis and Farmer Assistance

  • 融合YOLOv8检测+RAG生成,实现病害图像识别与自然语言诊断
  • 通过检索增强减少大模型幻觉,提供可解释的治疗建议
  • 面向农民设计易用界面,支持实时病害诊断与减药指导

作为社会性存在,人类与环境息息相关,生活方式、健康和食物都依赖农业。传统耕作常导致资源浪费与环境问题。为应对挑战,精准农业应运而生,利用先进技术优化农事流程。本文提出一种融合目标检测、大语言模型(LLM)与检索增强生成(RAG)的混合框架,将视觉与语言模型协同用于树叶片病害识别。该系统采用YOLOv8进行作物病害检测,结合RAG实现上下文感知的诊断,并通过自然语言处理生成可解释的修复建议。有效缓解大模型常见的幻觉问题,支持自适应治疗方案与实时检测。系统提供用户友好的交互界面,农民上传受病叶图像后,可即时获得病害识别结果与减排农药的处置方法,助力降低农药使用、保护生计与生态环境。项目强调可扩展性、可靠性与易用性,旨在推动集成RAG的目标检测系统在农业领域的广泛应用。

原文摘要 · Abstract (English)

As a social being, we have an intimate bond with the environment. A plethora of things in human life, such as lifestyle, health, and food are dependent on the environment and agriculture. It comes under our responsibility to support the environment as well as agriculture. However, traditional farming practices often result in inefficient resource use and environmental challenges. To address these issues, precision agriculture has emerged as a promising approach that leverages advanced technologies to optimise agricultural processes. In this work, a hybrid approach is proposed that combines the three different potential fields of model AI: object detection, large language model (LLM), and Retrieval-Augmented Generation (RAG). In this novel framework, we have tried to combine the vision and language models to work together to identify potential diseases in the tree leaf. This study introduces a novel AI-based precision agriculture system that uses Retrieval Augmented Generation (RAG) to provide context-aware diagnoses and natural language processing (NLP) and YOLOv8 for crop disease detection. The system aims to tackle major issues with large language models (LLMs), especially hallucinations and allows for adaptive treatment plans and real-time disease detection. The system provides an easy-to-use interface to the farmers, which they can use to detect the different diseases related to coffee leaves by just submitting the image of the affected leaf the model will detect the diseases as well as suggest potential remediation methodologies which aim to lower the use of pesticides, preserving livelihoods, and encouraging environmentally friendly methods. With an emphasis on scalability, dependability, and user-friendliness, the project intends to improve RAG-integrated object detection systems for wider agricultural applications in the future.

病害检测视觉语言模型RAG精准农业

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。