arXiv:2504.04789cs.AI2025-04被引 3

MA3架构融合多模态信息,实现甘蔗病害智能诊断与决策。

Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making

  • 构建多模态农业代理框架,融合视觉、文本等多源信息
  • 在五项任务上验证性能,支持病害分类、检测与问答
  • 开源数据集与代码,适合农业智能化研究者使用

现代农业面临提高生产效率与可持续发展的双重挑战,气候变化导致极端天气频发,农业生产不确定性急剧上升。为此,本文提出新型多模态农业代理架构(MA3),通过跨模态信息融合与任务协作机制,实现智能农业决策。研究构建了一个包含五项核心任务的多模态农业代理数据集:分类、检测、视觉问答(VQA)、工具选择与代理评估。提出统一骨干网络用于甘蔗病害分类与检测,并开发甘蔗病害专家模型。引入创新工具选择模块,使代理可有效完成分类、检测与VQA任务。此外,建立多维度量化评估框架,在自建数据集上全面验证了MA3在农业场景中的实用性与鲁棒性。本研究为农业智能体发展提供新思路与方法,具有重要理论与实践意义。代码与数据集将在论文接受后公开。

原文摘要 · Abstract (English)

As a strategic pillar industry for human survival and development, modern agriculture faces dual challenges: optimizing production efficiency and achieving sustainable development. Against the backdrop of intensified climate change leading to frequent extreme weather events, the uncertainty risks in agricultural production systems are increasing exponentially. To address these challenges, this study proposes an innovative \textbf{M}ultimodal \textbf{A}gricultural \textbf{A}gent \textbf{A}rchitecture (\textbf{MA3}), which leverages cross-modal information fusion and task collaboration mechanisms to achieve intelligent agricultural decision-making. This study constructs a multimodal agricultural agent dataset encompassing five major tasks: classification, detection, Visual Question Answering (VQA), tool selection, and agent evaluation. We propose a unified backbone for sugarcane disease classification and detection tools, as well as a sugarcane disease expert model. By integrating an innovative tool selection module, we develop a multimodal agricultural agent capable of effectively performing tasks in classification, detection, and VQA. Furthermore, we introduce a multi-dimensional quantitative evaluation framework and conduct a comprehensive assessment of the entire architecture over our evaluation dataset, thereby verifying the practicality and robustness of MA3 in agricultural scenarios. This study provides new insights and methodologies for the development of agricultural agents, holding significant theoretical and practical implications. Our source code and dataset will be made publicly available upon acceptance.

农业智能多模态决策系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。