用自然语言对话分析农业地块,让非专业人士也能轻松使用遥感数据。
A Multimodal Conversational Assistant for the Characterization of Agricultural Plots from Geospatial Open Data
- 融合影像、植被指数和文本的多模态检索增强生成
- 在多维度评估中实现清晰且上下文相关的回答
- 开源可复现,适合农业研究与政策制定者使用
日益丰富的开放地球观测(EO)与农业数据为可持续土地管理提供了巨大潜力,但其高技术门槛限制了非专家用户的应用。本研究提出一个开源对话助手,结合多模态检索与大语言模型(LLMs),支持通过自然语言交互访问异构的农业与地理空间数据。该架构融合正射影像、哨兵-2植被指数及用户提供的文档,利用检索增强生成(RAG)机制,灵活决定是否依赖多模态证据、文本知识或两者结合来生成答案。为评估响应质量,采用Qwen3-32B作为零样本、无监督的评判模型,在多维量化评估框架中进行直接打分。初步结果显示,系统能生成清晰、相关且具备上下文感知的回答,同时在不同地理区域具有可复现性和可扩展性。主要贡献包括:融合多模态地球观测与文本知识源的架构设计;通过自然语言交互降低专业农业信息获取门槛;以及开放可复现的设计。
原文摘要 · Abstract (English)
The increasing availability of open Earth Observation (EO) and agricultural datasets holds great potential for supporting sustainable land management. However, their high technical entry barrier limits accessibility for non-expert users. This study presents an open-source conversational assistant that integrates multimodal retrieval and large language models (LLMs) to enable natural language interaction with heterogeneous agricultural and geospatial data. The proposed architecture combines orthophotos, Sentinel-2 vegetation indices, and user-provided documents through retrieval-augmented generation (RAG), allowing the system to flexibly determine whether to rely on multimodal evidence, textual knowledge, or both in formulating an answer. To assess response quality, we adopt an LLM-as-a-judge methodology using Qwen3-32B in a zero-shot, unsupervised setting, applying direct scoring in a multi-dimensional quantitative evaluation framework. Preliminary results show that the system is capable of generating clear, relevant, and context-aware responses to agricultural queries, while remaining reproducible and scalable across geographic regions. The primary contributions of this work include an architecture for fusing multimodal EO and textual knowledge sources, a demonstration of lowering the barrier to access specialized agricultural information through natural language interaction, and an open and reproducible design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。