农业遥感模型部署效果差,因数据模态多样且任务结构复杂。
Foundation Models Meet Agriculture: Challenges Beyond Pretraining

- 对比多种模型,发现遥感模型难处理农业多模态数据
- 五维结构分析揭示现有模型泛化能力弱,排名极不稳定
- 为下一代农业专用大模型提供设计方向
全球粮食安全与可持续气候行动越来越依赖于稳健、可扩展的农业监测。地球观测基础模型已在通用遥感领域展现出强大且标签高效的性能,但早期将其应用于农业任务却表现不佳。我们假设这一性能差距源于农业景观的高度异质性,以及当前地球观测基础模型无法适应特定任务的细微差别。本文系统评估了两个关键瓶颈:在七个真实农业数据集上,对比了两种地球观测基础模型、一个面向表格数据的基础模型及传统监督基线,在产量预测、物候估计和作物分类任务中的表现。首先,发现预训练-部署模态不匹配:农业下游任务常需图像以外的多样化数据模态,而地球观测模型架构无法有效处理;反观表格数据基础模型则更自然地适应这种异构性。其次,通过五个结构性轴对农业任务空间进行形式化分析,证明现有模型难以可靠泛化,导致不同评估设置下模型排名高度不稳定。这些结构与模态上的差距揭示了通用架构与专业农业数据之间的摩擦,为下一代领域感知基础模型的发展提供了战略路线图。
原文摘要 · Abstract (English)
Global food security and sustainable climate action increasingly rely on robust, scalable agricultural monitoring. Earth observation foundation models have emerged as powerful, label-efficient tools across general remote sensing domains, yet early attempts to deploy them for agricultural applications have yielded surprisingly poor results. We hypothesize that this performance gap stems from the extreme heterogeneity of agricultural landscapes and the inherent inability of current earth observation foundation models to adapt to task-specific nuances. In this work, we systematically evaluate two critical bottlenecks hindering the deployment of foundation models in agricultural tasks, benchmarking two earth observation foundation models, a foundation model designed for tabular data, and conventional supervised baselines across seven real-world agricultural datasets spanning yield prediction, phenology estimation, and crop classification. First, we identify a pretraining-deployment modality gap: agricultural downstream tasks frequently require diverse, non-imagery data modalities that earth observation foundation models are architecturally unequipped to ingest, while a foundation model built for tabular data handles this heterogeneity more naturally. Second, we formalize the agricultural task space across five structural axes to demonstrate why current models fail to generalize reliably, resulting in highly unstable model rankings across evaluation settings. By characterizing these structural and modal gaps, our insights highlight the friction between general-purpose architectures and specialized agricultural downstream data, providing a strategic roadmap for developing the next generation of domain-aware foundation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。