融合气候、管理与遥感数据,用视觉变压器精准预测葡萄园产量。
CMAViT: Integrating Climate, Managment, and Remote Sensing Data for Crop Yield Estimation with Multimodel Vision Transformers
- 用多模态视觉变压器整合遥感图像、气象数据和管理文本。
- 在500万株葡萄树上测试,R2达0.84,MAPE为8.22%。
- 强调管理实践对极端产量预测的关键作用,适合农业AI研究者。
作物产量预测对农业规划至关重要,但受天气、气候与管理措施复杂交互影响,仍具挑战。本文提出基于深度学习的多模态模型CMAViT,用于像素级葡萄园产量预测。CMAViT融合遥感影像与短期气象数据,捕捉生长季变化,并通过交叉注意力编码器将文本形式的管理实践与时序数据建模结合。在2016-2019年覆盖2200公顷、八种葡萄品种、超500万株葡萄树的大规模数据集上验证,显著优于传统模型(如UNet-ConvLSTM),在空间变异性和极端值预测上表现优异。测试集上取得R²=0.84,MAPE=8.22%。模态遮蔽实验表明:剔除管理信息、气候数据或二者,R²分别降至0.73、0.70、0.72,MAPE升至11.92%、12.66%、12.39%,凸显各模态重要性。代码开源于https://github.com/plant-ai-biophysics-lab/CMAViT。
原文摘要 · Abstract (English)
Crop yield prediction is essential for agricultural planning but remains challenging due to the complex interactions between weather, climate, and management practices. To address these challenges, we introduce a deep learning-based multi-model called Climate-Management Aware Vision Transformer (CMAViT), designed for pixel-level vineyard yield predictions. CMAViT integrates both spatial and temporal data by leveraging remote sensing imagery and short-term meteorological data, capturing the effects of growing season variations. Additionally, it incorporates management practices, which are represented in text form, using a cross-attention encoder to model their interaction with time-series data. This innovative multi-modal transformer tested on a large dataset from 2016-2019 covering 2,200 hectares and eight grape cultivars including more than 5 million vines, outperforms traditional models like UNet-ConvLSTM, excelling in spatial variability capture and yield prediction, particularly for extreme values in vineyards. CMAViT achieved an R2 of 0.84 and a MAPE of 8.22% on an unseen test dataset. Masking specific modalities lowered performance: excluding management practices, climate data, and both reduced R2 to 0.73, 0.70, and 0.72, respectively, and raised MAPE to 11.92%, 12.66%, and 12.39%, highlighting each modality's importance for accurate yield prediction. Code is available at https://github.com/plant-ai-biophysics-lab/CMAViT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。