用气象数据预训练模型,提升极端气候下作物产量预测准确率
VITA: Variational Pretraining of Transformers for Climate-Robust Crop Yield Forecasting
- 通过气象变量作为代理目标进行变分预训练,学习季节性大气状态表征
- 在763个县的玉米大豆预测中表现最优,极端年份提升显著(p<0.0001)
- 无需土壤数据且计算量小,适合数据稀缺地区的实际应用
准确的作物产量预测对全球粮食安全至关重要。然而,当前人工智能模型在产量偏离历史趋势时表现显著下降。我们将其归因于缺乏直接关联大气状态与产量的丰富、物理可解释的数据集。为此,本文提出VITA(用于非对称数据的变分推断变压器),一种基于大规模卫星气象数据预训练的框架,将学到的表征迁移到有限的地面观测数据上用于产量预测。VITA在预训练阶段使用详细的气象变量作为代理目标,并在季节性感知的正弦先验下学习预测潜在大气状态。这使得模型可在部署时仅用少量气象统计量进行微调。应用于美国玉米带763个县,VITA在所有评估场景下均达到最先进性能,尤其在极端年份提升显著(配对t检验,p < 0.0001)。重要的是,VITA在无需土壤数据的情况下超越了GNN-RNN等先前框架,且相比更大基础模型(如Chronos-Bolt)消耗更少算力,具备实际部署可行性,尤其适用于数据稀缺地区。本工作表明,领域感知的AI设计可突破数据限制,支持气候变化下的韧性农业预测。
原文摘要 · Abstract (English)
Accurate crop yield forecasting is essential for global food security. However, current AI models systematically underperform when yields deviate from historical trends. We attribute this to the lack of rich, physically grounded datasets directly linking atmospheric states to yields. To address this, we introduce VITA (Variational Inference Transformer for Asymmetric Data), a variational pretraining framework that learns representations from large satellite-based weather datasets and transfers to the ground-based limited measurements available for yield prediction. VITA is trained using detailed meteorological variables as proxy targets during pretraining and learns to predict latent atmospheric states under a seasonality-aware sinusoidal prior. This allows the model to be fine-tuned using limited weather statistics during deployment. Applied to 763 counties in the US Corn Belt, VITA achieves state-of-the-art performance in predicting corn and soybean yields across all evaluation scenarios, particularly during extreme years, with statistically significant improvements (paired t-test, p < 0.0001). Importantly, VITA outperforms prior frameworks like GNN-RNN without soil data, and larger foundational models (e.g., Chronos-Bolt) with less compute, making it practical for real-world use, especially in data-scarce regions. This work highlights how domain-aware AI design can overcome data limitations and support resilient agricultural forecasting in a changing climate.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。