评估AlphaEarth在农业任务中的表现,发现其在多个场景下效果优异但存在可解释性不足等问题。
Harvesting AlphaEarth: Benchmarking the Geospatial Foundation Model for Agricultural Downstream Tasks
- 用AlphaEarth生成的遥感嵌入向量,直接用于作物产量、耕作方式和覆盖作物地图等农业任务
- 在局部数据上,其预测性能媲美专门设计的遥感模型,尤其在产量与县尺度耕作映射中表现突出
- 但存在空间泛化能力弱、时间敏感性差、结果难解释等局限,需谨慎应用于农业决策
地理空间基础模型(GFMs)为克服现有特征提取方法的局限提供了新路径。谷歌深脑推出的AlphaEarth Foundation(AEF)利用多源连续时间遥感数据预训练,生成年度全球嵌入数据集,可直接用于分析建模。内部实验显示,AEF嵌入在15项遥感任务中无需微调即超越现有运行模型,但主要集中在土地覆盖与利用分类。将AEF及其他GFM应用于农业监测仍缺乏深入评估。本研究通过整合公开与私有数据,在美国三个农业下游任务中系统评估了AEF嵌入的表现:作物产量预测、耕作方式制图和覆盖作物制图。构建多尺度、多区域数据集,并以传统遥感模型作为对比。结果表明,基于AEF的模型在各项任务中整体表现良好,在本地数据训练下,其产量预测和县级耕作制图性能可媲美专用遥感模型。然而也发现当前AEF嵌入存在空间迁移能力有限、可解释性低、时间响应迟钝等缺陷,提示在对时间敏感性、泛化性和可解释性要求高的农业应用中需保持谨慎。
原文摘要 · Abstract (English)
Geospatial foundation models (GFMs) have emerged as a promising approach to overcoming the limitations in existing featurization methods. More recently, Google DeepMind has introduced AlphaEarth Foundation (AEF), a GFM pre-trained using multi-source EOs across continuous time. An annual and global embedding dataset is produced using AEF that is ready for analysis and modeling. The internal experiments show that AEF embeddings have outperformed operational models in 15 EO tasks without re-training. However, those experiments are mostly about land cover and land use classification. Applying AEF and other GFMs to agricultural monitoring require an in-depth evaluation in critical agricultural downstream tasks. There is also a lack of comprehensive comparison between the AEF-based models and traditional remote sensing (RS)-based models under different scenarios, which could offer valuable guidance for researchers and practitioners. This study addresses some of these gaps by evaluating AEF embeddings in three agricultural downstream tasks in the U.S., including crop yield prediction, tillage mapping, and cover crop mapping. Datasets are compiled from both public and private sources to comprehensively evaluate AEF embeddings across tasks at different scales and locations, and RS-based models are trained as comparison models. AEF-based models generally exhibit strong performance on all tasks and are competitive with purpose-built RS-based models in yield prediction and county-level tillage mapping when trained on local data. However, we also find several limitations in current AEF embeddings, such as limited spatial transferability compared to RS-based models, low interpretability, and limited time sensitivity. These limitations recommend caution when applying AEF embeddings in agriculture, where time sensitivity, generalizability, and interpretability is important.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。