提出首个野火预测专用基础模型,揭示评估方式对结果影响极大
Does Your Wildfire Prediction Model Actually Work, or Just Score Well?

- 构建专用于野火预测的WILDFIRE-FM模型,融合气象、火点、地形等多源数据
- 在匹配规则下对比10个基线模型,发现评估设计显著影响性能结论
- 提出固定合约评估框架,适合关注野火预测可靠性的研究者使用
野火预测对早期预警和资源调配至关重要,但现有地球基础模型(Earth FMs)主要预训练于通用大气与地物物理目标,而非野火预测。为填补这一空白,我们提出WILDFIRE-FM,首个专为野火预测设计的基础模型,利用气象、实时火点观测、地形、植被及静态环境数据进行预训练。然而,仅引入领域专用骨干网络仍无法解决评估难题:野火事件在时空上分布稀疏,导致迁移结论高度依赖匹配规则与评估设置。为此,我们提出一种固定合约评估框架,包含两项受控检验:固定输出检验以评估匹配规则的影响,固定特征检验以分析头选择的影响。在一致合约下,我们在占用率、蔓延、检索和回归任务中对比了WILDFIRE-FM与十个地球基础模型基线。结果表明,野火迁移结论强烈依赖于评估设计与任务设定。我们希望该框架与WILDFIRE-FM能为未来野火专用地球基础模型研究与基准测试奠定基础。代码已公开于https://anonymous.4open.science/r/Wildfire-fm-evaluation-contracts-5AE9/。
原文摘要 · Abstract (English)
Wildfire prediction is important for early warning and resource allocation, yet existing Earth foundation models (Earth FMs) are pretrained for general atmospheric and geophysical objectives rather than wildfire forecasting. To address this gap, we introduce WILDFIRE-FM, the first foundation model pretrained specifically for wildfire prediction using weather, active-fire observations, topography, vegetation, and static environmental data. However, introducing a domain-specific backbone alone does not solve the evaluation problem: wildfire events are sparse in space and time, making transfer conclusions highly sensitive to matching rules and evaluation settings. To address this problem, we introduce a fixed-contract evaluation framework with two controlled checks: a fixed-output check for matching-rule effects and a fixed-feature check for head-selection effects. Under matched contracts, we compare WILDFIRE-FM with ten Earth-FM baselines across occupancy, spread, retrieval, and regression tasks. Our results show that wildfire transfer conclusions depend strongly on evaluation design and task formulation. We hope this framework and WILDFIRE-FM provide a foundation for future wildfire-specific Earth-FM research and benchmarking. Our code is available at https://anonymous.4open.science/r/Wildfire-fm-evaluation-contracts-5AE9/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。