用反事实生成新数据,提升气候异常下作物生长预测准确率
Augmenting The Weather: A Hybrid Counterfactual-SMOTE Algorithm for Improving Crop Growth Prediction When Climate Changes
- 结合反事实生成与SMOTE,合成气候异常样本
- 在2018年欧洲干旱数据上,预测误差降低23%
- 适合农业AI研究者应对极端气候数据不足问题
近年来,气候变化导致极端天气频发,对农业等经济部门造成严重影响。人工智能本应助力应对气候挑战,但现有机器学习方法依赖历史数据分布,难以处理分布外的异常事件。本文提出一种新型数据增强方法——基于反事实的SMOTE(CFA-SMOTE),将可解释AI中的实例级反事实生成与经典不平衡数据处理方法SMOTE结合,生成代表气候异常事件的合成数据点,以扩充训练集。实验在2018年欧洲干旱及饲草危机背景下,针对爱尔兰奶牛牧场的牧草生长预测任务进行,对比不同类别不平衡比率下的基准方法。结果表明,该方法显著提升预测性能,平均误差下降23%。
原文摘要 · Abstract (English)
In recent years, humanity has begun to experience the catastrophic effects of climate change as economic sectors (such as agriculture) struggle with unpredictable and extreme weather events. Artificial Intelligence (AI) should help us handle these climate challenges but its most promising solutions are not good at dealing with climate-disrupted data; specifically, machine learning methods that work from historical data-distributions, are not good at handling out-of-distribution, outlier events. In this paper, we propose a novel data augmentation method, that treats the predictive problems around climate change as being, in part, due to class-imbalance issues; that is, prediction from historical datasets is difficult because, by definition, they lack sufficient minority-class instances of "climate outlier events". This novel data augmentation method -- called Counterfactual-Based SMOTE (CFA-SMOTE) -- combines an instance-based counterfactual method from Explainable AI (XAI) with the well-known class-imbalance method, SMOTE. CFA-SMOTE creates synthetic data-points representing outlier, climate-events that augment the dataset to improve predictive performance. We report comparative experiments using this CFA-SMOTE method, comparing it to benchmark counterfactual and class-imbalance methods under different conditions (i.e., class-imbalance ratios). The focal climate-change domain used relies on predicting grass growth on Irish dairy farms, during Europe-wide drought and forage crisis of 2018.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。