用可解释性分析提升太阳耀斑预测模型的可靠性
Large Scale Evaluation of Deep Learning-based Explainable Solar Flare Forecasting Models with Attribution-based Proximity Analysis
- 通过注意力图分析模型决策依据
- 验证模型预测与活跃区特征相关性
- 适合空间天气预报和模型可信度研究者
准确可靠的太阳耀斑预测对地球及空间基础设施至关重要。尽管深度学习模型在该领域表现出较强预测能力,但现有评估多关注准确率,忽视了可解释性和可靠性——这在实际运行中尤为关键。为此,我们提出一种基于邻近性的后处理解释分析框架,用于评估深度学习模型在太阳耀斑预测中的可解释性。研究对比了两个基于全盘视向磁图(LoS)图像训练的模型,在24小时内预测≥M级耀斑的表现。采用引导梯度加权类激活映射(Guided Grad-CAM)生成归因图,并引入一种基于邻近性的量化指标,评估已知兴趣区域下局部解释的准确性和相关性。结果表明,模型预测与活跃区特征存在不同程度关联,揭示其决策行为。该框架提升了太阳耀斑预测中模型可解释性的评估能力,支持更透明、可靠的业务系统开发。
原文摘要 · Abstract (English)
Accurate and reliable predictions of solar flares are essential due to their potentially significant impact on Earth and space-based infrastructure. Although deep learning models have shown notable predictive capabilities in this domain, current evaluations often focus on accuracy while neglecting interpretability and reliability--factors that are especially critical in operational settings. To address this gap, we propose a novel proximity-based framework for analyzing post hoc explanations to assess the interpretability of deep learning models for solar flare prediction. Our study compares two models trained on full-disk line-of-sight (LoS) magnetogram images to predict $\geq$M-class solar flares within a 24-hour window. We employ the Guided Gradient-weighted Class Activation Mapping (Guided Grad-CAM) method to generate attribution maps from these models, which we then analyze to gain insights into their decision-making processes. To support the evaluation of explanations in operational systems, we introduce a proximity-based metric that quantitatively assesses the accuracy and relevance of local explanations when regions of interest are known. Our findings indicate that the models' predictions align with active region characteristics to varying degrees, offering valuable insights into their behavior. This framework enhances the evaluation of model interpretability in solar flare forecasting and supports the development of more transparent and reliable operational systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。