arXiv:2506.17872cs.LGcs.CV2025-06被引 3

FedNAM+让联邦学习模型既能解释预测,又能准确给出可信度,适合医疗等高要求场景。

Decoding Federated Learning: The FedNAM+ Conformal Revolution

  • 用NAM+新置信区间方法,动态识别关键输入特征并生成像素级不确定性估计。
  • 在MNIST上精度仅损失0.1%,比蒙特卡洛丢包更高效,且提供全局置信区间。
  • 可视化不确定区域,指导数据补充,适合医疗图像等需透明决策的场景。

联邦学习在跨去中心化数据源训练模型方面取得显著进展,但现有框架常缺乏不确定性量化、可解释性与鲁棒性的综合解决方案。为此,我们提出FedNAM+,将神经加法模型(NAMs)与新型置信区间方法结合,实现可解释且可靠的不确定性估计。该方法引入基于梯度的敏感性图,动态调整重要特征层级,支持像素级不确定性分析。相比LIME、SHAP等不提供置信区间的传统方法,FedNAM+可生成预测可靠性可视化结果。我们在CT扫描、MNIST和CIFAR数据集上验证,结果显示预测精度高且损失极小(如MNIST仅0.1%),同时提供透明的不确定性度量。视觉分析揭示了不同区域的不确定性差异,指明模型低置信区,可通过补充数据优化。相较蒙特卡洛丢包,FedNAM+计算开销更低,具备高效全局不确定性估计能力,特别适用于联邦学习场景。总体而言,FedNAM+构建了一个稳健、可解释、高效的框架,增强了分布式建模中的信任与透明度。

原文摘要 · Abstract (English)

Federated learning has significantly advanced distributed training of machine learning models across decentralized data sources. However, existing frameworks often lack comprehensive solutions that combine uncertainty quantification, interpretability, and robustness. To address this, we propose FedNAM+, a federated learning framework that integrates Neural Additive Models (NAMs) with a novel conformal prediction method to enable interpretable and reliable uncertainty estimation. Our method introduces a dynamic level adjustment technique that utilizes gradient-based sensitivity maps to identify key input features influencing predictions. This facilitates both interpretability and pixel-wise uncertainty estimates. Unlike traditional interpretability methods such as LIME and SHAP, which do not provide confidence intervals, FedNAM+ offers visual insights into prediction reliability. We validate our approach through experiments on CT scan, MNIST, and CIFAR datasets, demonstrating high prediction accuracy with minimal loss (e.g., only 0.1% on MNIST), along with transparent uncertainty measures. Visual analysis highlights variable uncertainty intervals, revealing low-confidence regions where model performance can be improved with additional data. Compared to Monte Carlo Dropout, FedNAM+ delivers efficient and global uncertainty estimates with reduced computational overhead, making it particularly suitable for federated learning scenarios. Overall, FedNAM+ provides a robust, interpretable, and computationally efficient framework that enhances trust and transparency in decentralized predictive modeling.

联邦学习可解释性不确定性估计医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。