用可解释AI选出关键数据,让联邦学习更高效
FedXDS: Leveraging Model Attribution Methods to counteract Data Heterogeneity in Federated Learning

- 用归因方法找出对任务重要的数据特征
- 在不同客户端间选择性共享数据,准确率更高且收敛更快
- 既保护隐私又防数据泄露,适合医疗等敏感场景
近年来,可解释人工智能(XAI)在识别驱动深度学习决策的关键输入特征方面表现优异,提升了模型透明度。然而,其在联邦学习等邻近领域的潜力尚未被充分探索。本文首次提出将XAI应用于联邦学习:尽管联邦学习可在不共享原始数据的情况下协作训练模型,但当客户端数据分布存在统计异质性时性能会下降。我们提出FedXDS(基于XAI引导的数据共享的联邦学习),是首个利用特征归因技术精确识别应跨客户端选择性共享的数据元素的方法。通过基于传播的归因机制,仅需一次反向传播即可识别任务相关特征,实现客户端贡献对齐。为保护敏感信息,引入度量隐私技术,在保障实用性的同时提供形式化隐私保证。实验表明,该方法在不同客户端数量和异质性设置下均显著提升准确率并加速收敛。理论分析给出了隐私保障,并实证验证了对成员推断和特征逆向攻击的鲁棒性。代码已开源。
原文摘要 · Abstract (English)
Explainable AI (XAI) methods have demonstrated significant success in recent years at identifying relevant features in input data that drive deep learning model decisions, enhancing interpretability for users. However, the potential of XAI beyond providing model transparency has remained largely unexplored in adjacent machine learning domains. In this paper, we show for the first time how XAI can be utilized in the context of federated learning. Specifically, while federated learning enables collaborative model training without raw data sharing, it suffers from performance degradation when client data distributions exhibit statistical heterogeneity. We introduce FedXDS (Federated Learning via XAI-guided Data Sharing), the first approach to utilize feature attribution techniques to identify precisely which data elements should be selectively shared between clients to mitigate heterogeneity. By employing propagation-based attribution, our method identifies task-relevant features through a single backward pass, enabling selective data sharing that aligns client contributions. To protect sensitive information, we incorporate metric privacy techniques that provide formal privacy guarantees while preserving utility. Experimental results demonstrate that our approach consistently achieves higher accuracy and faster convergence compared to existing methods across varying client numbers and heterogeneity settings. We provide theoretical privacy guarantees and empirically demonstrate robustness against both membership inference and feature inversion attacks. Code is available at https://github.com/MaxH1996/FedXDS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。