arXiv:2410.08634cs.LGcs.IT2024-10

用生成式AI提升联邦学习的个性化与可解释性

GAI-Enabled Explainable Personalized Federated Semi-Supervised Learning

  • 用生成式AI从无标签数据中提取知识,辅助本地模型训练
  • 融合本地与全局模型,实现个性化与知识共享的平衡
  • 通过决策树和t-SNE可视化,让模型决策过程透明可读

联邦学习(FL)是移动用户(MUs)训练人工智能(AI)模型的常见分布式算法,但在实际应用中面临标签稀缺、非独立同分布(non-IID)数据及不可解释性等挑战。为此,我们提出一种可解释的个性化联邦学习框架XPFL。首先,提出一种生成式AI(GAI)辅助的个性化联邦半监督学习方法GFed:在本地训练中,利用GAI模型从大量无标签数据中学习,并通过基于知识蒸馏的半监督学习,将GAI提取的知识用于训练本地FL模型;在全局聚合阶段,以特定比例融合本地与全局模型,使各本地模型既吸收全局知识,又保持个性化特征。其次,提出一种可解释性AI机制XFed:在本地训练中,使用决策树匹配本地FL模型的输入输出;在全局聚合后,采用t-SNE对本地模型进行可视化对比。仿真结果验证了所提XPFL框架的有效性。

原文摘要 · Abstract (English)

Federated learning (FL) is a commonly distributed algorithm for mobile users (MUs) training artificial intelligence (AI) models, however, several challenges arise when applying FL to real-world scenarios, such as label scarcity, non-IID data, and unexplainability. As a result, we propose an explainable personalized FL framework, called XPFL. First, we introduce a generative AI (GAI) assisted personalized federated semi-supervised learning, called GFed. Particularly, in local training, we utilize a GAI model to learn from large unlabeled data and apply knowledge distillation-based semi-supervised learning to train the local FL model using the knowledge acquired from the GAI model. In global aggregation, we obtain the new local FL model by fusing the local and global FL models in specific proportions, allowing each local model to incorporate knowledge from others while preserving its personalized characteristics. Second, we propose an explainable AI mechanism for FL, named XFed. Specifically, in local training, we apply a decision tree to match the input and output of the local FL model. In global aggregation, we utilize t-distributed stochastic neighbor embedding (t-SNE) to visualize the local models before and after aggregation. Finally, simulation results validate the effectiveness of the proposed XPFL framework.

联邦学习生成式AI可解释性半监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。