通过聚类加权提升联邦学习性能与隐私保护
Enhancing Federated Learning Through Secure Cluster-Weighted Client Aggregation
- 基于模型差异度与k均值聚类动态分组客户端
- 每组内用置信度生成个性化权重,提升聚合精度
- 适合数据异构严重且注重隐私的分布式场景
联邦学习(FL)作为一种新兴机器学习范式,可在不共享原始数据的前提下实现跨去中心化设备的协同建模。然而,由于用户行为、设备能力和数据分布差异导致的本地数据异构性,带来模型性能偏差、收敛困难及潜在隐私风险。本文提出新框架ClusterGuardFL,利用全局与局部模型间的差异度得分进行k均值聚类,并根据聚类规模分配权重;在每个簇内计算数据点的重构置信度,通过softmax层生成客户端专属权重,用于模型聚合。该方法有效提升了模型鲁棒性与隐私性。实验表明,在多样化数据集上显著改善了模型性能。
原文摘要 · Abstract (English)
Federated learning (FL) has emerged as a promising paradigm in machine learning, enabling collaborative model training across decentralized devices without the need for raw data sharing. In FL, a global model is trained iteratively on local datasets residing on individual devices, each contributing to the model's improvement. However, the heterogeneous nature of these local datasets, stemming from diverse user behaviours, device capabilities, and data distributions, poses a significant challenge. The inherent heterogeneity in federated learning gives rise to various issues, including model performance discrepancies, convergence challenges, and potential privacy concerns. As the global model progresses through rounds of training, the disparities in local data quality and quantity can impede the overall effectiveness of federated learning systems. Moreover, maintaining fairness and privacy across diverse user groups becomes a paramount concern. To address this issue, this paper introduces a novel FL framework, ClusterGuardFL, that employs dissimilarity scores, k-means clustering, and reconciliation confidence scores to dynamically assign weights to client updates. The dissimilarity scores between global and local models guide the formation of clusters, with cluster size influencing the weight allocation. Within each cluster, a reconciliation confidence score is calculated for individual data points, and a softmax layer generates customized weights for clients. These weights are utilized in the aggregation process, enhancing the model's robustness and privacy. Experimental results demonstrate the efficacy of the proposed approach in achieving improved model performance in diverse datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。