通过预筛选相似数据客户,提升联邦学习个性化效果与隐私安全。
PQFed: A Privacy-Preserving Quality-Controlled Federated Learning Framework
- 训练前基于聚类分析客户数据相似性,定制化选择协作伙伴。
- 在CIFAR-10和MNIST上,小参与规模下模型准确率提升显著。
- 适合数据异构性强、参与方有限的隐私敏感场景使用。
联邦学习可在不共享原始数据的前提下实现协同建模,但数据异构性持续影响全局模型性能。传统优化方法通常依赖全体客户端参与全局训练,再进行本地微调。本文提出PQFed,一种新型隐私保护的个性化联邦学习框架,在联邦训练前即开展早期质量控制。该框架从各客户端原始数据中提取代表性特征,运用聚类技术估计客户端间数据分布相似性,并据此实施客户端选择策略,使每个客户端仅与数据分布兼容者协作。我们在两个基准数据集CIFAR-10与MNIST上,集成三种现有联邦学习算法进行评估。实验结果表明,即便参与者数量有限,PQFed仍能持续提升目标客户端的模型性能。与基线聚类算法IFCA对比,PQFed在低参与度场景下也表现更优。这些发现凸显了PQFed在个性化联邦学习中的可扩展性与有效性。
原文摘要 · Abstract (English)
Federated learning enables collaborative model training without sharing raw data, but data heterogeneity consistently challenges the performance of the global model. Traditional optimization methods often rely on collaborative global model training involving all clients, followed by local adaptation to improve individual performance. In this work, we focus on early-stage quality control and propose PQFed, a novel privacy-preserving personalized federated learning framework that designs customized training strategies for each client prior to the federated training process. PQFed extracts representative features from each client's raw data and applies clustering techniques to estimate inter-client dataset similarity. Based on these similarity estimates, the framework implements a client selection strategy that enables each client to collaborate with others who have compatible data distributions. We evaluate PQFed on two benchmark datasets, CIFAR-10 and MNIST, integrated with three existing federated learning algorithms. Experimental results show that PQFed consistently improves the target client's model performance, even with a limited number of participants. We further benchmark PQFed against a baseline cluster-based algorithm, IFCA, and observe that PQFed also achieves better performance in low-participation scenarios. These findings highlight PQFed's scalability and effectiveness in personalized federated learning settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。