用群体稳定性指数优化非独立同分布联邦学习,提升模型准确率与公平性。
Clust-PSI-PFL: A Population Stability Index Approach for Clustered Non-IID Personalized Federated Learning
- 基于群体稳定性指数聚类客户端,识别数据分布相似的组别。
- 在六大数据集上比顶尖方法高18%准确率,严重偏斜下公平性提升37%。
- 轻量级设计适合真实场景,尤其适用于标签偏斜的个性化联邦学习。
联邦学习(FL)通过将数据保留在客户端设备上,实现隐私保护的分布式机器学习训练。然而,客户端间数据分布不均(非独立同分布,non-IID)会导致更新偏差并降低性能。为此,我们提出 Clust-PSI-PFL,一种基于聚类的个性化联邦学习框架,利用群体稳定性指数(PSI)量化非IID程度。我们计算加权PSI指标 $WPSI^L$,证明其比常见非IID度量(如Hellinger、Jensen-Shannon和地球移动距离)更具信息量。基于PSI特征,采用K-means++对客户端进行分布一致分组,最优聚类数通过轮廓系数系统确定,通常生成少量聚类且开销低。在六种数据集(表格、图像、文本模态)、两种划分策略(狄利克雷参数 $α$ 与相似性参数 S)及多种客户端规模下,Clust-PSI-PFL 的全局准确率较现有最佳方法最高提升18%,在严重非IID条件下客户公平性相对提升37%。结果表明,以PSI引导的聚类是应对标签偏斜下鲁棒个性化联邦学习的合理且轻量机制。
原文摘要 · Abstract (English)
Federated learning (FL) supports privacy-preserving, decentralized machine learning (ML) model training by keeping data on client devices. However, non-independent and identically distributed (non-IID) data across clients biases updates and degrades performance. To alleviate these issues, we propose Clust-PSI-PFL, a clustering-based personalized FL framework that uses the Population Stability Index (PSI) to quantify the level of non-IID data. We compute a weighted PSI metric, $WPSI^L$, which we show to be more informative than common non-IID metrics (Hellinger, Jensen-Shannon, and Earth Mover's distance). Using PSI features, we form distributionally homogeneous groups of clients via K-means++; the number of optimal clusters is chosen by a systematic silhouette-based procedure, typically yielding few clusters with modest overhead. Across six datasets (tabular, image, and text modalities), two partition protocols (Dirichlet with parameter $α$ and Similarity with parameter S), and multiple client sizes, Clust-PSI-PFL delivers up to 18% higher global accuracy than state-of-the-art baselines and markedly improves client fairness by a relative improvement of 37% under severe non-IID data. These results establish PSI-guided clustering as a principled, lightweight mechanism for robust PFL under label skew.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。