主动选客户端,让联邦学习更快更公平。
Choose Wisely and Privately: Proactive Client Selection for Fair and Efficient Federated Learning

- 基于差分隐私统计表计算特征相关性,提前筛选优质客户端。
- 在四个数据集上训练速度更快,准确率提升5%-12%,且避免群体不公平。
- 适合对公平性和效率要求高的实际联邦学习场景。
联邦学习可在不传输数据的前提下,实现分布式数据协同建模。基于平均的联邦学习受限于非独立同分布(non-IID)数据,导致收敛慢、准确率低。传统方法多为被动处理,对噪声大或异构严重的客户端仍执行昂贵梯度计算,最终被丢弃或降权,浪费算力、增加通信轮次并暴露隐私。本文提出一种主动客户端选择框架,在训练前就构建满足性能与公平性要求的最优客户端组合。方法通过差分隐私保护的列联表计算互信息,量化联合数据集中跨特征的相关性。定义潜在联盟损失(PFL),在固定规模的客户端组合中平衡整体数据效用与跨特征公平性。将客户端选择建模为最优子集搜索问题,采用模拟退火求解,并保证客户端本地统计信息的强差分隐私。在四个基准数据集上的实验表明,相比均匀采样,即使使用最先进的自适应聚合或采样策略,本方法仍能实现更快收敛、更高准确率(提升5%-12%)和更公平的模型表现。
原文摘要 · Abstract (English)
Federated Learning enables collaborative model training across decentralized data sources without data transfer. Averaging-based FL is limited by the presence of non-IID data, which negatively impacts convergence speed and final model accuracy. Conventional alternatives suffer from significant inefficiency. Clients with noisy or highly heterogeneous data contribute expensive gradient computations that are either discarded or heavily down-weighted before aggregation. These reactive approaches waste computational resources, require more communication rounds and result in unnecessary privacy exposure. In this paper, we propose a proactive client selection framework that aims to find an optimal federation of clients whose combined data match utility and fairness requirements before training begins. Our method relies on mutual information computed from differentially private contingency tables to quantify the relevance of cross-feature correlations in the union dataset. We introduce a Potential Federation Loss (PFL) over the set of fixed-size federations, which balances two objectives. Maximizing collective data utility while ensuring fair cross-features correlations to prevent group unfairness. Client selection is expressed as an optimal subset search problem over the PFL objective, which we solve using simulated annealing under strong differential privacy guarantees for clients' local statistics. Experimental results on four benchmarks show faster, fairer, and more accurate models trained on optimally found federations, compared to uniform sampling, even when state-of-the-art adaptive aggregation or sampling strategies are employed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。