arXiv:2504.21775cs.LGcs.AI2025-04IJCAI被引 2

解决联邦学习中性能与公平性的异构权衡问题,提升全局和本地模型表现。

Learning Heterogeneous Performance-Fairness Trade-offs in Federated Learning

  • 根据客户端特性自适应采样偏好,捕捉不同本地权衡曲线差异。
  • 融合各客户端超网络,使全局权衡曲线性能更优,超越7个基线方法。
  • 理论证明收敛速度快,适合存在数据异构的联邦学习场景。

现有方法利用超网络处理联邦学习中的性能-公平性权衡,将客户端偏好映射到权衡曲线上的特定模型(局部帕累托前沿)。但这些方法通常采用统一的偏好采样分布训练超网络,忽略了客户端间局部帕累托前沿的固有异质性;同时,从泛化角度出发,未考虑局部与全局帕累托前沿在全局数据集上的差距。为解决上述问题,本文提出HetPFL,可有效学习局部与全局帕累托前沿。HetPFL包含偏好采样自适应(PSA)和偏好感知超网络融合(PHF)两部分:PSA为每个客户端自适应确定最优偏好采样分布,以适配其异质性局部帕累托前沿;PHF则实现偏好感知的客户端超网络融合,保障全局帕累托前沿性能。我们证明了在弱于现有方法的假设下,HetPFL的收敛速度为线性。在四个数据集上的大量实验表明,相较于七个基线,HetPFL在学习到的局部与全局帕累托前沿质量上均有显著提升。

原文摘要 · Abstract (English)

Recent methods leverage a hypernet to handle the performance-fairness trade-offs in federated learning. This hypernet maps the clients' preferences between model performance and fairness to preference-specifc models on the trade-off curve, known as local Pareto front. However, existing methods typically adopt a uniform preference sampling distribution to train the hypernet across clients, neglecting the inherent heterogeneity of their local Pareto fronts. Meanwhile, from the perspective of generalization, they do not consider the gap between local and global Pareto fronts on the global dataset. To address these limitations, we propose HetPFL to effectively learn both local and global Pareto fronts. HetPFL comprises Preference Sampling Adaptation (PSA) and Preference-aware Hypernet Fusion (PHF). PSA adaptively determines the optimal preference sampling distribution for each client to accommodate heterogeneous local Pareto fronts. While PHF performs preference-aware fusion of clients' hypernets to ensure the performance of the global Pareto front. We prove that HetPFL converges linearly with respect to the number of rounds, under weaker assumptions than existing methods. Extensive experiments on four datasets show that HetPFL significantly outperforms seven baselines in terms of the quality of learned local and global Pareto fronts.

联邦学习公平性权衡优化超网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。