arXiv:2601.01649cs.LGcs.DC2026-01中稿 · Transactions on Ma…

解决联邦学习中客户端周期参与下的高效AUC优化问题

Communication-Efficient Federated AUC Maximization with Cyclic Client Participation

  • 设计通信高效的算法应对客户端周期性参与的挑战
  • 在平方损失下达到通信复杂度$ ilde{O}(1/ε^{1/2})$,迭代复杂度$ ilde{O}(1/ε)$
  • 适用于医疗影像、欺诈检测等数据不平衡场景

联邦AUC最大化是处理联邦学习中不平衡数据的强大方法。然而,现有方法通常假设所有客户端始终可用,这在现实中难以实现。真实系统中,客户端常按固定周期性轮换参与训练,这对非可分解的AUC目标带来独特优化挑战。本文针对此设定,提出并分析了通信高效的联邦AUC最大化算法。首先,在平方代理损失下,将问题转化为非凸-强凹极小极大优化,利用Polyak-Łojasiewicz (PL) 条件,建立了最优通信复杂度$ ilde{O}(1/ε^{1/2})$和迭代复杂度$ ilde{O}(1/ε)$。其次,对一般成对AUC损失,建立通信复杂度$O(1/ε^3)$和迭代复杂度$O(1/ε^4)$;在PL条件下,复杂度提升至$ ilde{O}(1/ε^{1/2})$和$ ilde{O}(1/ε)$。在图像分类、医学影像和欺诈检测等基准任务上的大量实验验证了所提方法的高效性和有效性。

原文摘要 · Abstract (English)

Federated AUC maximization is a powerful approach for learning from imbalanced data in federated learning (FL). However, existing methods typically assume full client availability, which is rarely practical. In real-world FL systems, clients often participate in a cyclic manner: joining training according to a fixed, repeating schedule. This setting poses unique optimization challenges for the non-decomposable AUC objective. This paper addresses these challenges by developing and analyzing communication-efficient algorithms for federated AUC maximization under cyclic client participation. We investigate two key settings: First, we study AUC maximization with a squared surrogate loss, which reformulates the problem as a nonconvex-strongly-concave minimax optimization. By leveraging the Polyak-Łojasiewicz (PL) condition, we establish a state-of-the-art communication complexity of $\widetilde{O}(1/ε^{1/2})$ and iteration complexity of $\widetilde{O}(1/ε)$. Second, we consider general pairwise AUC losses. We establish a communication complexity of $O(1/ε^3)$ and an iteration complexity of $O(1/ε^4)$. Further, under the PL condition, these bounds improve to communication complexity of $\widetilde{O}(1/ε^{1/2})$ and iteration complexity of $\widetilde{O}(1/ε)$. Extensive experiments on benchmark tasks in image classification, medical imaging, and fraud detection demonstrate the superior efficiency and effectiveness of our proposed methods.

联邦学习AUC优化通信效率周期参与

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。