arXiv:2507.00259cs.LG2025-07

提出细粒度信任机制,让联邦学习客户端按例判断是否信任他人预测。

Whom to Trust? Adaptive Collaboration in Personalized Federated Learning

  • 基于每个样本的共识与置信度动态调整损失权重和伪标签贡献。
  • 在多种非独立同分布场景下超越主流联邦与个性化方法,且优于本地与中心化训练。
  • 无需共享参数或数据,在半监督框架中实现自适应协作,适合高异构数据场景。

数据异质性是联邦学习(FL)的核心挑战,尤其当客户端不仅分布不同,且对个别样本的预测可靠性也存在差异时。尽管个性化联邦学习(PFL)旨在应对此问题,我们发现许多现有PFL方法无法超越本地训练和集中式训练这两个基准,表明有意义的个性化仅在特定区间有效:全局模型不足,但跨客户端协作仍有价值。我们的实证研究揭示了该区间的两个关键要素:协作的自适应性与细粒度的信任机制(以单个样本为单位)。我们证明,这些特性可在联邦半监督学习中实现,客户端通过共享一个公共未标记数据集上的预测结果来达成共识。在此框架下,客户端可选择性地采纳公共意见,或自行判断,无需共享模型参数或原始数据。为此,我们提出了FEDMOSAIC,一种个性化的协同训练方法,其根据每样本的共识度和置信度重新加权损失及伪标签贡献。FEDMOSAIC在多种非独立同分布设置下均显著优于强基线,并在标准平滑性、有界方差和漂移假设下证明了收敛性。相较于多数基线,它还优于本地训练与集中式训练。这明确了联邦个性化有效的边界条件,以及细粒度信任感知协作如何促成其成功。

原文摘要 · Abstract (English)

Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their predictions across individual examples. While personalized FL (PFL) aims to address this, we observe that many PFL methods fail to outperform two necessary baselines, local training and centralized training. This suggests that meaningful personalization only emerges in a narrow regime, where global models are insufficient, but collaboration across clients still holds value. Our empirical findings point to two key ingredients for success in this regime: adaptivity in collaboration and fine-grained trust, at the level of individual examples. We show that these properties can be achieved within federated semi-supervised learning, where clients exchange predictions over a shared unlabeled dataset. This enables each client to align with public consensus when it is helpful, and disregard it when it is not, without sharing model parameters or raw data. As a concrete realization of this idea, we develop FEDMOSAIC, a personalized co-training method where clients reweight their loss and their contribution to pseudo-labels based on per-example agreement and confidence. FEDMOSAIC outperforms strong FL and PFL baselines across a range of non-IID settings, and we prove convergence under standard smoothness, bounded-variance, and drift assumptions. In contrast to many of these baselines, it also outperforms local and centralized training. These results clarify when federated personalization can be effective, and how fine-grained, trust-aware collaboration enables it.

联邦学习个性化信任机制半监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。