arXiv:2503.04231cs.LGcs.AI2025-03被引 1

提出无需调参的自动聚类联邦学习方法,提升个性化模型训练效率。

One-Shot Clustering for Federated Learning

  • 基于梯度余弦相似度与温度检测,自动识别聚类时机。
  • 在3个数据集上30+任务中表现稳定,无需人工调整超参数。
  • 适合资源受限且数据异构的分布式场景,可快速部署。

联邦学习(FL)是一种去中心化学习范式,允许多个客户端在不直接传输数据的情况下联合训练模型。自2015年提出以来,已发展出多个子领域,如处理数据异构性或资源分配等问题。其中,聚类联邦学习(CFL)致力于将客户端分组以提供个性化模型。尽管已有少数成果,但该领域仍处于探索阶段,因基本假设和设置不同于标准FL。本文提出一种无须预设聚类的“一次性聚类联邦学习”(OCFL)算法,能自动检测最早合适的聚类时刻。该算法通过计算客户端梯度间的余弦相似度及温度指标,判断联邦模型是否开始收敛。我们在三个基准数据集上对超过三十项任务测试了多种一次性聚类算法,实验证明该方法可在无需调参的情况下实现自动化CFL,性能优异。

原文摘要 · Abstract (English)

Federated Learning (FL) is a widespread and well adopted paradigm of decentralized learning that allows training one model from multiple sources without the need to directly transfer data between participating clients. Since its inception in 2015, it has been divided into numerous sub-fields that deal with application-specific issues, be it data heterogeneity or resource allocation. One such sub-field, Clustered Federated Learning (CFL), is dealing with the problem of clustering the population of clients into separate cohorts to deliver personalized models. Although few remarkable works have been published in this domain, the problem is still largely unexplored, as its basic assumption and settings are slightly different from standard FL. In this work, we present One-Shot Clustered Federated Learning (OCFL), a clustering-agnostic algorithm that can automatically detect the earliest suitable moment for clustering. Our algorithm is based on the computation of cosine similarity between gradients of the clients and a temperature measure that detects when the federated model starts to converge. We empirically evaluate our methodology by testing various one-shot clustering algorithms for over thirty different tasks on three benchmark datasets. Our experiments showcase the good performance of our approach when used to perform CFL in an automated manner without the need to adjust hyperparameters.

联邦学习聚类自动化个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。