arXiv:2511.22305cs.LG2025-11NeurIPS被引 5

FLUX让联邦学习在数据分布不同时仍高效稳定,无需事先知道分布类型或聚类数。

FLUX: Efficient Descriptor-Driven Clustered Federated Learning under Arbitrary Distribution Shifts

  • 基于客户端描述符提取与无监督聚类,自动适应各类数据分布偏移。
  • 在多个基准上平均提升23个百分点准确率,性能优于现有最佳基线。
  • 支持测试时动态适配新客户,适合真实世界中未知分布的场景。

联邦学习(FL)可在保护数据隐私的前提下实现多客户端协作训练。传统方法通常假设客户端数据独立同分布(IID),但当该假设不成立时,全局模型性能可能显著下降,限制了实际应用。为此,本文提出FLUX,一种新型聚类联邦学习(CFL)框架,可应对训练和测试阶段最常见的四类分布偏移。FLUX通过隐私保护的客户端侧描述符提取与无监督聚类,确保在不同分布偏移程度和类型下具备鲁棒性与可扩展性。与现有CFL方法相比,FLUX无需预先知晓分布偏移类型或客户端聚类数量,且支持测试时自适应,使未标注的新客户端也能受益于最匹配的簇特定模型。在四个标准基准、两个真实世界数据集及十种先进基线上进行的大量实验表明,FLUX在多种分布偏移下显著提升性能与稳定性,平均准确率较最优基线最高提升23个百分点,同时保持与FedAvg相当的计算与通信开销。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative model training across multiple clients while preserving data privacy. Traditional FL methods often use a global model to fit all clients, assuming that clients' data are independent and identically distributed (IID). However, when this assumption does not hold, the global model accuracy may drop significantly, limiting FL applicability in real-world scenarios. To address this gap, we propose FLUX, a novel clustering-based FL (CFL) framework that addresses the four most common types of distribution shifts during both training and test time. To this end, FLUX leverages privacy-preserving client-side descriptor extraction and unsupervised clustering to ensure robust performance and scalability across varying levels and types of distribution shifts. Unlike existing CFL methods addressing non-IID client distribution shifts, FLUX i) does not require any prior knowledge of the types of distribution shifts or the number of client clusters, and ii) supports test-time adaptation, enabling unseen and unlabeled clients to benefit from the most suitable cluster-specific models. Extensive experiments across four standard benchmarks, two real-world datasets and ten state-of-the-art baselines show that FLUX improves performance and stability under diverse distribution shifts, achieving an average accuracy gain of up to 23 percentage points over the best-performing baselines, while maintaining computational and communication overhead comparable to FedAvg.

联邦学习聚类分布偏移隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。