arXiv:2602.07671cs.LG2026-02被引 2

Feroma通过数据分布画像实现抗分布偏移与漂移的联邦学习。

Federated Learning with Profile Mapping under Distribution Shifts and Drifts

  • 用客户端数据分布画像替代身份识别,实现隐私保护下的动态聚合
  • 在6个基准上平均比最优基线高12个百分点,且通信开销接近FedAvg
  • 适合真实场景中未知客户、数据随时间漂移的联邦学习任务

联邦学习(FL)可在不共享原始数据的前提下实现跨客户端的分布式模型训练,但在现实数据异质性下性能下降。现有方法通常无法同时应对客户端间分布偏移和随时间的数据漂移,或依赖于已知客户端聚类数和异质类型等不切实际的假设,限制了泛化能力。本文提出Feroma,一种新型联邦学习框架,无需依赖客户端或聚类身份信息,显式处理分布偏移与漂移。Feroma基于客户端分布画像——本地数据的紧凑、隐私保护表示——通过自适应相似性加权引导模型聚合与测试时模型分配。该设计使Feroma在训练中动态选择聚合策略(从聚类到个性化),并在无需重训练、在线适应或先验知识的情况下,为未见过的、无标签测试客户端部署合适模型。大量实验表明,相比10种先进方法,Feroma在动态数据异质条件下提升性能与稳定性:在6个基准上平均准确率提升达12个百分点,且计算与通信开销与FedAvg相当。结果表明,基于分布画像的聚合为应对分布偏移与漂移提供了实用的鲁棒联邦学习路径。

原文摘要 · Abstract (English)

Federated Learning (FL) enables decentralized model training across clients without sharing raw data, but its performance degrades under real-world data heterogeneity. Existing methods often fail to address distribution shift across clients and distribution drift over time, or they rely on unrealistic assumptions such as known number of client clusters and data heterogeneity types, which limits their generalizability. We introduce Feroma, a novel FL framework that explicitly handles both distribution shift and drift without relying on client or cluster identity. Feroma builds on client distribution profiles-compact, privacy-preserving representations of local data-that guide model aggregation and test-time model assignment through adaptive similarity-based weighting. This design allows Feroma to dynamically select aggregation strategies during training, ranging from clustered to personalized, and deploy suitable models to unseen, and unlabeled test clients without retraining, online adaptation, or prior knowledge on clients' data. Extensive experiments show that compared to 10 state-of-the-art methods, Feroma improves performance and stability under dynamic data heterogeneity conditions-an average accuracy gain of up to 12 percentage points over the best baselines across 6 benchmarks-while maintaining computational and communication overhead comparable to FedAvg. These results highlight that distribution-profile-based aggregation offers a practical path toward robust FL under both data distribution shifts and drifts.

联邦学习分布偏移动态适应隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。