FedPrism通过分层建模提升非独立同分布下的联邦学习性能
FedPrism: Adaptive Personalized Federated Learning under Non-IID Data
- 将客户端模型分解为全局、群组和私有三部分,自动聚类相似用户
- 双流设计根据本地专家置信度动态路由预测,提升个性化能力
- 在高异构数据下显著优于传统方法,适合实际部署场景
联邦学习在真实场景中常面临中到极端的统计异构性(非独立同分布客户端数据),导致性能下降。现有全局聚合策略虽能促进泛化,却难以捕捉局部数据分布差异,影响个性化效果。本文提出FedPrism框架,采用两种核心策略:首先,引入棱镜分解(Prism Decomposition)方法,将每个客户端模型构建为三部分——全局基础、共享群组部分(用于相似客户端)和私有部分(针对独特本地数据),实现用户自动分组并随数据变化自适应调整;其次,设计双流架构,同时运行通用模型与本地专家模型,系统依据专家模型置信度动态决定预测路由。在非独立同分布数据划分下的系统性实验表明,FedPrism超越静态聚合与硬聚类基线,在高异构性条件下取得显著准确率提升,验证其在异构环境中兼具鲁棒性与灵活性,有效平衡通用知识与自适应个性化。
原文摘要 · Abstract (English)
Federated Learning (FL) suffers significant performance degradation in real-world deployments characterized by moderate to extreme statistical heterogeneity (non-IID client data). While global aggregation strategies promote broad generalization, they often fail to capture the diversity of local data distributions, leading to suboptimal personalization. We address this problem with FedPrism, a framework that uses two main strategies. First, it uses a Prism Decomposition method that builds each client's model from three parts: a global foundation, a shared group part for similar clients, and a private part for unique local data. This allows the system to group similar users together automatically and adapt if their data changes. Second, we include a Dual-Stream design that runs a general model alongside a local specialist. The system routes predictions between the general model and the local specialist based on the specialist's confidence. Through systematic experiments on non-IID data partitions, we demonstrate that FedPrism exceeds static aggregation and hard-clustering baselines, achieving significant accuracy gains under high heterogeneity. These results establish FedPrism as a robust and flexible solution for federated learning in heterogeneous environments, effectively balancing generalizable knowledge with adaptive personalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。