用概率模型+元学习,让联邦学习在混乱数据下更稳定、更个性化。
Probabilistic Federated Learning on Uncertain and Heterogeneous Data with Model Personalization
- 结合贝叶斯神经网络与元学习,动态适应本地数据不确定性。
- 在CIFAR-10等数据集上测试准确率比现有方法高最多7.42%。
- 适合边缘设备部署,兼顾精度与计算开销,适合物联网场景。
传统联邦学习在异构和不确定的本地数据下易出现训练退化。本文提出Meta-BayFL,一种融合元学习与贝叶斯神经网络(BNN)的个性化概率联邦学习方法,以应对上述挑战。该框架具备三个特性:(1) 客户端采用基于BNN的模型,在隐藏层显式建模不确定性,提升小样本与噪声数据下的训练稳定性;(2) 基于自适应学习率的元学习实现个性化更新,增强非独立同分布(non-IID)条件下的本地训练效果;(3) 统一的概率与个性化设计提升全局模型聚合的鲁棒性。我们提供了理论收敛分析,并给出全局模型在通信轮次上的上界。进一步评估了运行时间、延迟与通信成本,讨论其在边缘节点与物联网系统中的可行性。在CIFAR-10、CIFAR-100和Tiny-ImageNet上的实验表明,Meta-BayFL持续优于主流方法,包括标准与个性化联邦学习(如pFedMe、Ditto、FedFomo),最高测试准确率提升达7.42%。
原文摘要 · Abstract (English)
Conventional federated learning (FL) frameworks often suffer from training degradation due to data uncertainty and heterogeneity across local clients. Probabilistic approaches such as Bayesian neural networks (BNNs) can mitigate this issue by explicitly modeling uncertainty, but they introduce additional runtime, latency, and bandwidth overhead that has rarely been studied in federated settings. To address these challenges, we propose Meta-BayFL, a personalized probabilistic FL method that combines meta-learning with BNNs to improve training under uncertain and heterogeneous data. The framework is characterized by three main features: (1) BNN-based client models incorporate uncertainty across hidden layers to stabilize training on small and noisy datasets, (2) meta-learning with adaptive learning rates enables personalized updates that enhance local training under non-IID conditions, and (3) a unified probabilistic and personalized design improves the robustness of global model aggregation. We provide a theoretical convergence analysis and characterize the upper bound of the global model over communication rounds. In addition, we evaluate computational costs (runtime, latency, and communication) and discuss the feasibility of deployment on resource-constrained devices such as edge nodes and IoT systems. Extensive experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet show that Meta-BayFL consistently outperforms state-of-the-art methods, including both standard and personalized FL approaches (e.g., pFedMe, Ditto, FedFomo), with up to 7.42\% higher test accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。