arXiv:2503.06633cs.LGcs.AI2025-03KDD被引 4

提出BTFL方法,在联邦学习测试时平衡个性化与泛化能力。

BTFL: A Bayesian-based Test-Time Generalization Method for Internal and External Data Distributions in Federated learning

  • 基于贝叶斯框架,用双头结构融合全局与本地知识
  • 在多种数据集上提升测试性能,且推理更快
  • 适合应对真实场景中分布漂移的在线联邦学习

联邦学习(FL)允许多个客户端在保护数据隐私的前提下协同训练全局模型。然而,在线部署面临分布偏移和动态测试样本的挑战。个性化联邦学习(PFL)虽能适配各客户端的数据分布,但在测试阶段遇到分布外(OOD)样本时性能下降。现实中,如何在在线测试中兼顾个性化与泛化至关重要,而现有方法多关注训练阶段的泛化。为此,我们提出测试时内/外部分布泛化新范式(TGFL),评估模型在内部分布(IND)与外部分布(EXD)下的适应能力。提出基于贝叶斯的测试时泛化方法BTFL,通过双头架构存储局部与全局知识,并在样本级使用双重贝叶斯框架进行预测融合,结合历史测试数据与当前样本特征,具备理论保障且速度更快。实验表明,BTFL在多个数据集与模型上均取得更优性能,且计算开销更低。代码已公开于https://github.com/ZhouYuCS/BTFL。

原文摘要 · Abstract (English)

Federated Learning (FL) enables multiple clients to collaboratively develop a global model while maintaining data privacy. However, online FL deployment faces challenges due to distribution shifts and evolving test samples. Personalized Federated Learning (PFL) tailors the global model to individual client distributions, but struggles with Out-Of-Distribution (OOD) samples during testing, leading to performance degradation. In real-world scenarios, balancing personalization and generalization during online testing is crucial and existing methods primarily focus on training-phase generalization. To address the test-time trade-off, we introduce a new scenario: Test-time Generalization for Internal and External Distributions in Federated Learning (TGFL), which evaluates adaptability under Internal Distribution (IND) and External Distribution (EXD). We propose BTFL, a Bayesian-based test-time generalization method for TGFL, which balances generalization and personalization at the sample level during testing. BTFL employs a two-head architecture to store local and global knowledge, interpolating predictions via a dual-Bayesian framework that considers both historical test data and current sample characteristics with theoretical guarantee and faster speed. Our experiments demonstrate that BTFL achieves improved performance across various datasets and models with less time cost. The source codes are made publicly available at https://github.com/ZhouYuCS/BTFL .

联邦学习测试时泛化贝叶斯方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。