arXiv:2604.16574cs.LGcs.AI2026-04

提出一种基于参数重要性评估的联邦个性化方法,提升模型适应性且减少计算负担。

FedOBP: Federated Optimal Brain Personalization through Cloud-Edge Element-wise Decoupling

论文配图:FedOBP: Federated Optimal Brain Personalization through Cloud-Edge Element-wise Decoupling
图 1 · 摘自论文原文
  • 通过元素级重要性评分,自动识别需个性化的参数
  • 仅需少量参数个性化即超越现有方法,在多种异构场景下表现优异
  • 将计算移至服务器端,降低移动端资源压力,适合边缘设备

联邦学习面临客户端数据异构和移动设备资源受限的问题,导致模型精度下降。个性化联邦学习通过将共享全局知识适配到本地数据分布来缓解此问题。其中模型解耦方法将模型分为全局与个性化参数,关键在于确定哪些参数应个性化以平衡全局知识共享与局部适应性。本文提出联邦最优脑个性化(FedOBP)算法,采用分位数阈值机制并引入元素级重要性评分。该评分扩展了最优脑损伤(OBD)剪枝理论,结合泰勒展开中的一阶导数的联邦近似,评估每个参数对个性化的敏感度。此外,将指标计算从客户端迁移至服务器端,减轻资源受限设备负担。据我们所知,这是首个将经典显著性剪枝理论与联邦参数解耦相结合的工作,为基于局部损失景观敏感性的个性化参数选择提供了严格的理论依据。大量实验表明,FedOBP在多种数据集和异构场景下均优于当前最优方法,且只需极少数参数进行个性化。

原文摘要 · Abstract (English)

Federated Learning (FL) faces challenges from client data heterogeneity and resource-constrained mobile devices, which can degrade model accuracy. Personalized Federated Learning (PFL) addresses this issue by adapting shared global knowledge to local data distributions. A promising approach in PFL is model decoupling, which separates the model into global and personalized parameters, raising the key question of which parameters should be personalized to balance global knowledge sharing and local adaptation. In this paper, we propose a Federated Optimal Brain Personalization (FedOBP) algorithm with a quantile-based thresholding mechanism and introduce an element-wise importance score. This score extends Optimal Brain Damage (OBD) pruning theory by incorporating a federated approximation of the first-order derivative in the Taylor expansion to evaluate the importance of each parameter for personalization. Moreover, we move the metric computation originally performed on clients to the server side, to alleviate the burden on resource-constrained mobile devices. To the best of our knowledge, this is the first work to bridge classical saliency-based pruning theory with federated parameter decoupling, providing a rigorous theoretical justification for selecting personalized parameters based on their sensitivity to local loss landscapes. Extensive experiments demonstrate that FedOBP outperforms state-of-the-art methods across diverse datasets and heterogeneity scenarios, while requiring personalization of only a very small number of personalized parameters.

联邦学习个性化模型解耦边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。