arXiv:2503.07505cs.LGcs.AI2025-03被引 10

对比中心化与去中心化联邦学习,揭示协议差异带来的性能、隐私与鲁棒性影响

From Centralized to Decentralized Federated Learning: Theoretical Insights, Privacy Preservation, and Robustness Challenges

  • 以聚合方式与联合优化为区分标准,重新梳理两类联邦学习框架
  • 发现去中心化中基于分布式优化的方法研究严重不足
  • 适合关注隐私保护与系统鲁棒性的研究人员参考

联邦学习(FL)允许在不直接共享原始数据的情况下进行协作学习,可采用中心化(基于服务器)或去中心化(点对点)方式实现。本文提出新视角:中心化FL(CFL)与去中心化FL(DFL)的根本区别不在于网络拓扑,而在于训练协议——独立聚合与联合优化。这一协议差异导致模型性能、隐私保护及抗攻击鲁棒性显著不同。我们系统梳理并分类现有CFL与DFL工作,依据其采用的协议类型构建新分类体系,深化对既有研究的理解,并厘清各类方法间的关联与差异。分析发现,尽管分布式优化方法在去中心化场景下具有潜力,但相关探索仍极为有限。本文呼吁更多研究聚焦于利用分布式优化推进联邦学习发展。整体上,本工作全面回顾从中心化到去中心化的联邦学习,揭示核心差异,明确开放挑战与未来方向。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative learning without directly sharing individual's raw data. FL can be implemented in either a centralized (server-based) or decentralized (peer-to-peer) manner. In this survey, we present a novel perspective: the fundamental difference between centralized FL (CFL) and decentralized FL (DFL) is not merely the network topology, but the underlying training protocol: separate aggregation vs. joint optimization. We argue that this distinction in protocol leads to significant differences in model utility, privacy preservation, and robustness to attacks. We systematically review and categorize existing works in both CFL and DFL according to the type of protocol they employ. This taxonomy provides deeper insights into prior research and clarifies how various approaches relate or differ. Through our analysis, we identify key gaps in the literature. In particular, we observe a surprising lack of exploration of DFL approaches based on distributed optimization methods, despite their potential advantages. We highlight this under-explored direction and call for more research on leveraging distributed optimization for federated learning. Overall, this work offers a comprehensive overview from centralized to decentralized FL, sheds new light on the core distinctions between approaches, and outlines open challenges and future directions for the field.

联邦学习去中心化隐私保护优化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。