用去中心化网络提升联邦学习抗干扰能力,让每个客户端自主筛选可信模型更新。
Don't Reach for the Stars: Rethinking Topology for Resilient Federated Learning
- 采用点对点拓扑,客户端基于本地验证集计算更新间语义一致性得分
- 在五大数据集上,极端异构和对抗环境下客户端性能显著优于中心化与现有去中心方法
- 支持个性化聚合与正则化,适合数据分布差异大或存在恶意客户端的场景
联邦学习(FL)可在保护数据隐私的前提下实现分布式客户端协同训练。传统方法依赖中心化的星型拓扑,由中央服务器聚合客户端模型更新,但存在单点故障、个性化能力弱、对数据分布偏移敏感及易受异常客户端影响等问题。此外,中心化方法通常依据低层参数差异选择更新,当客户端数据非独立同分布时可靠性下降,且客户端缺乏控制权。本文提出一种去中心化的点对点(P2P)联邦学习框架LIGHTYEAR,利用P2P拓扑灵活性,使每个客户端能够识别并聚合一组可信且有益的更新。其核心是基于本地验证集计算的协议得分,该得分衡量更新在函数空间中与客户端参考模型的语义对齐程度。客户端据此选择个性化更新子集,并引入正则化项以稳定训练。在五个数据集上的实证评估表明,该方法在客户端层面性能持续优于中心化基线与现有去中心方法,尤其在对抗性与高度异构条件下表现突出。
原文摘要 · Abstract (English)
Federated learning (FL) enables collaborative model training across distributed clients while preserving data privacy by keeping data local. Traditional FL approaches rely on a centralized, star-shaped topology, where a central server aggregates model updates from clients. However, this architecture introduces several limitations, including a single point of failure, limited personalization, and poor robustness to distribution shifts or vulnerability to malfunctioning clients. Moreover, update selection in centralized FL often relies on low-level parameter differences, which can be unreliable when client data is not independent and identically distributed, and offer clients little control. In this work, we propose a decentralized, peer-to-peer (P2P) FL framework. It leverages the flexibility of the P2P topology to enable each client to identify and aggregate a personalized set of trustworthy and beneficial updates.This framework is the Local Inference Guided Aggregation for Heterogeneous Training Environments to Yield Enhancement Through Agreement and Regularization (LIGHTYEAR). Central to our method is an agreement score, computed on a local validation set, which quantifies the semantic alignment of incoming updates in the function space with respect to the clients reference model. Each client uses this score to select a tailored subset of updates and performs aggregation with a regularization term that further stabilizes the training. Our empirical evaluation across five datasets shows that the proposed approach consistently outperforms both, centralized baselines and existing P2P methods in terms of client-level performance, particularly under adversarial and heterogeneous conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。