提出统一框架,让去中心化联邦学习更公平且抗恶意攻击。
DFedReweighting: A Unified Framework for Objective-Oriented Reweighting in Decentralized Federated Learning
- 通过本地小数据集评估性能,动态调整客户端权重
- 实测显著提升公平性与拜占庭鲁棒性,支持多目标优化
- 适合关注模型公平性与系统安全的实践者
去中心化联邦学习(DFL)允许多个客户端在无中心服务器情况下协作训练模型,但面临公平性和拜占庭鲁棒性挑战。本文提出 extbf{DFedReweighting},一种在每轮训练末尾通过目标导向重加权实现多样学习目标的统一聚合框架。针对每个客户端,先基于从本地数据构建的紧凑辅助数据集评估目标性能指标(TPM),生成初步权重;再通过定制化重加权策略(CRS)优化,得到最终权重。理论上,我们证明了合适的 TPM-CRS 组合能保证对一般 $L$-光滑且强凸函数的线性收敛。实验表明,该方法在多种场景下显著提升公平性与抗拜占庭攻击能力。两个多目标示例进一步验证:通过合理设计 TPM 与 CRS,可支持跨客户端和客户端内多种学习目标。代码已开源。
原文摘要 · Abstract (English)
Decentralized federated learning (DFL) has emerged as a promising paradigm that enables multiple clients to collaboratively train machine learning models through iterative rounds of local training, communication, and aggregation, without relying on a central server. Nevertheless, DFL systems continue to face a range of challenges, including fairness and Byantine robustness. To address these challenges, we propose \textbf{DFedReweighting}, a unified aggregation framework that achieves diverse learning objectives in DFL via objective-oriented reweighting at the final step of each learning round. Specifically, for each client, the framework first evaluates a target performance metric (TPM) on a compact auxiliary dataset constructed from local data, yielding preliminary aggregation weights, which are subsequently refined by a customized reweighting strategy (CRS) to produce the final aggregation weights. Theoretically, we prove that an appropriate TPM-CRS combination guarantees linear convergence for general $L$-smoothand strongly convex functions. Empirical results consistently demonstrate that \textbf{DFedReweighting} significantly improves fairness and robustness against Byzantine attacks across diverse settings. Two multi-objective examples, spanning tasks across and within clients, further establish that a broad range of desired learning objectives can be accommodated by appropriately designing the TPM and CRS. Our code is available at https://github.com/KaichuangZhang/DFedReweighting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。