arXiv:2508.18060cs.LG2025-08被引 5

提出无需假设恶意节点比例的抗拜占庭聚合方法,提升联邦学习鲁棒性。

FedGreed: A Byzantine-Robust Loss-Based Aggregation Method for Federated Learning

  • 基于服务器参考数据集评估客户端损失,按损失排序后贪心选择最优模型
  • 在非独立同分布数据下仍保持收敛,对抗标签翻转和高斯噪声攻击表现优异
  • 适用于真实场景中存在恶意客户端的联邦学习,无需预设恶意比例

联邦学习(FL)可在保护数据隐私的前提下实现多客户端协同建模。本文针对部分客户端可能发起拜占庭攻击的情形,提出一种名为FedGreed的鲁棒聚合策略,该策略不依赖对恶意客户端比例的任何假设。其核心思想是:服务器利用自身持有的参考数据集,评估各客户端本地模型更新的损失,并依据损失值从低到高排序,贪心地选取损失最小的一组客户端模型进行聚合。与现有方法不同,本方法在真实场景常见的非独立同分布(non-IID)数据条件下依然表现稳定,具备收敛性保证和有界的最优性差距。在MNIST、FMNIST和CIFAR-10上的实验表明,相比均值、截断均值、中位数、Krum及Multi-Krum等基线方法,FedGreed在多数恶意攻击场景下(包括标签翻转与高斯噪声注入)均显著更优。所有实验均基于Flower框架完成。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative model training across multiple clients while preserving data privacy by keeping local datasets on-device. In this work, we address FL settings where clients may behave adversarially, exhibiting Byzantine attacks, while the central server is trusted and equipped with a reference dataset. We propose FedGreed, a resilient aggregation strategy for federated learning that does not require any assumptions about the fraction of adversarial participants. FedGreed orders clients' local model updates based on their loss metrics evaluated against a trusted dataset on the server and greedily selects a subset of clients whose models exhibit the minimal evaluation loss. Unlike many existing approaches, our method is designed to operate reliably under heterogeneous (non-IID) data distributions, which are prevalent in real-world deployments. FedGreed exhibits convergence guarantees and bounded optimality gaps under strong adversarial behavior. Experimental evaluations on MNIST, FMNIST, and CIFAR-10 demonstrate that our method significantly outperforms standard and robust federated learning baselines, such as Mean, Trimmed Mean, Median, Krum, and Multi-Krum, in the majority of adversarial scenarios considered, including label flipping and Gaussian noise injection attacks. All experiments were conducted using the Flower federated learning framework.

联邦学习拜占庭鲁棒模型聚合非IID

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。