提出新聚合方法ArKrum,提升联邦学习抗恶意攻击能力
Secure and Private Federated Learning: Achieving Adversarial Resilience through Robust Aggregation
- 用中位数过滤剔除异常更新,再估算恶意客户端数
- 多轮更新平均提升稳定性,跨数据分布场景表现优
- 适合对抗性环境下的隐私保护机器学习系统
联邦学习(FL)可在不共享原始数据的前提下,实现分布式数据上的协同建模,是隐私保护人工智能的有力方案。然而,其易受恶意参与方(即拜占庭客户端)的攻击,这些客户端会发送误导性更新以破坏全局模型。传统平均法对此类攻击缺乏鲁棒性,而如Krum等更稳健的方法需预先知道恶意客户端数量,这在实际中难以满足。为此,我们提出Average-rKrum(ArKrum),一种新型聚合策略,兼顾鲁棒性与隐私保障。基于先前工作rKrum,ArKrum引入两项创新:一是采用中位数过滤机制,在估计恶意客户端数量前剔除极端异常值;二是实施多更新平均方案,提升在非同质数据分布下的稳定性和性能。我们在图像与文本基准数据集上,针对三种常见拜占庭攻击类型评估ArKrum,结果表明其始终维持高准确率与稳定性,表现优于或相当其他鲁棒聚合方法。实验验证了ArKrum在对抗性环境中作为安全联邦学习的有效且实用解决方案。
原文摘要 · Abstract (English)
Federated Learning (FL) enables collaborative machine learning across decentralized data sources without sharing raw data. It offers a promising approach to privacy-preserving AI. However, FL remains vulnerable to adversarial threats from malicious participants, referred to as Byzantine clients, who can send misleading updates to corrupt the global model. Traditional aggregation methods, such as simple averaging, are not robust to such attacks. More resilient approaches, like the Krum algorithm, require prior knowledge of the number of malicious clients, which is often unavailable in real-world scenarios. To address these limitations, we propose Average-rKrum (ArKrum), a novel aggregation strategy designed to enhance both the resilience and privacy guarantees of FL systems. Building on our previous work (rKrum), ArKrum introduces two key innovations. First, it includes a median-based filtering mechanism that removes extreme outliers before estimating the number of adversarial clients. Second, it applies a multi-update averaging scheme to improve stability and performance, particularly when client data distributions are not identical. We evaluate ArKrum on benchmark image and text datasets under three widely studied Byzantine attack types. Results show that ArKrum consistently achieves high accuracy and stability. It performs as well as or better than other robust aggregation methods. These findings demonstrate that ArKrum is an effective and practical solution for secure FL systems in adversarial environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。