arXiv:2410.06509cs.LG2024-10被引 2

攻击者可绕过联邦学习公平机制,悄悄让模型偏袒特定群体

PFAttack: Stealthy Attack Bypassing Group Fairness in Federated Learning

  • 通过局部微调恢复敏感属性依赖,实现隐蔽攻击
  • 模型准确率不变但明显偏袒特定群体,攻击成功率超90%
  • 适合研究公平性防御的学者和安全评估人员

联邦学习(FL)通过引入群体公平机制,使多个客户端协作训练出对不同敏感属性群体(如性别、种族)决策无偏的全局模型。由于其分布式特性,已有研究证明FL易受模型投毒攻击。然而,这些研究多聚焦于降低准确率,未解决关键问题:攻击者能否绕过公平机制,操纵全局模型产生偏见?为此,本文提出利润驱动的公平性攻击(PFAttack),旨在不降低准确率的前提下绕过公平机制。核心思路是:公平机制会弱化输出对敏感属性的依赖,而攻击者可通过在各敏感群体上进行本地微调,重建这种依赖关系,生成一个既保持高准确率又具偏见的恶意模型,并通过模型替换注入系统。相比针对准确率的攻击,该方法更隐蔽——恶意模型参数变化细微,能有效规避拜占庭鲁棒聚合的检测与过滤。在四个公平联邦学习框架和三种拜占庭鲁棒聚合算法上,基于基准数据集的大量实验验证了PFAttack的有效性与隐蔽性。

原文摘要 · Abstract (English)

Federated learning (FL), integrating group fairness mechanisms, allows multiple clients to collaboratively train a global model that makes unbiased decisions for different populations grouped by sensitive attributes (e.g., gender and race). Due to its distributed nature, previous studies have demonstrated that FL systems are vulnerable to model poisoning attacks. However, these studies primarily focus on perturbing accuracy, leaving a critical question unexplored: Can an attacker bypass the group fairness mechanisms in FL and manipulate the global model to be biased? The motivations for such an attack vary; an attacker might seek higher accuracy, yet fairness considerations typically limit the accuracy of the global model or aim to cause ethical disruption. To address this question, we design a novel form of attack in FL, termed Profit-driven Fairness Attack (PFAttack), which aims not to degrade global model accuracy but to bypass fairness mechanisms. Our fundamental insight is that group fairness seeks to weaken the dependence of outputs on input attributes related to sensitive information. In the proposed PFAttack, an attacker can recover this dependence through local fine-tuning across various sensitive groups, thereby creating a biased yet accuracy-preserving malicious model and injecting it into FL through model replacement. Compared to attacks targeting accuracy, PFAttack is more stealthy. The malicious model in PFAttack exhibits subtle parameter variations relative to the original global model, making it robust against detection and filtering by Byzantine-resilient aggregations. Extensive experiments on benchmark datasets are conducted for four fair FL frameworks and three Byzantine-resilient aggregations against model poisoning, demonstrating the effectiveness and stealth of PFAttack in bypassing group fairness mechanisms in FL.

联邦学习公平性攻击模型投毒隐私安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。