arXiv:2409.15126cs.CRcs.LG2024-09被引 4

UTrace可追踪隐私训练中作恶数据提供者,保障模型安全可信。

UTrace: Poisoning Forensics for Private Collaborative Learning

  • 通过梯度相似性识别异常更新模式,定位潜在投毒行为。
  • 在四个数据集上对十种攻击实现高精度检测,误报率低。
  • 无需泄露隐私即可追溯责任方,适合需要审计的协同学习场景。

隐私保护机器学习(PPML)系统通过安全多方计算(MPC)等密码协议,使多个数据所有者可在不暴露原始敏感数据的前提下协同训练模型。尽管PPML提供了强隐私保障,但也引入了新攻击面:恶意数据所有者可隐蔽注入投毒数据,破坏模型完整性。现有防御机制如私有输入验证虽能缓解部分攻击,但难以应对隐蔽或分布式攻击。为增强PPML系统鲁棒性,亟需事后审计机制以建立问责机制。本文提出UTrace框架,实现用户级溯源,在不破坏MPC隐私的前提下,将模型异常归因于具体数据提供者。UTrace包含两个核心机制:基于梯度相似性的异常更新识别方法,以及用户级不可知技术,用于量化每个用户对模型行为的边际影响。两者结合可高精度定位作恶用户。我们在兼容MPC的训练与审计流水线中实现该框架,并在视觉、文本和恶意软件四类数据集上评估其效果。在十种典型投毒攻击下,UTrace均表现出高检测准确率与低误报率。

原文摘要 · Abstract (English)

Privacy-preserving machine learning (PPML) systems enable multiple data owners to collaboratively train models without revealing their raw, sensitive data by leveraging cryptographic protocols such as secure multi-party computation (MPC). While PPML offers strong privacy guarantees, it also introduces new attack surfaces: malicious data owners can inject poisoned data into the training process without being detected, thus undermining the integrity of the learned model. Although recent defenses, such as private input validation within MPC, can mitigate some specific poisoning strategies, they remain insufficient, particularly in preventing stealthy or distributed attacks. As the robustness of PPML remains an open challenge, strengthening trust in these systems increasingly necessitates post-hoc auditing mechanisms that instill accountability. In this paper we present UTrace, a framework for user-level traceback in PPML that attributes integrity failures to responsible data owners without compromising the privacy guarantees of MPC. UTrace encapsulates two mechanisms: a gradient similarity method that identifies suspicious update patterns linked to poisoning, and a user-level unlearning technique that quantifies each user's marginal influence on model behavior. Together, these methods allow UTrace to attribute model misbehavior to specific users with high precision. We implement UTrace within an MPC-compatible training and auditing pipeline and evaluate its effectiveness on four datasets spanning vision, text, and malware. Across ten canonical poisoning attacks, UTrace consistently achieves high detection accuracy with low false positive rates.

隐私计算投毒攻击模型审计溯源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。