arXiv:2410.21453cs.LGcs.CR2024-10被引 3

用数据投毒模拟梯度攻击,仅1%恶意数据即可让模型失效

Inverting Gradient Attacks Makes Powerful Data Poisoning

  • 通过梯度反演重建恶意数据点,实现数据投毒
  • 在非凸神经网络上,1%毒化数据使模型性能降至随机水平
  • 首次证明数据投毒可实现对模型可用性的破坏性攻击

梯度攻击与数据投毒均能恶意干扰机器学习训练过程,在凸设置下已被证明等价。但在非凸设置下,二者造成的危害程度尚不明确。梯度攻击影响范围小但危害大,因其可任意设计;而数据投毒受限于只能注入数据点,如通过合法参与联合数据集。本文在最坏情况下给出肯定回答:数据投毒可模拟梯度攻击,在非凸神经网络上实现可用性攻击。通过梯度反演(gradient inversion)技术,从恶意梯度中重建数据点,足以发动多种攻击。首次实现仅用1%的毒化数据,即能使模型性能降至随机水平,完成可用性攻击。

原文摘要 · Abstract (English)

Gradient attacks and data poisoning tamper with the training of machine learning algorithms to maliciously alter them and have been proven to be equivalent in convex settings. The extent of harm these attacks can produce in non-convex settings is still to be determined. Gradient attacks can affect far less systems than data poisoning but have been argued to be more harmful since they can be arbitrary, whereas data poisoning reduces the attacker's power to only being able to inject data points to training sets, via e.g. legitimate participation in a collaborative dataset. This raises the question of whether the harm made by gradient attacks can be matched by data poisoning in non-convex settings. In this work, we provide a positive answer in a worst-case scenario and show how data poisoning can mimic a gradient attack to perform an availability attack on (non-convex) neural networks. Through gradient inversion, commonly used to reconstruct data points from actual gradients, we show how reconstructing data points out of malicious gradients can be sufficient to perform a range of attacks. This allows us to show, for the first time, an availability attack on neural networks through data poisoning, that degrades the model's performances to random-level through a minority (as low as 1%) of poisoned points.

数据投毒神经网络安全攻防梯度反演

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。