用影响函数定位毒化数据,仅需一个中毒样本即可精准清除攻击影响。
Delta-Influence: Unlearning Poisons via Influence Functions
- 通过数据变换引发影响分数坍塌,识别中毒训练数据。
- 在三个数据集上对三种攻击均实现最佳去学习效果。
- 适合需要高可靠性模型的工业部署场景。
为应对数据完整性挑战,如训练后消除数据毒化的影响,本文提出Δ-影响(Δ-Influence)方法。现有影响函数(如EK-FAC、TRAK)难以准确归因异常模型行为至具体中毒样本;传统去学习算法在仅知少数中毒样本时也难有效消除影响。Δ-影响利用影响函数,仅需一个中毒测试样本,通过数据变换切断中毒样本与受损测试点的关联,同时保持干净数据不变。该变换导致中毒样本的影响分数大幅下降,形成“影响坍塌”现象,从而精准定位中毒训练数据。通过重训练移除这些样本,可有效消除数据毒化影响。我们在三个视觉任务数据集上验证了三种毒化攻击,对比五种检测算法和五种去学习策略,结果表明Δ-影响在所有设置下均表现最优,展现出影响函数在纠错去学习中的潜力。代码已开源:https://github.com/Ruby-a07/delta-influence
原文摘要 · Abstract (English)
Addressing data integrity challenges, such as unlearning the effects of data poisoning after model training, is necessary for the reliable deployment of machine learning models. State-of-the-art influence functions, such as EK-FAC and TRAK, often fail to accurately attribute abnormal model behavior to the specific poisoned training data responsible for the data poisoning attack. In addition, traditional unlearning algorithms often struggle to effectively remove the influence of poisoned samples, particularly when only a few affected examples can be identified. To address these challenge, we introduce $Δ$-Influence, a novel approach that leverages influence functions to trace abnormal model behavior back to the responsible poisoned training data using as little as just one poisoned test example. $Δ$-Influence applies data transformations that sever the link between poisoned training data and compromised test points without significantly affecting clean data. This allows $Δ$-Influence to detect large negative shifts in influence scores following data transformations, a phenomenon we term as influence collapse, thereby accurately identifying poisoned training data. Unlearning this subset, e.g. through retraining, effectively eliminates the data poisoning. We validate our method across three vision-based poisoning attacks and three datasets, benchmarking against five detection algorithms and five unlearning strategies. We show that $Δ$-Influence consistently achieves the best unlearning across all settings, showing the promise of influence functions for corrective unlearning. Our code is publicly available at: https://github.com/Ruby-a07/delta-influence
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。