arXiv:2411.19479cs.CRcs.AI2024-11中稿 · and will appear in…被引 13

提出FLARE方法,有效净化含后门攻击的数据集,应对多种复杂攻击。

FLARE: Toward Universal Dataset Purification against Backdoor Attacks

  • 融合多层异常激活,构建聚类表示
  • 通过自适应子空间选择提升中毒样本分离度
  • 对22种攻击类型均有效,尤其适合复杂后门场景

深度神经网络易受后门攻击,攻击者通过在数据集中植入特定触发器,使模型在特定输入下产生恶意输出。现有净化方法依赖于中毒样本与正常样本在输入-输出空间或最后一层隐藏空间中可分离的假设,但该假设在全对全(A2A)和无目标(UT)攻击下不成立。本文发现分离性在不同隐藏层间存在差异,为此提出通用净化方法FLARE。FLARE聚合所有隐藏层的异常激活构建表征,并设计自适应子空间选择算法,找出最优分割空间将数据分为两簇;再通过评估簇的稳定性,识别更稳定的一簇为中毒样本。在基准数据集上的大量实验表明,FLARE能有效应对22种代表性后门攻击,包括A2O、A2A和UT攻击,且对自适应攻击具有鲁棒性。代码已开源。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) are susceptible to backdoor attacks, where adversaries poison datasets with adversary-specified triggers to implant hidden backdoors, enabling malicious manipulation of model predictions. Dataset purification serves as a proactive defense by removing malicious training samples to prevent backdoor injection at its source. We first reveal that the current advanced purification methods rely on a latent assumption that the backdoor connections between triggers and target labels in backdoor attacks are simpler to learn than the benign features. We demonstrate that this assumption, however, does not always hold, especially in all-to-all (A2A) and untargeted (UT) attacks. As a result, purification methods that analyze the separation between the poisoned and benign samples in the input-output space or the final hidden layer space are less effective. We observe that this separability is not confined to a single layer but varies across different hidden layers. Motivated by this understanding, we propose FLARE, a universal purification method to counter various backdoor attacks. FLARE aggregates abnormal activations from all hidden layers to construct representations for clustering. To enhance separation, FLARE develops an adaptive subspace selection algorithm to isolate the optimal space for dividing an entire dataset into two clusters. FLARE assesses the stability of each cluster and identifies the cluster with higher stability as poisoned. Extensive evaluations on benchmark datasets demonstrate the effectiveness of FLARE against 22 representative backdoor attacks, including all-to-one (A2O), all-to-all (A2A), and untargeted (UT) attacks, and its robustness to adaptive attacks. Codes are available at \href{https://github.com/THUYimingLi/BackdoorBox}{BackdoorBox} and \href{https://github.com/vtu81/backdoor-toolbox}{backdoor-toolbox}.

后门攻击数据净化深度学习安全鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。