arXiv:2409.03183cs.CLcs.AI2024-09被引 1

新攻击方法让恶意触发器骗过防御系统,且能操控多种AI模型输出有害内容。

Bypassing DARCY Defense: Indistinguishable Universal Adversarial Triggers

  • 设计不可区分的触发器,使对抗样本在检测层与正常数据无法区分。
  • 在RNN/CNN模型上使检测准确率下降超40.8%,在BERT上降低34%以上。
  • 可攻破DARCY等防御机制,还让GPT-2生成种族歧视内容。

神经网络分类模型在自然语言处理中易受通用对抗触发器(UAT)攻击,该攻击可使任意输入触发模型产生特定预测结果。DARCY借鉴‘诱饵’概念,通过设置多个陷阱门来有效检测由UAT生成的对抗样本。然而,我们提出一种新的UAT生成方法——IndisUAT,其生成的触发器(即词元)可构造出在DARCY检测层特征分布上与随机选取类别良性样本无法区分的对抗样本。这些对抗样本在受DARCY保护的模型上引发最大预测损失。同时,生成的触发器在文本生成、文本推理和阅读理解等黑盒任务中依然有效。评估显示,IndisUAT可有效绕过DARCY,并突破其他防御机制:在RNN和CNN模型上,检测真阳性率分别至少下降40.8%和90.6%,准确率分别至少降低33.3%和51.6%;在BERT的对抗防御模型上,准确率至少下降34.0%;甚至使GPT-2语言模型在非种族语境下仍输出种族主义内容。

原文摘要 · Abstract (English)

Neural networks (NN) classification models for Natural Language Processing (NLP) are vulnerable to the Universal Adversarial Triggers (UAT) attack that triggers a model to produce a specific prediction for any input. DARCY borrows the "honeypot" concept to bait multiple trapdoors, effectively detecting the adversarial examples generated by UAT. Unfortunately, we find a new UAT generation method, called IndisUAT, which produces triggers (i.e., tokens) and uses them to craft adversarial examples whose feature distribution is indistinguishable from that of the benign examples in a randomly-chosen category at the detection layer of DARCY. The produced adversarial examples incur the maximal loss of predicting results in the DARCY-protected models. Meanwhile, the produced triggers are effective in black-box models for text generation, text inference, and reading comprehension. Finally, the evaluation results under NN models for NLP tasks indicate that the IndisUAT method can effectively circumvent DARCY and penetrate other defenses. For example, IndisUAT can reduce the true positive rate of DARCY's detection by at least 40.8% and 90.6%, and drop the accuracy by at least 33.3% and 51.6% in the RNN and CNN models, respectively. IndisUAT reduces the accuracy of the BERT's adversarial defense model by at least 34.0%, and makes the GPT-2 language model spew racist outputs even when conditioned on non-racial context.

对抗攻击NLP安全模型防御触发器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。