arXiv:2606.27215cs.AI2026-06

用遗传算法生成更隐蔽的对抗文本,让语言模型误判

Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Text

  • 用遗传算法结合GloVe嵌入,黑盒生成语义相近的对抗文本
  • 在多个数据集上使模型准确率从76.8%降至5.8%,优于现有方法
  • 适合研究模型安全或对抗攻击的工程师与研究人员

深度学习模型在多个领域表现优异,但在自然语言处理中仍易受对抗输入影响,可能造成严重现实后果。现有攻击多通过微小、语义相近的词替换来欺骗模型,部分方法依赖对模型内部结构的访问。本文提出GAversary,一种混合遗传算法,在仅需模型输出logit值的情况下,即可作为黑盒攻击生成对抗文本。该方法利用GloVe嵌入设计突变算子,提升对抗样本的语义相似度。在多个基准数据集和主流模型上测试显示,GAversary显著降低模型准确率,最佳情况下将76.8%准确率降至5.8%,优于BAE和A2T攻击。代价是扰动词数略多(约两倍),语义相似度稍低,运行时间增加约5%。

原文摘要 · Abstract (English)

Deep learning models have achieved impressive performance across various fields but remain vulnerable to adversarial inputs, particularly in NLP, where such attacks can have significant real-world consequences. Adversarial attacks often involve small, semantically similar token replacements to fool NLP models, and recent methods have become more precise by targeting specific vulnerable words, often by exploiting some level of access to the model's internal structure. This paper proposes GAversary, a hybrid Genetic Algorithm (GA) to generate adversarial attacks on natural language models. The GA is able to treat the target model as a black box, requiring only the logit value output by the model to guide the search. GAversary differs from GAs previously proposed for this problem by using GloVe embeddings to propose word replacements (the mutation operator) to improve the semantic similarity of the adversarial examples. GAversary is applied to several benchmark data sets and well-known target models. GAversary is able to substantially reduce the target model's accuracy on test data compared to the BAE and A2T attacks compared against (in the best case, reducing a 76.8% accuracy to 5.8%, compared to BAE's 27.6%). The trade-off is that GAversary perturbs just under twice as many words as the other two methods, with a slightly lower semantic similarity to the original text and around a 5% increase in run-time.

对抗攻击遗传算法自然语言黑盒攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。