arXiv:2411.07850cs.CLcs.AI2024-11被引 2

用反语生成对抗文本,暴露情感分析模型的脆弱性。

IAE: Irony-based Adversarial Examples for Sentiment Analysis Systems

  • 通过反语改写句子,让模型误解真实情感
  • 多个主流模型在反语攻击下准确率显著下降
  • 人类比模型更难被反语误导,适合安全测试

对抗样本是通过微小但不可察觉的扰动诱导模型出错的输入,对深度神经网络的可靠性与安全性构成严重威胁。尽管图像等连续数据领域的对抗攻击研究已很充分,但文本的离散特性带来了独特挑战。本文提出基于反语的对抗样本(IAE),将直白句子转化为反语句以生成对抗文本。该方法利用反语这一修辞手法——字面意义与真实意图相反,需深层语境理解才能识别。实现需精准定位评价词、替换为恰当搭配,并添加合适的反语元素,同时保持语义连贯。本研究有三项关键贡献:(1)提出不依赖预设反语语料库的IAE方法,适用于多种NLP任务;(2)验证多个先进深度学习模型在情感分析任务上经受IAE攻击后性能显著下降,凸显当前NLP系统对反语类攻击的脆弱性;(3)对比发现人类对反语影响的敏感度低于现有NLP系统。

原文摘要 · Abstract (English)

Adversarial examples, which are inputs deliberately perturbed with imperceptible changes to induce model errors, have raised serious concerns for the reliability and security of deep neural networks (DNNs). While adversarial attacks have been extensively studied in continuous data domains such as images, the discrete nature of text presents unique challenges. In this paper, we propose Irony-based Adversarial Examples (IAE), a method that transforms straightforward sentences into ironic ones to create adversarial text. This approach exploits the rhetorical device of irony, where the intended meaning is opposite to the literal interpretation, requiring a deeper understanding of context to detect. The IAE method is particularly challenging due to the need to accurately locate evaluation words, substitute them with appropriate collocations, and expand the text with suitable ironic elements while maintaining semantic coherence. Our research makes the following key contributions: (1) We introduce IAE, a strategy for generating textual adversarial examples using irony. This method does not rely on pre-existing irony corpora, making it a versatile tool for creating adversarial text in various NLP tasks. (2) We demonstrate that the performance of several state-of-the-art deep learning models on sentiment analysis tasks significantly deteriorates when subjected to IAE attacks. This finding underscores the susceptibility of current NLP systems to adversarial manipulation through irony. (3) We compare the impact of IAE on human judgment versus NLP systems, revealing that humans are less susceptible to the effects of irony in text.

对抗样本情感分析反语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。