arXiv:2507.16164cs.CRcs.AI2025-07

通过微调字符让可解释NLP系统误判,同时保持解释不变。

Attacking interpretable NLP systems

  • 基于解释重要性筛选关键词元,仅修改少量字符。
  • 平均改2个字符即使模型准确率大幅下降。
  • 适合研究模型鲁棒性与可解释性安全的学者。

研究表明,机器学习系统在理论和实践中均易受对抗样本攻击。以往攻击多针对视觉模型,利用人机感知差异;而文本模型也面临类似威胁,但现有方法常破坏语义与相似性。本文提出AdvChar,一种针对可解释自然语言处理系统的黑盒攻击,旨在误导分类器同时保持解释与正常输入一致,从而利用系统透明性带来的信任。通过解释导向评分法,识别出对解释影响最大的词元,再以简单的字符级修改最小化原文与新文差异,实现对抗性解释。我们在七个NLP模型和三个解释模型上,使用基准数据集进行测试。实验表明,AdvChar平均仅修改两个字符,即可显著降低深度学习模型的预测准确率。

原文摘要 · Abstract (English)

Studies have shown that machine learning systems are vulnerable to adversarial examples in theory and practice. Where previous attacks have focused mainly on visual models that exploit the difference between human and machine perception, text-based models have also fallen victim to these attacks. However, these attacks often fail to maintain the semantic meaning of the text and similarity. This paper introduces AdvChar, a black-box attack on Interpretable Natural Language Processing Systems, designed to mislead the classifier while keeping the interpretation similar to benign inputs, thus exploiting trust in system transparency. AdvChar achieves this by making less noticeable modifications to text input, forcing the deep learning classifier to make incorrect predictions and preserve the original interpretation. We use an interpretation-focused scoring approach to determine the most critical tokens that, when changed, can cause the classifier to misclassify the input. We apply simple character-level modifications to measure the importance of tokens, minimizing the difference between the original and new text while generating adversarial interpretations similar to benign ones. We thoroughly evaluated AdvChar by testing it against seven NLP models and three interpretation models using benchmark datasets for the classification task. Our experiments show that AdvChar can significantly reduce the prediction accuracy of current deep learning models by altering just two characters on average in input samples.

NLP安全对抗攻击可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。