用可解释AI改关键词,让AI文本更难被识破。
Explainability-Based Token Replacement on LLM-Generated Text
- 用SHAP/LIME找出影响检测的关键词汇
- 替换这些词后单模型检测准确率下降40%以上
- 多模型集成检测仍有效,适合安全防护场景
生成式模型(如大语言模型)虽能产出类人文本,但常有可被识别的模式。本文首先训练一个集成分类器以区分AI生成文本(AIGT)与人类文本,再利用SHAP和LIME识别对分类结果影响最大的标记(token)。提出四种基于可解释性的标记替换策略,修改这些关键标记。实验表明,该方法显著削弱单一检测模型的识别能力,但在多语言、多领域下,集成分类器仍保持高精度,证明多模型策略能有效应对标记级混淆。研究揭示了可解释AI在隐藏AIGT中的潜力,同时也凸显了构建鲁棒集成检测系统的重要性。
原文摘要 · Abstract (English)
Generative models, especially large language models (LLMs), have shown remarkable progress in producing text that appears human-like. However, they often exhibit patterns that make their output easier to detect than text written by humans. In this paper, we investigate how explainable AI (XAI) methods can be used to reduce the detectability of AI-generated text (AIGT) while also introducing a robust ensemble-based detection approach. We begin by training an ensemble classifier to distinguish AIGT from human-written text, then apply SHAP and LIME to identify tokens that most strongly influence its predictions. We propose four explainability-based token replacement strategies to modify these influential tokens. Our findings show that these token replacement approaches can significantly diminish a single classifier's ability to detect AIGT. However, our ensemble classifier maintains strong performance across multiple languages and domains, showing that a multi-model approach can mitigate the impact of token-level manipulations. These results show that XAI methods can make AIGT harder to detect by focusing on the most influential tokens. At the same time, they highlight the need for robust, ensemble-based detection strategies that can adapt to evolving approaches for hiding AIGT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。