无需训练,用现成大模型就能让机器写作像真人。
Your Language Model Can Secretly Write Like Humans: Contrastive Paraphrase Attacks on LLM-Generated Text Detectors
- 用精心设计指令引导大模型生成类人文本
- 通过对比学习消除文本中的机器特征,提升隐蔽性
- 适合研究检测漏洞或对抗攻击的学者使用
大型语言模型(LLMs)的滥用(如学术抄袭)催生了文本检测器。为绕过检测,现有改写攻击需大量数据与算力训练专用改写器,且面对先进检测算法时效果大幅下降。为此,我们提出无需训练的对比改写攻击(CoPA),利用现成大模型实现高效欺骗。首先通过精细指令引导模型生成更类人的文本;但发现模型固有统计偏差仍会残留机器特征,被检测器捕捉。为此,CoPA构建辅助的机器类词汇分布,与模型生成的人类分布对比,在解码时减去机器特征,使输出更难被识别。理论分析表明该方法优势显著,大量实验验证其在多种场景下可有效欺骗文本检测器。
原文摘要 · Abstract (English)
The misuse of large language models (LLMs), such as academic plagiarism, has driven the development of detectors to identify LLM-generated texts. To bypass these detectors, paraphrase attacks have emerged to purposely rewrite these texts to evade detection. Despite the success, existing methods require substantial data and computational budgets to train a specialized paraphraser, and their attack efficacy greatly reduces when faced with advanced detection algorithms. To address this, we propose \textbf{Co}ntrastive \textbf{P}araphrase \textbf{A}ttack (CoPA), a training-free method that effectively deceives text detectors using off-the-shelf LLMs. The first step is to carefully craft instructions that encourage LLMs to produce more human-like texts. Nonetheless, we observe that the inherent statistical biases of LLMs can still result in some generated texts carrying certain machine-like attributes that can be captured by detectors. To overcome this, CoPA constructs an auxiliary machine-like word distribution as a contrast to the human-like distribution generated by the LLM. By subtracting the machine-like patterns from the human-like distribution during the decoding process, CoPA is able to produce sentences that are less discernible by text detectors. Our theoretical analysis suggests the superiority of the proposed attack. Extensive experiments validate the effectiveness of CoPA in fooling text detectors across various scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。