给大模型生成文本加不可见水印,能精准识别假内容。
Signal Watermark on Large Language Models
- 用信号处理方法在生成时嵌入水印,保持文本质量
- 检测准确率高,AUROC达0.97,远超现有方法
- 适合需要内容溯源的AI安全场景
随着大语言模型(LLMs)日益复杂,虚假新闻和学术滥用等安全问题日益突出。现有检测方法依赖困惑度和突发性波动,且计算开销大。本文提出一种基于预定义信号模式的水印技术,在LLM生成文本时嵌入特定水印。该方法利用LLMs与快速傅里叶变换(FFT)进行词元概率计算和水印检测,将信号处理原理引入文本生成,实现对人类不可见但可检测的水印嵌入,同时保持文本质量和语法正确性。实验验证表明,该方法在多个LLM上均保持高检测精度,即使在不同温度设置下也稳定有效。在区分人工撰写与水印文本的任务中,本方法获得0.97的AUROC,显著优于GPTZero的0.64。水印在多种攻击场景下仍具鲁棒性,有效应对生成内容认证的关键挑战。
原文摘要 · Abstract (English)
As Large Language Models (LLMs) become increasingly sophisticated, they raise significant security concerns, including the creation of fake news and academic misuse. Most detectors for identifying model-generated text are limited by their reliance on variance in perplexity and burstiness, and they require substantial computational resources. In this paper, we proposed a watermarking method embedding a specific watermark into the text during its generation by LLMs, based on a pre-defined signal pattern. This technique not only ensures the watermark's invisibility to humans but also maintains the quality and grammatical integrity of model-generated text. We utilize LLMs and Fast Fourier Transform (FFT) for token probability computation and detection of the signal watermark. The unique application of signal processing principles within the realm of text generation by LLMs allows for subtle yet effective embedding of watermarks, which do not compromise the quality or coherence of the generated text. Our method has been empirically validated across multiple LLMs, consistently maintaining high detection accuracy, even with variations in temperature settings during text generation. In the experiment of distinguishing between human-written and watermarked text, our method achieved an AUROC score of 0.97, significantly outperforming existing methods like GPTZero, which scored 0.64. The watermark's resilience to various attacking scenarios further confirms its robustness, addressing significant challenges in model-generated text authentication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。