发现并检测语言模型水印伪造,揭示攻击漏洞。
Discovering Spoofing Attempts on Language Model Watermarks
- 基于统计方法识别伪造水印的文本特征
- 对所有学习型伪造方法检测成功率接近100%
- 适合关注生成内容可信度的研究者
语言模型水印是标识生成文本归属的一种有前景的方法。但伪造攻击会冒充特定模型生成文本,威胁水印可信性。尽管已有研究证明现有水印方案易受伪造攻击,但尚无针对伪造行为的事后检测方法。本文首次提出一种可靠的统计检测方法,可区分伪造与真实水印文本,表明当前伪造攻击实际效果低于预期。我们发现,所有基于学习的伪造方法均会在文本中留下可被检测的异常痕迹,这些痕迹是伪造的标志。基于此,我们构建了严格的统计检验方法,能有效揭示伪造痕迹。实验验证显示,该方法对所有学习型伪造方法具有极高的检测能力,揭示其根本局限,并提供缓解策略。代码已开源:https://github.com/eth-sri/watermark-spoofing-detection。
原文摘要 · Abstract (English)
LLM watermarks stand out as a promising way to attribute ownership of LLM-generated text. One threat to watermark credibility comes from spoofing attacks, where an unauthorized third party forges the watermark, enabling it to falsely attribute arbitrary texts to a particular LLM. Despite recent work demonstrating that state-of-the-art schemes are, in fact, vulnerable to spoofing, no prior work has focused on post-hoc methods to discover spoofing attempts. In this work, we for the first time propose a reliable statistical method to distinguish spoofed from genuinely watermarked text, suggesting that current spoofing attacks are less effective than previously thought. In particular, we show that regardless of their underlying approach, all current learning-based spoofing methods consistently leave observable artifacts in spoofed texts, indicative of watermark forgery. We build upon these findings to propose rigorous statistical tests that reliably reveal the presence of such artifacts and thus demonstrate that a watermark has been spoofed. Our experimental evaluation shows high test power across all learning-based spoofing methods, providing insights into their fundamental limitations and suggesting a way to mitigate this threat. We make all our code available at https://github.com/eth-sri/watermark-spoofing-detection .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。