让文字水印更抗修改,自动识别内容语义防伪造
SimKey: A Semantically Aware Key Module for Watermarking Language Models
- 根据上下文语义生成水印密钥,而非随机生成
- 对改写、翻译后文本仍能正确识别水印
- 适合需要防滥用和责任追溯的AI生成内容场景
大型语言模型生成文本的泛滥使得区分真实人类写作与机器输出愈发困难。水印技术提供了一种可行方案:模型所有者可在生成文本中嵌入不可察觉的信号以标记来源。现有主流方法通过伪随机密钥种子引导模型的下一步词元采样,后续可恢复该密钥以识别文本为机器生成,同时仅轻微改变输出分布。但这些方法存在两个相关问题:(i) 水印对简单表面编辑(如改写或重排)脆弱;(ii) 攻击者可附加无关甚至有害文本并继承水印,导致模型所有者面临声誉风险。为此,我们提出SimKey,一种语义感知的密钥模块,通过将密钥生成与先前上下文的语义绑定来增强水印鲁棒性。SimKey采用语义嵌入的局部敏感哈希,确保改写文本生成相同水印密钥,而无关或语义偏移文本则生成不同密钥。集成至当前最先进的水印方案后,SimKey显著提升了对改写和翻译的鲁棒性,并防止有害内容被错误归因,确立了语义感知密钥生成作为一项实用且可扩展的水印方向。
原文摘要 · Abstract (English)
The rapid spread of text generated by large language models (LLMs) makes it increasingly difficult to distinguish authentic human writing from machine output. Watermarking offers a promising solution: model owners can embed an imperceptible signal into generated text, marking its origin. Most leading approaches seed an LLM's next-token sampling with a pseudo-random key that can later be recovered to identify the text as machine-generated, while only minimally altering the model's output distribution. However, these methods suffer from two related issues: (i) watermarks are brittle to simple surface-level edits such as paraphrasing or reordering; and (ii) adversaries can append unrelated, potentially harmful text that inherits the watermark, risking reputational damage to model owners. To address these issues, we introduce SimKey, a semantic key module that strengthens watermark robustness by tying key generation to the meaning of prior context. SimKey uses locality-sensitive hashing over semantic embeddings to ensure that paraphrased text yields the same watermark key, while unrelated or semantically shifted text produces a different one. Integrated with state-of-the-art watermarking schemes, SimKey improves watermark robustness to paraphrasing and translation while preventing harmful content from false attribution, establishing semantic-aware keying as a practical and extensible watermarking direction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。