arXiv:2601.22246cs.CRcs.AI2026-01

提出一种可泛化的多比特语言模型水印方法,保持文本质量同时提升检测能力。

MirrorMark: Generalizable Mirrored Sampling for Multi-bit LLM Watermarking

  • 通过镜像映射分离符号规则与采样器,实现无损水印嵌入。
  • 在不改变词元分布前提下,检测准确率高且误报率低。
  • 适合需要高保真内容溯源的生成式应用,如论文写作与新闻生成。

随着大语言模型在问答和内容生成等应用中日益重要,可靠的内容溯源变得愈发关键。水印是一种有前景的解决方案,但现有方法多仅提供二值信号,或通过扭曲生成分布实现多比特嵌入。我们提出 MirrorMark,一种面向多比特语言模型水印的可泛化映射中心方法。该方法将符号映射规则与基础水印采样器解耦,将每个符号映射为检测器可复现的伪随机对象(如采样值或排列秩)的模1镜像变换。二值化令牌分析表明,互补映射相比独立密钥或移位映射能产生更大的匹配-非匹配得分差距。结合无失真基础采样器,MirrorMark 在设计上保持词元概率分布,实际文本质量不受影响。为支持实用化载荷嵌入,我们引入上下文锚定平衡调度器(CABS),在消息位置间均衡分配词元,同时限制修改范围。我们还对两种代表性采样器实例进行了理论误报率(EER)分析。实验表明,MirrorMark 在保持接近非水印生成的文本质量的同时,实现了强检测性和高比特准确性。

原文摘要 · Abstract (English)

As large language models (LLMs) become integral to applications such as question answering and content creation, reliable content attribution has become increasingly important. Watermarking is a promising approach, but most existing methods either provide only binary signals or achieve multi-bit embedding by distorting the generation distribution. We propose MirrorMark, a generalizable mapping-centric approach for multi-bit LLM watermarking. MirrorMark separates the symbol mapping rule from the base watermarking sampler and maps each symbol to a mod-1 mirroring transformation of a detector-reproducible pseudorandom object, such as sampling values or permutation ranks. A binary-tokenizer analysis shows that complementary mappings yield larger matched--mismatched score gaps than independent-key or shift-based mappings. When composed with a distortion-free base sampler, MirrorMark preserves the token probability distribution by design and maintains text quality in practice. To support practical payload embedding, we introduce a Context-Anchored Balanced Scheduler (CABS), which balances token assignments across message positions while localizing edit effects. We further provide theoretical EER analyses for two representative sampler instantiations. Experiments show that MirrorMark achieves strong detectability and bit accuracy while maintaining text quality comparable to non-watermarked generation.

水印语言模型溯源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。