arXiv:2604.13786cs.CL2026-04ACL

提出一种对齐生成质量的多比特水印方法,解决文本熵低时水印失真问题。

QuantileMark: A Message-Symmetric Multi-bit Watermark for LLMs

  • 将概率区间均分,按目标符号分配固定概率预算,确保上下文无关的嵌入稳定性。
  • 在C4和LFQA数据集上实现更高多比特恢复率与更强检测鲁棒性。
  • 适合关注内容溯源且需保持生成质量的LLM部署场景。

随着大语言模型成为内容生成的标准后端,实际出处追踪越来越需要多比特水印。在服务提供商内部部署中,关键要求是消息对称性:消息本身不应系统性影响文本质量或验证结果。词汇划分水印在低熵解码时会破坏消息对称性:某些消息被分配大部分概率质量,而其他消息被迫使用尾部词元。这导致嵌入质量和消息解码准确率依赖于消息内容。我们提出QuantileMark,一种白盒多比特水印方法,将消息嵌入连续累积概率区间[0,1)内。每一步中,QuantileMark将该区间划分为M个等概率子区间,并严格从目标符号对应的子区间采样,确保无论上下文熵如何,始终有固定的1/M概率预算。检测时,验证者在教师强制下重建相同划分,计算隐含子区间的后验概率,并聚合证据进行验证。我们证明了消息无偏性,即在消息平均下可恢复基础分布,为生成侧对称性提供理论基础;等概率设计还进一步在检测侧实现了各消息间证据强度的均匀性。实验表明,在C4续写和LFQA任务上,相比强基线,QuantileMark实现了更优的多比特恢复率与检测鲁棒性,且对生成质量影响微乎其微。代码已开源于GitHub。

原文摘要 · Abstract (English)

As large language models become standard backends for content generation, practical provenance increasingly requires multi-bit watermarking. In provider-internal deployments, a key requirement is message symmetry: the message itself should not systematically affect either text quality or verification outcomes. Vocabulary-partition watermarks can break message symmetry in low-entropy decoding: some messages are assigned most of the probability mass, while others are forced to use tail tokens. This makes embedding quality and message decoding accuracy message-dependent. We propose QuantileMark, a white-box multi-bit watermark that embeds messages within the continuous cumulative probability interval $[0, 1)$. At each step, QuantileMark partitions this interval into $M$ equal-mass bins and samples strictly from the bin assigned to the target symbol, ensuring a fixed $1/M$ probability budget regardless of context entropy. For detection, the verifier reconstructs the same partition under teacher forcing, computes posteriors over latent bins, and aggregates evidence for verification. We prove message-unbiasedness, a property ensuring that the base distribution is recovered when averaging over messages. This provides a theoretical foundation for generation-side symmetry, while the equal-mass design additionally promotes uniform evidence strength across messages on the detection side. Empirical results on C4 continuation and LFQA show improved multi-bit recovery and detection robustness over strong baselines, with negligible impact on generation quality. Our code is available at GitHub (https://github.com/zzzjunlin/QuantileMark).

水印LLM生成对称多比特

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。