arXiv:2604.05242cs.CLcs.AI2026-04ACL被引 1

XMark让大模型生成文本可隐藏多比特水印,保质又准

XMark: Reliable Multi-Bit Watermarking for LLM-Generated Texts

  • 通过优化编码器生成低失真词元分布,保持文本质量
  • 在短文本下仍能保持高解码准确率,优于现有方法
  • 适合需要追踪生成内容来源的场景,如版权保护

多比特水印已成为在大语言模型(LLM)生成文本中嵌入不可察觉二进制信息的有前景方案,有助于可靠追溯恶意使用。尽管已有进展,现有方法仍存在关键局限:部分方法在处理大消息时计算成本过高,另一些则在文本质量和解码准确性之间权衡不佳。尤其当生成文本的词元数受限时,现有方法的解码准确率显著下降——这在实际应用中极为常见。为此,我们提出 extsc{XMark},一种用于在 LLM 生成文本中编码和解码二进制消息的新方法。其独特的编码器设计生成的词元对数分布畸变更小,有效保留文本质量;同时其定制化解码器可在词元数量有限时仍可靠恢复编码信息。跨多种下游任务的大量实验表明, extsc{XMark} 在保持文本质量的同时显著提升解码准确率,优于先前方法。

原文摘要 · Abstract (English)

Multi-bit watermarking has emerged as a promising solution for embedding imperceptible binary messages into Large Language Model (LLM)-generated text, enabling reliable attribution and tracing of malicious usage of LLMs. Despite recent progress, existing methods still face key limitations: some become computationally infeasible for large messages, while others suffer from a poor trade-off between text quality and decoding accuracy. Moreover, the decoding accuracy of existing methods drops significantly when the number of tokens in the generated text is limited, a condition that frequently arises in practical usage. To address these challenges, we propose \textsc{XMark}, a novel method for encoding and decoding binary messages in LLM-generated texts. The unique design of \textsc{XMark}'s encoder produces a less distorted logit distribution for watermarked token generation, preserving text quality, and also enables its tailored decoder to reliably recover the encoded message with limited tokens. Extensive experiments across diverse downstream tasks show that \textsc{XMark} significantly improves decoding accuracy while preserving the quality of watermarked text, outperforming prior methods. The code is at https://github.com/JiiahaoXU/XMark.

水印大模型文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。