arXiv:2512.16904cs.CRcs.CL2025-12被引 2

用大模型重写文本实现水印,提升生成内容可追溯性。

How Good is Post-Hoc Watermarking With Language Model Rephrasing?

  • 通过大模型重写+生成时水印,实现内容溯源。
  • 重写后文本检测率高,且语义保持良好。
  • 小模型在代码类文本上反而更优,反直觉发现。

生成时文本水印通过嵌入统计信号来追踪AI生成内容。本文探索后处理水印(post-hoc watermarking):即利用语言模型重写已有文本并施加生成时水印,以保护版权文档或检测其在训练或RAG中的使用。与生成时方法相比,该设置在生成和检测层面拥有更多自由度。我们研究了计算资源分配(如使用更大重写模型、束搜索、多候选生成或检测时熵过滤)对质量-可检测性权衡的影响。结果表明,策略在开放文本(如书籍)上实现强可检测性与高语义保真度;其中,简单的Gumbel-max方案在核采样下意外优于近期方法,且多数方法显著受益于束搜索。然而,在可验证文本(如代码)上,多数方法表现不佳,反直觉地发现小模型性能优于大模型。本研究揭示了后处理水印的潜力与局限,为实际应用与未来研究奠定基础。

原文摘要 · Abstract (English)

Generation-time text watermarking embeds statistical signals into text for traceability of AI-generated content. We explore *post-hoc watermarking* where an LLM rewrites existing text while applying generation-time watermarking, to protect copyrighted documents, or detect their use in training or RAG via watermark radioactivity. Unlike generation-time approaches, which is constrained by how LLMs are served, this setting offers additional degrees of freedom for both generation and detection. We investigate how allocating compute (through larger rephrasing models, beam search, multi-candidate generation, or entropy filtering at detection) affects the quality-detectability trade-off. Our strategies achieve strong detectability and semantic fidelity on open-ended text such as books. Among our findings, the simple Gumbel-max scheme surprisingly outperforms more recent alternatives under nucleus sampling, and most methods benefit significantly from beam search. However, most approaches struggle when watermarking verifiable text such as code, where we counterintuitively find that smaller models outperform larger ones. This study reveals both the potential and limitations of post-hoc watermarking, laying groundwork for practical applications and future research.

文本水印大模型可追溯性重写

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。