为开源大模型设计精准鲁棒的文本水印技术,解决版权验证难题。
PRO: Enabling Precise and Robust Text Watermark for Open-Source LLMs
- 联合训练水印策略与模型,提升水印学习与检测一致性。
- 在多个开源模型上检测率显著提升,抗微调等修改能力强。
- 适合关注模型版权保护的开发者与研究者使用。
大语言模型(LLM)的文本水印技术使模型所有者能够验证生成内容的来源并保护知识产权。尽管闭源模型的水印方法相对成熟,但将其扩展至开源模型仍面临挑战,因为开发者无法控制解码过程。因此,开源模型所有者缺乏有效手段验证文本是否由其模型生成。核心难点在于:直接将水印嵌入模型权重会损害可检测性。一种有前景的方法是将闭源模型的水印知识蒸馏到开源模型中,但存在(i)因学习模式与预设模式不匹配导致检测能力差,(ii)对下游修改(如微调或模型合并)脆弱的问题。为此,我们提出PRO——一种针对开源LLM的精确且鲁棒的文本水印方法。PRO联合训练水印策略模型与主模型,生成更易学习且与检测标准一致的水印模式。通过正则化项模拟下游扰动,惩罚水印可检测性下降,确保模型编辑后的鲁棒性。在多个开源模型(如LLaMA-3.2、LLaMA-3、Phi-2)上的实验表明,PRO显著提升了水印可检测性及对模型修改的抗性。
原文摘要 · Abstract (English)
Text watermarking for large language models (LLMs) enables model owners to verify text origin and protect intellectual property. While watermarking methods for closed-source LLMs are relatively mature, extending them to open-source models remains challenging, as developers cannot control the decoding process. Consequently, owners of open-source LLMs lack practical means to verify whether text was generated by their models. A core difficulty lies in embedding watermarks directly into model weights without hurting detectability. A promising idea is to distill watermarks from a closed-source model into an open one, but this suffers from (i) poor detectability due to mismatch between learned and predefined patterns, and (ii) fragility to downstream modifications such as fine-tuning or model merging. To overcome these limitations, we propose PRO, a Precise and Robust text watermarking method for open-source LLMs. PRO jointly trains a watermark policy model with the LLM, producing patterns that are easier for the model to learn and more consistent with detection criteria. A regularization term further simulates downstream perturbations and penalizes degradation in watermark detectability, ensuring robustness under model edits. Experiments on open-source LLMs (e.g., LLaMA-3.2, LLaMA-3, Phi-2) show that PRO substantially improves both watermark detectability and resilience to model modifications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。