arXiv:2502.08332cs.CRcs.AI2025-02

通过新指标实现文本修改与生成内容双重检测

Modification and Generated-Text Detection: Achieving Dual Detection Capabilities for the Outputs of LLM by Watermark

  • 引入'丢弃标记数'指标监测文本修改
  • 实测可同时精准识别修改与生成文本
  • 适合关注LLM安全与版权保护的开发者

大语言模型的发展引发滥用担忧。一种实用方案是在文本中嵌入水印,通过提取水印验证归属。现有方法多聚焦于防御修改攻击,常忽略其他伪造攻击。例如,攻击者可篡改带水印文本生成有害内容,而水印仍存在,导致恶意内容被错误归因于模型。这严重威胁服务提供方,凸显同步实现修改检测与生成文本检测的重要性。为此,我们提出一种对修改敏感的无偏水印技术,引入新指标'丢弃标记数'(即未参与水印检测的标记数量),当文本被修改时该值发生变化,可作为修改证据。同时优化水印检测流程,提出新型无偏水印方法。实验表明,该方法能有效实现双重检测:既能识别文本修改,又能判定是否由模型生成。

原文摘要 · Abstract (English)

The development of large language models (LLMs) has raised concerns about potential misuse. One practical solution is to embed a watermark in the text, allowing ownership verification through watermark extraction. Existing methods primarily focus on defending against modification attacks, often neglecting other spoofing attacks. For example, attackers can alter the watermarked text to produce harmful content without compromising the presence of the watermark, which could lead to false attribution of this malicious content to the LLM. This situation poses a serious threat to the LLMs service providers and highlights the significance of achieving modification detection and generated-text detection simultaneously. Therefore, we propose a technique to detect modifications in text for unbiased watermark which is sensitive to modification. We introduce a new metric called ``discarded tokens", which measures the number of tokens not included in watermark detection. When a modification occurs, this metric changes and can serve as evidence of the modification. Additionally, we improve the watermark detection process and introduce a novel method for unbiased watermark. Our experiments demonstrate that we can achieve effective dual detection capabilities: modification detection and generated-text detection by watermark.

水印技术LLM安全文本检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。