arXiv:2606.00613cs.CLcs.AI2026-06

LUNA在多语言下实现无损水印,检测准确率超99.5%且不影响文本质量。

Linguistics-Aware Non-Distortionary LLM Watermarking

论文配图:Linguistics-Aware Non-Distortionary LLM Watermarking
图 1 · 摘自论文原文
  • 基于词性上下文估计熵值,动态调整采样深度实现无损水印
  • 在12个设置中平均困惑度偏移仅0.045,检测AUROC达0.9959
  • 支持多语言、跨领域部署,适合需高保真水印的生成系统

水印需在不降低生成质量或依赖模型提供方的前提下识别模型输出。多语言部署使这一目标更难实现,因形态学、分词和书写系统差异影响水印嵌入位置。本文提出LUNA,一种语言自适应水印方法,结合无需模型的检测与单标记无失真机制,在标准随机密钥模型下运行。LUNA通过外部语料库中词性上下文估算归一化下一标签熵,以此设定无失真二元锦标赛采样器的深度;检测器可从文本、分词器、标注器和密钥重建相同调度。我们在六种语言类型多样且两个领域的数据集上评估了LUNA,并与八种主流基线对比。结果表明,LUNA在12个设置中均达到0.9959的AUROC,平均绝对中位困惑度偏移最低(0.045),其95%置信区间[0.022, 0.073]低于所有基线。此外,它在Self-BLEU、Distinct-1、意外度及熵偏移上均表现最优;唯一在多数设置中同时实现AUROC>0.99与困惑度偏移<0.1的方法,共在9/12设置中达成此目标,而所有基线均未超过2次。代码已开源:https://github.com/Shinwoo-Park/luna_watermark。

原文摘要 · Abstract (English)

Watermarking should identify language-model output without degrading quality or limiting verification to the model provider. Multilingual deployment makes this harder because morphology, segmentation, and script change where watermark evidence can be naturally embedded. We introduce LUNA, a linguistically adaptive watermark that combines model-free detection with single-token non-distortion under the standard random-key model. LUNA estimates normalized next-tag entropy from part-of-speech contexts in an external corpus and uses it to set the depth of a non-distortionary binary tournament sampler; the detector reconstructs the same schedule from text, a tokenizer, a tagger, and a secret key. We evaluate LUNA on six typologically diverse languages and two domains against eight primary baselines. LUNA attains an AUROC of 0.9959 and the lowest mean absolute median perplexity shift, 0.045, across the 12 settings; its 95% bootstrap interval [0.022, 0.073] lies below all baseline intervals. LUNA also records the lowest mean on Self-BLEU, Distinct-1, surprisal, and entropy shifts; it is the only method that simultaneously achieves AUROC > 0.99 and an absolute median perplexity shift below 0.1 in a majority of settings, reaching this regime in 9 of the 12 settings while no baseline reaches it in more than 2. Our code is available at https://github.com/Shinwoo-Park/luna_watermark.

水印技术多语言无损生成大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。