arXiv:2608.19369cs.CLcs.CR2026-08

揭示语言模型水印在语义变换下的隐藏几何特性,解释为何传统检测会失效。

Linguistic Holonomy and Statistical Watermarks: Inner Geometry of Meaning-Preserving Transformations

  • 用语言环理论重构语义不变变换的内在结构
  • 发现水印信号衰减遵循ρ^(h+1)规律,与编辑位置密切相关
  • 证明检测器无法捕捉的几何相位效应,适用于安全与可信生成研究

语言模型中的统计水印存在于符号的自由度中:它们在语义几乎等价的词元间选择,因此会被那些仅改变文本形式而保持内容不变的变换所削弱。现有文献通过原始文本与重写文本之间的语义相似性来衡量此类变换,但我们证明终点相似性是错误的统计量。通过引入语言环的形式化,我们证明了语义不变变换链的不变量可分解为终点部分和初始状态稳定子中的整体性(holonomy),后者无法被语义缺陷感知;环的旋转对应嵌入空间单位球面上的平行移动,使类比于威尔逊环成为定理而非修辞。在检测侧,我们证明了一个精确恒等式:残余统计量正比于其种子窗口完整保留的位置数,由此导出独立编辑下的衰减律ρ^(h+1)。该恒等式带来令人不安的后果:在相同保留率下,残留信号可能为原信号的二分之一、四分之一,或完全消失,仅取决于编辑发生的位置。

原文摘要 · Abstract (English)

Statistical watermarks for language models live in the freedom of the signifier: they choose among tokens that are nearly equivalent in meaning, and they are therefore eroded by exactly those transformations which move the form of a text while leaving its content in place. The literature measures such transformations by their endpoint, through the semantic similarity between the original and the rewritten text. We show that the endpoint is the wrong statistic. Adapting the formalism of linguistic loops, we prove that the invariant of a chain of meaning-preserving transformations factorises canonically into an endpoint part and a holonomy in the stabiliser of the initial state, the second of which the semantic deficit cannot see; the loop rotation is parallel transport on the unit sphere of the embedding space, so that the analogy with the Wilson loop becomes a theorem rather than a figure of speech. On the side of the detector we prove an exact identity: the residual statistic is proportional to the number of positions whose seeding window survived intact, from which the decay law $ρ^{h+1}$ follows as the independent-edit corollary. The identity has a disconcerting consequence, which we confirm to three decimal places: at one and the same retention rate the surviving signal may be one half of the original, one quarter of it, or exactly nothing, according only to where the edits fall.

语言模型水印检测几何不变量语义变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。