arXiv:2601.05144cs.AI2026-01被引 2

为推理大模型设计低干扰水印方案,保障逻辑连贯性与可追溯性。

Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models

  • 分思考与回答两阶段,用语义关键点生成主向量指导水印
  • 水印使文本困惑度降0.35,数学准确率升0.67点,翻译得分提0.164
  • 水印检测AUC高0.34%,延迟几乎不变,适合实际部署

推理型大语言模型在复杂任务中表现优异,但现有数字水印方法常破坏逻辑连贯性或带来高计算开销。基于标记的水印技术通过施加伪随机偏置会干扰推理流程,而语义感知方法虽提升质量,却引入显著延迟或需额外模型。本文提出ReasonMark,一种专为推理密集型LLM设计的水印框架。该方法将生成过程解耦为不受干扰的思考阶段与带水印的回答阶段。我们引入关键性评分,从推理轨迹中识别语义关键标记,并将其提炼为关键语义向量(PSV)。PSV引导一种语义自适应机制,根据标记与PSV的对齐程度动态调节水印强度,确保鲁棒性的同时不损害逻辑完整性。大量实验表明,ReasonMark在降低文本困惑度0.35、提升翻译BLEU分数0.164、数学准确率0.67点的同时,水印检测AUC提高0.34%,且对攻击更具鲁棒性,仅带来可忽略的延迟增加。该工作推动了推理型LLM在真实场景中的可追溯与可信部署。

原文摘要 · Abstract (English)

Reasoning Large Language Models (RLLMs) excelling in complex tasks present unique challenges for digital watermarking, as existing methods often disrupt logical coherence or incur high computational costs. Token-based watermarking techniques can corrupt the reasoning flow by applying pseudo-random biases, while semantic-aware approaches improve quality but introduce significant latency or require auxiliary models. This paper introduces ReasonMark, a novel watermarking framework specifically designed for reasoning-intensive LLMs. Our approach decouples generation into an undisturbed Thinking Phase and a watermarked Answering Phase. We propose a Criticality Score to identify semantically pivotal tokens from the reasoning trace, which are distilled into a Principal Semantic Vector (PSV). The PSV then guides a semantically-adaptive mechanism that modulates watermark strength based on token-PSV alignment, ensuring robustness without compromising logical integrity. Extensive experiments show ReasonMark surpasses state-of-the-art methods by reducing text Perplexity by 0.35, increasing translation BLEU score by 0.164, and raising mathematical accuracy by 0.67 points. These advancements are achieved alongside a 0.34% higher watermark detection AUC and stronger robustness to attacks, all with a negligible increase in latency. This work enables the traceable and trustworthy deployment of reasoning LLMs in real-world applications.

水印推理模型语义引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。