arXiv:2606.09135cs.CRcs.AI2026-06

利用大模型生成过程中的随机种子隐藏信息,无需修改模型或输出。

Steganography Without Modification: Hidden Communication via LLM Seeds

论文配图:Steganography Without Modification: Hidden Communication via LLM Seeds
图 1 · 摘自论文原文
  • 通过重构生成文本中的概率区间,从种子推导秘密信息。
  • 已知提示时300字内可100%恢复32位种子,未知提示时600-800字内接近完美恢复。
  • 适用于隐蔽通信与安全分析,尤其对忽视提示信息的假设提出警示。

我们证明,广泛部署的大语言模型推理栈存在一种无需修改模型权重、采样代码或输出分布的隐写通道。该通道利用确定性解码的结构特性:逆变换采样中使用的伪随机数生成器(PRNG)会产生依赖种子的逐标记概率区间,这些区间仅凭生成文本即可重构。发送方在生成前将秘密消息编码至PRNG种子;接收方通过穷举种子空间,重构区间并恢复种子以获取隐藏内容。我们定义两种工作模式:在已知提示场景下,共享提示可实现精确区间重建和种子完美恢复;在未知提示场景下,仅依赖生成文本,结合最大命中计数评分策略,仍可在足够长输出中可靠恢复。六种模型家族、五个异构文本领域的实验表明,在已知提示下,32位种子在单张GPU上300词内、35秒内可达100%准确率;未知提示下,600-800词约12秒内接近完美恢复。我们进一步分析了提示策略、分词歧义与采样超参数对通道可靠性的影响。此外,本研究揭示其应用潜力:不仅支持32比特隐写传输,更表明忽略提示信息并非有效的安全假设。

原文摘要 · Abstract (English)

We demonstrate that widely deployed Large Language Model (LLM) inference stacks harbor a steganographic channel that requires no modification to model weights, sampling code, or output distributions. The channel exploits a structural property of deterministic decoding: pseudo-random number generators (PRNGs) used in inverse-transform sampling produce a seed-dependent sequence of token-level probability intervals that can be reconstructed from the generated text alone. A sender encodes a secret message in the PRNG seed before generation; a receiver reconstructs the intervals and recovers the seed, and thus the hidden payload, by exhaustive search over the seed space. We formalize two operational modes. In the known-prompt setting, sender and receiver share the prompt, enabling exact interval reconstruction and perfect seed recovery via forced alignment. In the unknown-prompt setting, only the generated text is available; approximate interval reconstruction combined with a maximum-hit-count scoring strategy still permits reliable recovery from sufficiently long outputs. Extensive experiments across six model families and five heterogeneous text domains show that, in the known-prompt setting, full 32-bit seed recovery from the complete 2^32 candidate space achieves up to 100% accuracy, depending on model and text domain, within 300 tokens and under 35 seconds on a single GPU. In the unknown-prompt setting, recovery reaches near-perfect accuracy at 600-800 tokens in about 12 seconds. We further analyze the influence of prompting strategies, tokenization ambiguities, and sampling hyperparameters on channel reliability. Moreover, we discuss several applications of our results: First, it allows for the steganographic transmission of 32 bits, but also shows that ignorance of the prompt is not a valid security assumption.

隐写大模型安全随机种子秘密通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。