arXiv:2608.14697cs.AI2026-08

让大模型在不依赖共享提示的情况下实现隐蔽信息传输。

Synchronized Logit Steering: Real-world Steganography

论文配图:Synchronized Logit Steering: Real-world Steganography
图 1 · 摘自论文原文
  • 用生成文本自构建代理提示,消除收发双方必须共享提示的限制。
  • 40个词后代理提示与真实提示的差异小于0.5纳特,信息密度达0.20比特/词。
  • 隐蔽性强,输出难以与普通生成内容区分,适合安全通信场景。

大型语言模型中的隐写术可将隐藏信息嵌入自然文本中。现有基于标记和对数概率的方法通常要求发送方和接收方共享相同的提示上下文,但在使用检索增强生成或专有系统指令的生产流程中,这种条件很难满足。本文提出同步对数引导(Synchronized Logit Steering, SLS),一种确定性隐写方案,通过从生成输出自身推导出代理提示,使双方无需原始提示即可重建相同的对数概率分布。SLS将数据负载编码为代理提示分布中高熵区域的词元排名,并引入周期性重复和负载突发机制以提升信息密度。在ShareGPT、GSM8K和SWE-bench Verified数据集上,当同步窗口达到40个词时,真实与代理提示分布之间的KL散度低于0.5纳特,且SLS编码对收敛过程影响微小。周期-突发变体实现0.20比特/词的信息容量,约为单负载编码的10倍。科尔莫戈罗夫-斯米尔诺夫检验进一步表明,SLS输出在统计上难以与贪婪生成区分,证明了通过大模型实现隐蔽、提示无关通信在实践中既可行又隐蔽。

原文摘要 · Abstract (English)

Steganography in large language models offers a way to embed hidden messages within natural-sounding text. Existing token and logit-level methods typically require the sender and receiver to share an identical prompt context, which is rarely guaranteed in production pipelines that use retrieval-augmented generation or proprietary system instructions. We introduce Synchronized Logit Steering (SLS), a deterministic steganographic scheme that eliminates this dependency by deriving a proxy prompt from the generated output itself, allowing both parties to reconstruct the same logit distribution without access to the original prompt. SLS encodes payload values as token ranks within high-entropy regions of the proxy prompt distribution, and we extend the scheme with periodic recurrence and payload bursts to scale information density. Across ShareGPT, GSM8K, and SWE-bench Verified, we show that the KL divergence between the true and proxy prompt distributions falls below 0.5 nats once the synchronization window reaches 40 tokens, and SLS encoding does not meaningfully disrupt this convergence relative to greedy generation. We also find that the periodic-burst variant achieves 0.20 bits per token, or roughly 10x the capacity of single-payload encoding. Kolmogorov-Smirnov tests further confirm that SLS outputs are statistically difficult to distinguish from greedy generations, demonstrating that covert, prompt-agnostic communication through LLMs is both practical and stealthy.

隐写术大模型安全通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。