arXiv:2602.14095cs.AIcs.CR2026-02

测试大模型能否在看似正常的回答中暗藏秘密推理,发现当前模型难同时完成推理和隐藏。

NEST: Nascent Encoded Steganographic Thoughts

  • 让模型在回答无关问题时悄悄嵌入秘密推理信息
  • 前沿模型无法同时完成推理与隐藏,但可单独高效隐藏数字
  • 为检测隐蔽推理提供方法,适合关注AI安全的研究者

监控链式思维(CoT)推理是大型语言模型智能体的基础安全技术;然而,若模型学会隐藏其推理过程,这种监督将失效。本文探索了隐写式链式思维——即模型将秘密推理隐藏在看似无害的文本中——以评估潜在风险并制定部署策略。隐写式推理需在同一前向传播中完成两项技能:计算中间结果,并将其嵌入一个回答无关问题的连贯文本。基于我们对隐写与非隐写式CoT类型的分类体系,系统评估了34个模型(涵盖多个代际)在五大数据集上的隐写式CoT能力,包括监控规避率、拒绝率、编码保真度及隐藏任务准确率,并与普通推理、直接回答和填充令牌基线对比。两个实验分别分离出两项子技能:推理任务遍历测试联合推理与嵌入能力,计数任务则提供已知数字序列,仅测试嵌入能力——这是隐写推理的必要前提。结果显示,当前前沿模型无法维持联合推理与嵌入:成对麦克尼马尔检验表明,每个(模型,家族)单元中,隐写通道均被填充令牌基线主导。而仅编码的下限则已被突破——Claude Opus 4.5在4位数字序列上达到92%的逐项准确率,8位单数字序列实现100%完全匹配,证明隐写式CoT的瓶颈在于推理与编码的联合负载,而非通道容量本身。研究强调需持续评估隐写风险,并提供一种提前检测和评估潜在隐蔽推理的方法,防止对齐偏差和欺骗行为。

原文摘要 · Abstract (English)

Monitoring chain-of-thought (CoT) reasoning is a foundational safety technique for large language model agents; however, this oversight is compromised if models learn to conceal their reasoning. We explore steganographic CoT--where models hide secret reasoning within innocuous text--to inform risk assessment and deployment policies. Steganographic reasoning requires two skills in a single forward pass: computing an intermediate result, and embedding it into a coherent cover that answers an unrelated question. Drawing on our taxonomy of steganographic and non-steganographic CoT types, we systematically evaluate the limits of prompt-elicited steganographic CoT capability across 34 models, ranging from past generations to the current frontier. We measure monitor evasion, refusal rates, encoding fidelity, and hidden task accuracy across five datasets, comparing against plain reasoning, direct answer, and filler-token baselines. The two experiments isolate the two sub-skills: a reasoning tasks sweep tests joint reason-and-embed, while a counting task hands the model a known numerical sequence and tests embedding alone--a necessary precondition for stego reasoning. Current frontier models cannot sustain joint reason-and-embed: a paired McNemar comparison shows the steganographic channel is dominated by an filler-token baseline on every (model, family) cell. The encoding-only floor, by contrast, is cleared--Claude Opus~4.5 reaches 92% per-number partial accuracy on 4-digit sequences and saturates at 100% exact-match on length-8 single-digit sequences--establishing that the binding constraint on stego CoT is the joint reasoning-plus-encoding load, not raw channel capacity. Our findings underscore the need for continuous evaluation of steganographic risk and provide a methodology to preemptively detect and evaluate hidden reasoning that might empower misaligned scheming and deceptive behavior.

AI安全隐写链式思维

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。