arXiv:2608.09867cs.CRcs.AI2026-08被引 2

黑客可利用加密推理痕迹的兼容性,窃取大模型私有推理过程。

Stealing Reasoning Traces from Proprietary LLM APIs

论文配图:Stealing Reasoning Traces from Proprietary LLM APIs
图 1 · 摘自论文原文
  • 通过注入加密推理块,让弱模型直接输出明文内容。
  • 从公开仓库解密超30万条记录,发现367个敏感信息和182个凭证。
  • 适合研究模型安全、隐私泄露及对抗攻击的开发者参考。

主流大模型服务商如今隐藏其模型的逐步推理(链式思考),以保护知识产权并减少信息泄露。这些推理过程不存储于服务器端,而是以加密文本形式返回客户端,并随每次请求一同传回。基于已有研究,我们发现一个架构漏洞:这些加密块在同一家服务商的生态系统中,可跨会话、用户和模型完全兼容与互换。我们利用这一兼容性,开发出一种可扩展的解密越狱方法。通过将某模型的加密推理块注入同一服务商的较弱、防护较松的模型,迫使后者解码并原样输出该推理内容为明文,无需直接越狱强模型。此漏洞引发四种攻击路径:一是绕过反蒸馏机制,实现对专有模型推理的提取,我们在Anthropic、OpenAI和Google上均验证成功;二是实现大规模私有数据窃取,开发者常公开会话日志却不知其中加密块内容,我们解密了315,320个推理块,恢复出367个个人身份信息(PII)和182个凭证;三是无意间暴露推理过程中隐藏的危险信息,即使最终输出已拒绝恶意请求;四是攻击者可将恶意载荷嵌入加密块内,执行不可见的提示注入,污染公共代理系统。经负责任披露后,我们提出具体的密码学与系统级防护方案以保障客户端推理安全。

原文摘要 · Abstract (English)

Leading large language model providers now conceal their models' step-by-step reasoning, or chain-of-thought, to protect intellectual property and limit information leakage. Rather than storing these traces server-side, providers return them to the client as blocks of encrypted text, which the client passes back with each subsequent request. Building on prior research, we identify an architectural vulnerability: these encrypted blocks are fully compatible and interchangeable across different sessions, users, and models within a provider's ecosystem. We exploit this compatibility to develop a scalable decryption jailbreak. By injecting an encrypted reasoning trace from a given model into a weaker, and less safeguarded model from the same provider, we force it to decode and output the trace verbatim in plaintext, without ever jailbreaking the more capable model directly. This vulnerability enables four distinct attack vectors. First, it circumvents anti-distillation mechanisms, allowing adversaries to extract a proprietary model's reasoning, as we demonstrate across Anthropic, OpenAI, and Google. Second, it allows for large-scale private data extraction. Developers frequently share session logs publicly, unaware of contents of the encrypted blocks. By decoding 315,320 reasoning blocks scraped from public repositories, we recovered 367 Personally Identifiable Information (PII) artifacts and 182 credentials. Third, it inadvertently reveals hazardous information hidden within the reasoning process, even in cases where the model's final, visible output safely rejects a malicious request. Fourth, attackers can leverage this flaw to execute invisible prompt injections, embedding malicious payloads entirely within encrypted blocks to poison public agentic rollouts. Following responsible disclosure, we propose concrete cryptographic and system-level mitigations to secure client-side reasoning.

模型安全隐私泄露推理窃取提示注入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。