arXiv:2606.19588cs.AIcs.CR2026-06

LLM与求解器协作时,结果叙述存在漏洞,可能被攻击者篡改。

Analyzing the Narration Gap in LLM-Solver Loops

论文配图:Analyzing the Narration Gap in LLM-Solver Loops
图 1 · 摘自论文原文
  • 将LLM-求解器流程建模为可验证的决策过程
  • 五款开源模型在提示注入下均暴露叙述漏洞
  • 硬化提示可缓解但无法根除自适应攻击风险

当安全或安全关键问题可形式化为逻辑问题时,SAT和SMT等形式工具正越来越多地嵌入语言模型推理流程。与链式思维不同,求解器能生成有保障且可独立验证的答案。然而,求解器与模型间的交互可能导致这种保障失效。该混合流程包含三个部分:问题形式化、决策和结果叙述。已有研究关注前两步,但忽视了叙述环节——即如何将形式工具输出转化为用户可见答案。为填补这一叙述空白,我们首先将LLM-求解器循环建模为可验证的决策程序。我们评估了五种开源模型在提示注入下的表现,发现证书门控能使求解器结论保持正确,但攻击者仍可通过改写表述和渠道反转已验证结论。通过硬化提示可显著降低注入风险,但在自适应攻击下仍不稳固。结合形式分析与实证研究,我们表明在LLM-求解器循环中,最终用户所读到的答案并不可靠。

原文摘要 · Abstract (English)

Formal tools such as SAT and SMT solvers are increasingly embedded in language model reasoning pipelines when a safety or security critical question can be formulated in logic. Unlike chain of thought whose steps are sampled from the model distribution without formal guarantee, a solver produces a sound and independently verifiable answer. However, the soundness guarantee can be lost in the interaction between the solver and the model. The hybrid pipeline has three components: formalizing the question, deciding it, and narrating the result. Prior work has studied the formalization and decision, but not narration, which is the step that turns a formal tool's output into the user answer. To fill the narration gap, we first model the LLM-solver loop as a verified decision procedure. We further evaluate five open-sourced models under prompt injection, and we find certificate gating makes the solver verdict sound, while an adversary can invert a verified conclusion across phrasings and channels. We study the mitigation through hardened prompt that reduces injection significantly but cannot eliminate it and still suffers under adaptive attack. Combining the formal analysis and empirical studies, we show in the LLM-solver loop, robustness does not reach to the answer that the user finally reads.

大模型安全形式验证对抗攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。