arXiv:2606.30783cs.CRcs.AI2026-06中稿 · ICML被引 1

防御提示注入会损害模型忠实度,两者存在隐藏权衡。

Security--Fidelity Tradeoffs: The Hidden Cost of Prompt Injection Defense

论文配图:Security--Fidelity Tradeoffs: The Hidden Cost of Prompt Injection Defense
图 1 · 摘自论文原文
  • 通过抑制不可信文本来防御注入,但影响需保留原文的任务
  • 最高忠实度96.5%时安全仅47.8%,最安全达99.3%但忠实度不足74%
  • 防御效果差异源于策略而非单一指标,需根据部署成本决策

我们发现防御大模型间接提示注入存在安全与忠实度的权衡:防御机制通过抑制不可信文本实现,但会破坏需保留原始内容的任务(如翻译、文档编辑)。现有攻击成功率指标无法区分模型是忽略注入还是忠实地处理为数据。为此,我们提出SecFid基准,使执行注入、处理为数据和忽略注入产生可区分输出,从而可测量忠实度。在1,168个样本和48种配置下,无模型或防御能同时兼顾二者。最高忠实度模型达96.5%忠实度,但安全仅47.8%;最安全防御可达99.3%安全,但忠实度仅71.0%-73.9%。相同安全水平下,不同防御策略各异:部分修复劫持为忠实处理,部分则压制良性内容。决策论分析表明,正确行为取决于部署场景中劫持与遗漏损失的相对成本,因此仅报告安全值会掩盖其代价。

原文摘要 · Abstract (English)

We identify a security-fidelity tradeoff in defending LLMs against indirect prompt injection: defenses resist injected instructions largely by suppressing untrusted text, which corrupts tasks that must preserve it, such as translation and document editing. Attack-success metrics cannot see this, because a model that ignores an injection and one that faithfully processes it as data score identically. We introduce SecFid, a benchmark built so that executing an injection, processing it as data, and ignoring it produce distinguishable outputs. This makes fidelity measurable and exposes a frontier: across 1,168 examples and 48 configurations, no model or defense achieves both objectives. The highest-fidelity model reaches 96.5% fidelity at 47.8% security, while the most secure defenses invert this, at 99.3% security but only 71.0%-73.9% fidelity. Even defenses with identical security differ in how they earn it: some repair hijacks into faithful processing, others simply suppress benign content. A decision-theoretic analysis shows why no fixed choice can be right everywhere: the correct behavior is not a property of the defense but of the deployment, set by its relative cost of a hijack versus a dropped span. Security alone therefore measures only half of robustness, and reporting it without fidelity hides the price at which it was bought.

大模型安全提示注入忠实度权衡分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。