arXiv:2512.15081cs.CRcs.AI2025-12

量化大模型安全防护的投入产出比,帮团队选对防攻击措施。

Quantifying Return on Security Controls in LLM Systems

  • 用蒙特卡洛模拟把攻击成功率转为经济损失,算出每项防护的回报率。
  • 未加防护时单次攻击预计损失31.3万美元,最佳方案可降94%以上。
  • 微软预训练工具最有效,开源防护框架效果几乎可忽略。

尽管大型语言模型(LLMs)越来越多地应用于安全关键场景,但从业者仍缺乏部署哪些防护措施的量化依据。本文提出一种面向决策的框架与可复现的方法,可量化剩余风险,将对抗性探测结果转化为财务风险估计和安全控制回报率(RoC),并实现对多层防御机制的货币化比较。基于DeepSeek-R1模型构建一个包含合成个人身份信息(PII)的检索增强生成(RAG)服务,并在五个漏洞类别下使用Garak进行自动化攻击测试:PII泄露、隐式上下文注入、提示注入、对抗攻击生成和模型偏差。针对每个(漏洞,防护)组合,通过拉普拉斯成功法则估算攻击成功率,并结合从公开数据中校准的损失三角分布,在10,000次蒙特卡洛模拟中生成损失超出曲线和预期损失。对比三种常见缓解措施——基于属性的访问控制(ABAC)、使用微软Presidio的命名实体识别(NER)脱敏、NeMo Guardrails——与基准RAG配置。基准系统在PII、隐式注入和提示注入攻击中成功率均≥0.98,单次攻击情景下总模拟预期损失达31.3万美元。ABAC将两类攻击成功率降至接近零,使总预期损失降低约94%,获得9.83的RoC;NER脱敏同样消除PII泄露,达到5.97的RoC;而NeMo Guardrails仅带来边际改善(RoC为0.05)。

原文摘要 · Abstract (English)

Although large language models (LLMs) are increasingly used in security-critical workflows, practitioners lack quantitative guidance on which safeguards are worth deploying. This paper introduces a decision-oriented framework and reproducible methodology that together quantify residual risk, convert adversarial probe outcomes into financial risk estimates and return-on-control (RoC) metrics, and enable monetary comparison of layered defenses for LLM-based systems. A retrieval-augmented generation (RAG) service is instantiated using the DeepSeek-R1 model over a corpus containing synthetic personally identifiable information (PII), and subjected to automated attacks with Garak across five vulnerability classes: PII leakage, latent context injection, prompt injection, adversarial attack generation, and divergence. For each (vulnerability, control) pair, attack success probabilities are estimated via Laplace's Rule of Succession and combined with loss triangle distributions, calibrated from public breach-cost data, in 10,000-run Monte Carlo simulations to produce loss exceedance curves and expected losses. Three widely used mitigations, attribute-based access control (ABAC); named entity recognition (NER) redaction using Microsoft Presidio; and NeMo Guardrails, are then compared to a baseline RAG configuration. The baseline system exhibits very high attack success rates (>= 0.98 for PII, latent injection, and prompt injection), yielding a total simulated expected loss of $313k per attack scenario. ABAC collapses success probabilities for PII and prompt-related attacks to near zero and reduces the total expected loss by ~94%, achieving an RoC of 9.83. NER redaction likewise eliminates PII leakage and attains an RoC of 5.97, while NeMo Guardrails provides only marginal benefit (RoC of 0.05).

安全评估风险量化大模型防护决策支持

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。