arXiv:2604.18697cs.CRcs.CL2026-04中稿 · S&P 2026被引 1

提出新指标评估大模型接口的数据提取风险,突破传统隐私保护的局限。

Beyond Indistinguishability: Measuring Extraction Risk in LLM APIs

论文配图:Beyond Indistinguishability: Measuring Extraction Risk in LLM APIs
图 1 · 摘自论文原文
  • 定义$(l, b)$-不可提取性,量化黑盒攻击需至少$2^b$次查询才能提取指定长度片段。
  • 实测显示现有模型即使满足区分度隐私,仍存在显著数据提取风险。
  • 提供可部署的提取风险估算器,适用于训练、接口和解码配置的优化指导。

当前广泛采用的不可区分性(如差分隐私边界或低成员推断概率)常被视为模型抵御数据记忆风险的代理指标。然而,本文揭示这些性质既非充分也非必要条件,无法保证防止大模型接口中的数据提取。我们形式化了提取与不可区分性之间的隐私游戏分离,证明两者不可比较:控制区分度不等于控制提取风险。为此,提出$(l, b)$-不可提取性定义,要求任何黑盒攻击者需至少$2^b$次预期查询才能诱导模型输出一个受保护的$l$-gram子串。通过最坏情况提取博弈,推导出针对目标精确提取的秩基风险上界,并扩展至无目标及近似提取场景。所提出的估计器能捕捉多次攻击试验和前缀适应下的提取风险,对标准贪婪提取可提供紧致高效估计,并为任意解码配置给出概率提取风险上界。实验在多种模型上验证了提取风险与区分度的非相关性,展示了其优于现有方法的估计精度,并为模型训练、API访问和解码配置提供了可操作的缓解建议。代码已公开于:https://github.com/Emory-AIMS/Inextractability。

原文摘要 · Abstract (English)

Indistinguishability properties such as differential privacy bounds or low empirically measured membership inference are widely treated as proxies to show a model is sufficiently protected against broader memorization risks. However, we show that indistinguishability properties are neither sufficient nor necessary for preventing data extraction in LLM APIs. We formalize a privacy-game separation between extraction and indistinguishability-based privacy, showing that indistinguishability and inextractability are incomparable: upper-bounding distinguishability does not upper-bound extractability. To address this gap, we introduce $(l, b)$-inextractability as a definition that requires at least $2^b$ expected queries for any black-box adversary to induce the LLM API to emit a protected $l$-gram substring. We instantiate this via a worst-case extraction game and derive a rank-based extraction risk upper bound for targeted exact extraction, as well as extensions to cover untargeted and approximate extraction. The resulting estimator captures the extraction risk over multiple attack trials and prefix adaptations. We show that it can provide a tight and efficient estimation for standard greedy extraction and an upper bound on the probabilistic extraction risk given any decoding configuration. We empirically evaluate extractability across different models, clarifying its connection to distinguishability, demonstrating its advantage over existing extraction risk estimators, and providing actionable mitigation guidelines across model training, API access, and decoding configurations in LLM API deployment. Our code is publicly available at: https://github.com/Emory-AIMS/Inextractability.

隐私安全大模型提取风险评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。