arXiv:2609.03662cs.LG2026-09

攻击者可从遗忘模型中逆向提取被遗忘的提示,威胁数据隐私。

Extracting Forgotten Prompts from Targeted Unlearned Models

论文配图:Extracting Forgotten Prompts from Targeted Unlearned Models
图 1 · 摘自论文原文
  • 基于保留数据和黑盒访问,设计主动搜索策略定位遗忘实体。
  • 在3个数据集上100%准确恢复遗忘实体,95%重建被遗忘提示。
  • 查询效率比传统方法提升99.7倍,适合研究模型安全漏洞者。

现有遗忘方法(如NPO、DPO、LUNAR)通过拒绝响应抑制遗忘数据,但拒绝响应可能留下痕迹,已有攻击可恢复部分遗忘知识。本文揭示新漏洞:传统攻击假设遗忘提示已知,仅恢复其答案;而我们发现,利用保留数据和黑盒访问,可直接提取遗忘提示本身。提出目标主动搜索(TAS)攻击:先构建标准模板与实体池,通过有限查询预算筛选最具信息量的模板-实体对识别遗忘实体;再用这些实体填充提示模板,探测模型并重构遗忘提示。在三个未学习方法、三个数据集和三个大语言模型上的实验表明,TAS以最高99.7%的查询减少,实现100%遗忘实体恢复及最高95%遗忘提示重建。

原文摘要 · Abstract (English)

Recent unlearning methods (e.g. NPO, DPO, LUNAR) make use of refusal alignment to suppress forgotten data. However, it has been shown that refusal responses might leave traces of unlearning, and recent attacks have been able to successfully recover some of the unlearned knowledge. In this paper, we uncover a new vulnerability. Existing attacks typically assume that the forgotten prompts are already known to the adversary and focus on recovering their answers. However, we show that the forgotten prompts themselves can be extracted by using the retained data and black-box access to the model. Our attack, Targeted Active Search (TAS), first identifies the forgotten entities by constructing canonical templates and entity pool, and selectively querying the model using the most informative template-entity pair under a limited query budget. Once the entities are identified, TAS instantiates prompt templates with those entities to probe the unlearned model and reconstruct the forgotten prompts. Experiments across three unlearning methods with three datasets and three LLMs shows that TAS recovers the forgotten entity with $100\%$ accuracy and reconstructs up to $95\%$ of forgotten prompts, all while using up to $99.7\%$ fewer queries than naive probing.

模型安全数据遗忘提示提取大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。