大模型能从差分隐私文本中还原敏感信息,暴露现有保护方法漏洞。
Reconstruction of Differentially Private Text Sanitization via Large Language Models
- 利用大模型的指令理解能力,通过样本对构建私有数据与去敏文本的关联
- 黑盒攻击在词级差分隐私下对多个大模型恢复率超70%,最高达94.01%
- 揭示主流大模型成为差分隐私文本清洗的新威胁,适合安全与隐私研究者关注
差分隐私(DP)是防范隐私泄露攻击的公认标准,包括近期针对大语言模型(LLMs)的多种攻击。然而我们发现,大模型能够从给定的差分隐私处理后的提示中重构出被修改或移除的敏感信息。本文提出两种攻击方式(黑盒与白盒),基于对大模型的访问程度,通过提供样本文本对作为指令(黑盒攻击)或微调数据(白盒攻击),实现将差分隐私文本与对应训练数据关联。我们在多个现代大模型(如LLaMA-2、LLaMA-3、ChatGPT-3.5、ChatGPT-4、ChatGPT-4o、Claude-3、Claude-3.5、OPT、GPT-Neo、GPT-J、Gemma-2、Pythia)上,使用常用数据集(WikiMIA、Pile-CC、Pile-Wiki)进行了全面实验,覆盖词级与句子级差分隐私。结果表明恢复率显著,例如在词级差分隐私下,对WikiMIA数据集的黑盒攻击中,LLaMA-2(70B)恢复率为72.18%,LLaMA-3(70B)为82.39%,Gemma-2为75.35%,ChatGPT-4o为91.2%,Claude-3.5(Sonnet)高达94.01%。该研究警示:当前主流大模型已成为差分隐私文本清洗方法的新安全隐患。
原文摘要 · Abstract (English)
Differential privacy (DP) is the de facto privacy standard against privacy leakage attacks, including many recently discovered ones against large language models (LLMs). However, we discovered that LLMs could reconstruct the altered/removed privacy from given DP-sanitized prompts. We propose two attacks (black-box and white-box) based on the accessibility to LLMs and show that LLMs could connect the pair of DP-sanitized text and the corresponding private training data of LLMs by giving sample text pairs as instructions (in the black-box attacks) or fine-tuning data (in the white-box attacks). To illustrate our findings, we conduct comprehensive experiments on modern LLMs (e.g., LLaMA-2, LLaMA-3, ChatGPT-3.5, ChatGPT-4, ChatGPT-4o, Claude-3, Claude-3.5, OPT, GPT-Neo, GPT-J, Gemma-2, and Pythia) using commonly used datasets (such as WikiMIA, Pile-CC, and Pile-Wiki) against both word-level and sentence-level DP. The experimental results show promising recovery rates, e.g., the black-box attacks against the word-level DP over WikiMIA dataset gave 72.18% on LLaMA-2 (70B), 82.39% on LLaMA-3 (70B), 75.35% on Gemma-2, 91.2% on ChatGPT-4o, and 94.01% on Claude-3.5 (Sonnet). More urgently, this study indicates that these well-known LLMs have emerged as a new security risk for existing DP text sanitization approaches in the current environment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。