用大模型生成更安全的文本替换词,既保隐私又留信息。
Truthful Text Sanitization Guided by Inference Attacks
- 用指令微调的大模型生成语义泛化词作为替换项
- 在文本匿名化基准上实现更高保留率,重识别风险仅升1个百分点
- 适合需要高保真度隐私保护的应用场景
文本去标识化旨在重写文档中包含个人身份信息(PII)的部分以防止泄露。核心挑战在于平衡隐私保护(避免个人信息泄露)与内容保留(尽可能维持原文信息)。为此,本文提出一种基于泛化的新方法:使用更宽泛但仍有信息量的术语替代原始文本片段。该方法分两阶段进行:首先利用指令微调的大语言模型(LLM)生成每个敏感片段的保真替换候选,并按抽象程度排序;随后通过推理攻击评估各候选项的隐私防护能力。最终选择在攻击下仍具鲁棒性且信息量最大的替换项。该过程显著提升了隐私与效用的平衡。我们还提出了无需人工标注的新指标来评估两者。在Text Anonymization Benchmark上的实验表明,采用Mistral 7B Instruct实现的方法,在保持高效用的同时,重识别风险仅增加小于1个百分点,优于Microsoft Presidio的合成替换方案。
原文摘要 · Abstract (English)
Text sanitization aims to rewrite parts of a document to prevent disclosure of personal information. The central challenge of text sanitization is to strike a balance between privacy protection (avoiding the leakage of personal information) and utility preservation (retaining as much as possible of the document's original content). To this end, we introduce a novel text sanitization method based on generalizations, that is, broader but still informative terms that subsume the semantic content of the original text spans. The approach relies on the use of instruction-tuned large language models (LLMs) and is divided into two stages. Given a document including text spans expressing personally identifiable information (PII), the LLM is first applied to obtain truth-preserving replacement candidates for each text span and rank those according to their abstraction level. Those candidates are then evaluated for their ability to protect privacy by conducting inference attacks with the LLM. Finally, the system selects the most informative replacement candidate shown to be resistant to those attacks. This two-stage process produces replacements that effectively balance privacy and utility. We also present novel metrics to evaluate these two aspects without needing to manually annotate documents. Results on the Text Anonymization Benchmark show that the proposed approach, implemented with Mistral 7B Instruct, leads to enhanced utility, with only a marginal (< 1 p.p.) increase in re-identification risk compared to fully suppressing the original spans. Furthermore, our approach is shown to be more truth-preserving than existing methods such as Microsoft Presidio's synthetic replacements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。