arXiv:2603.17217cs.CLcs.AI2026-03被引 2

用本地大模型替换文本敏感信息,既保隐私又可用。

Anonymous-by-Construction: An LLM-Driven Framework for Privacy-Preserving Text

  • 本地运行大模型,用真实替代词替换敏感信息
  • 隐私保护优于主流工具,语义损失小,微调影响低
  • 适合需保密的问答代理和数据微调场景

负责任的AI使用要求在不损害数据价值的前提下保护敏感信息,这一需求在大语言模型时代尤为迫切。本文提出一种本地部署的LLM驱动替换流程,通过将个人身份信息(PII)替换为类型一致、真实的替代词来实现文本匿名化。整个过程在组织内部完成,避免数据外泄,同时保持文本流畅性和任务相关语义。我们在Action-Based Conversation Dataset上进行了系统性多指标评估,对比了行业标准(Microsoft Presidio、Google DLP)和前沿方法(ZSTS,含仅删除与删除+替换两种变体)。评估包含隐私性、语义效用与可训练性三方面,采用在清洗后文本上微调紧凑编码器(BERT+LoRA)的生命周期就绪标准。此外,通过在回答型LLM前加入本地匿名层,评估其生成回答的质量,验证中间替换阶段能有效防止敏感内容暴露于第三方API,支持安全的问答代理部署。结果表明,该方法在隐私性、主题漂移最小化、事实效用及训练损失控制上均达领先水平,优于规则方法、命名实体识别基线及ZSTS变体,在隐私-效用-可训练性综合性能上表现卓越。证明本地大模型替换生成的匿名语料既符合责任使用要求,又具备实际应用价值:适用于智能代理流程,且下游微调时降损极小。

原文摘要 · Abstract (English)

Responsible use of AI demands that we protect sensitive information without undermining the usefulness of data, an imperative that has become acute in the age of large language models. We address this challenge with an on-premise, LLM-driven substitution pipeline that anonymizes text by replacing personally identifiable information (PII) with realistic, type-consistent surrogates. Executed entirely within organizational boundaries using local LLMs, the approach prevents data egress while preserving fluency and task-relevant semantics. We conduct a systematic, multi-metric, cross-technique evaluation on the Action-Based Conversation Dataset, benchmarking against industry standards (Microsoft Presidio and Google DLP) and a state-of-the-art approach (ZSTS, in redaction-only and redaction-plus-substitution variants). Our protocol jointly measures privacy, semantic utility, and trainability under privacy via a lifecycle-ready criterion obtained by fine-tuning a compact encoder (BERT+LoRA) on sanitized text. In addition, we assess agentic Q&A performance by inserting an on-premise anonymization layer before the answering LLM and evaluating the quality of its responses. This intermediate, type-preserving substitution stage ensures that no sensitive content is exposed to third-party APIs, enabling responsible deployment of Q\&A agents without compromising confidentiality. Our method attains state-of-the-art privacy, minimal topical drift, strong factual utility, and low trainability loss, outperforming rule-based approaches and named-entity recognition (NER) baselines and ZSTS variants on the combined privacy--utility--trainability frontier. These results show that local LLM substitution yields anonymized corpora that are both responsible to use and operationally valuable: safe for agentic pipelines and suitable for downstream fine-tuning with limited degradation.

隐私保护文本匿名大模型本地部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。