用小模型本地化匿名化用户文本,保护隐私还保留内容质量。
AgentStealth: Reinforcing Large Language Model for Anonymizing User-generated Text
- 通过对抗性流程与自适应控制提升匿名化能力
- 在两个数据集上匿名效果提升12.3%,内容可用性提升6.8%
- 可部署于边缘设备,适合对隐私敏感的应用场景
当前数字环境中,用户生成内容常隐含可能暴露个人属性的细微线索,亟需有效文本匿名化以保护隐私。现有方法或依赖僵硬替换损害信息效用,或依赖云端大模型带来成本与隐私风险。为此,我们探索本地部署的小规模语言模型(SLMs)用于匿名化。但受限于高质量监督数据,训练高效SLMs仍具挑战。为此提出AgentStealth:首先引入基于上下文对比学习与自适应效用感知控制的对抗性匿名流程;其次利用该流程生成的高质量数据(含匿名化与攻击信号)对SLMs进行有监督微调;最后采用在线强化学习,使模型基于内部对抗反馈持续优化性能。在两个数据集上的实验表明,本方法在匿名有效性(+12.3%)与内容效用(+6.8%)上均优于基线。轻量设计支持直接部署于边缘设备,避免云依赖与通信带来的隐私风险。代码开源:https://github.com/tsinghua-fib-lab/AgentStealth。
原文摘要 · Abstract (English)
In today's digital world, casual user-generated content often contains subtle cues that may inadvertently expose sensitive personal attributes. Such risks underscore the growing importance of effective text anonymization to safeguard individual privacy. However, existing methods either rely on rigid replacements that damage utility or cloud-based LLMs that are costly and pose privacy risks. To address these issues, we explore the use of locally deployed smaller-scale language models (SLMs) for anonymization. Yet training effective SLMs remains challenging due to limited high-quality supervision. To address the challenge, we propose AgentStealth, a self-reinforcing LLM anonymization framework.First, we introduce an adversarial anonymization workflow enhanced by In-context Contrastive Learning and Adaptive Utility-Aware Control. Second, we perform supervised adaptation of SLMs using high-quality data collected from the workflow, which includes both anonymization and attack signals. Finally, we apply online reinforcement learning where the model leverages its internal adversarial feedback to iteratively improve anonymization performance. Experiments on two datasets show that our method outperforms baselines in both anonymization effectiveness (+12.3%) and utility (+6.8%). Our lightweight design supports direct deployment on edge devices, avoiding cloud reliance and communication-based privacy risks. Our code is open-source at https://github.com/tsinghua-fib-lab/AgentStealth.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。