用智能方法混淆用户提问中的敏感信息,既保护隐私又不损失回复质量。
PromptPET: Privacy-Utility Optimized Prompt Obfuscation

- 基于大模型的智能选择机制,动态决定如何混淆敏感内容。
- 在真实聊天数据上,隐私与回复质量平衡优于现有最佳方案。
- 首次将强化学习思想用于隐私混淆决策,适合注重隐私的AI应用开发者。
用户与AI聊天时可能无意泄露敏感信息,导致个人画像风险。本文提出用户侧隐私保护机制,通过变换提示中的敏感内容,在避免被建模的同时保留足够信息以获得有用回复。该方法面临隐私保护与响应效用之间的固有权衡。研究评估并比较了四种混淆策略:删除、抽象、替换及一种新提出的噪声/去噪方案。创新点包括:利用数据类型分类体系识别并混淆敏感信息,以及显式考虑回复效用来指导混淆决策。首先独立优化每种策略的隐私-效用平衡;其次提出PROMPTPET——一个基于大模型的代理系统,采用受强化学习启发的规则优化器,首次应用于此场景,为每个敏感部分自动选择最优混淆方式。基于真实聊天数据集验证,PROMPTPET达到单个混淆策略所能实现的最佳隐私-效用平衡,并显著超越现有先进方法。
原文摘要 · Abstract (English)
Privacy is an important challenge when users interact with AI chatbots, since users may share sensitive information, explicitly or implicitly, and AI chatbots can use this information for user profiling. In this paper, we aim to protect user privacy via a user-side mechanism that transforms sensitive information in a user prompt, while preserving enough information to elicit a useful response from the chatbot. This approach faces an inherent tradeoff between protecting privacy (i.e., avoiding profiling) and preserving utility (i.e., getting personalized and task-specific responses). To that end, we consider, evaluate, and compare four different obfuscation actions, namely redaction, abstraction, replacement, and a novel noising/denoising scheme that we introduce. Additional novel insights include: utilizing a data type taxonomy to both identify and obfuscate sensitive information and explicitly taking into account the utility of chat responses in making the obfuscation decision. First, we systematically optimize and evaluate each obfuscation action independently in terms of the privacy-utility tradeoff it achieves. Second, we propose PROMPTPET, an LLM-based agent that selects the best obfuscation action for each sensitive part of the prompt, using a reinforcement-learning inspired rule optimizer, applied for the first time in this context. Using a real-world chat dataset, we show that PROMPTPET matches the best privacy-utility tradeoff attainable by any single obfuscation action and significantly outperforms prior state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。