arXiv:2502.18509cs.CRcs.AI2025-02ACL被引 31

为对话模型设计隐私保护机制,自动识别并改写敏感信息。

Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agents

  • 在用户输入与大模型交互前,检测并重写无关或过量披露的信息
  • 在ShareGPT数据集上验证,轻量模型可实现强隐私保护且不损失目标意图
  • 76%用户更倾向改写后的提示,证明该方法实用有效

对话式代理正深入个人生活,但用户常低估其隐私风险。当用户向基于大语言模型的对话代理(LCAs)提供信息时,隐私即面临暴露风险。本文提出情境隐私概念,旨在确保用户仅披露达成目标所必需且相关的信息。通过初步设计用户研究发现,即使注重隐私的用户也常通过间接方式泄露敏感信息。基于此,我们提出一种本地部署的框架,位于用户与LCAs之间,识别并重写脱离上下文的信息。在ShareGPT数据集上的评估显示,轻量模型可有效实现该框架,在保持用户交互目标的同时显著提升情境隐私。人类评估中约76%参与者更偏好经改写的提示,验证了该框架的可用性与有效性。代码已开源:https://github.com/IBM/contextual-privacy-LLM。

原文摘要 · Abstract (English)

Conversational agents are increasingly woven into individuals' personal lives, yet users often underestimate the privacy risks associated with them. The moment users share information with these agents-such as large language models (LLMs)-their private information becomes vulnerable to exposure. In this paper, we characterize the notion of contextual privacy for user interactions with LLM-based Conversational Agents (LCAs). It aims to minimize privacy risks by ensuring that users (sender) disclose only information that is both relevant and necessary for achieving their intended goals when interacting with LCAs (untrusted receivers). Through a formative design user study, we observe how even "privacy-conscious" users inadvertently reveal sensitive information through indirect disclosures. Based on insights from this study, we propose a locally deployable framework that operates between users and LCAs, identifying and reformulating out-of-context information in user prompts. Our evaluation using examples from ShareGPT shows that lightweight models can effectively implement this framework, achieving strong gains in contextual privacy while preserving the user's intended interaction goals. Notably, about 76% of participants in our human evaluation preferred the reformulated prompts over the original ones, validating the usability and effectiveness of contextual privacy in our proposed framework. We opensource the code at https://github.com/IBM/contextual-privacy-LLM.

对话系统隐私保护大模型安全交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。