让聊天模型保护隐私,不泄露人名也不丢对话质量。
Whistledown: Combining User-Level Privacy with Conversational Coherence in LLMs
- 用假名+差分隐私技术处理用户输入,提前脱敏
- 本地或企业网关部署,计算开销极低可实时运行
- 无需改API,适合个人和企业保护敏感对话
用户越来越多地使用大语言模型(LLMs)进行涉及个人情感、社交敏感内容的对话。但发送至云端模型的提示词可能包含个人身份信息(PII),用户不希望这些信息被记录、保留或泄露。尤其在讨论朋友、同事或对手时——即‘爆猛料’场景下,问题尤为突出。企业使用模型处理内部沟通与决策时也面临相同挑战。本文提出Whistledown,一种尽力而为的隐私保护层,可在提示词发送至LLM前进行处理。它结合伪匿名化与$ε$-局部差分隐私($ε$-LDP)技术,并采用转换缓存机制,在不牺牲对话连贯性的情况下提供隐私保护。Whistledown设计为低计算与内存开销,支持个人用户直接在设备端部署;对企业用户,则可集中部署于零信任网关中,运行于企业可信基础设施上。该方案无需修改主流LLM提供商的现有API。
原文摘要 · Abstract (English)
Users increasingly rely on large language models (LLMs) for personal, emotionally charged, and socially sensitive conversations. However, prompts sent to cloud-hosted models can contain personally identifiable information (PII) that users do not want logged, retained, or leaked. We observe this to be especially acute when users discuss friends, coworkers, or adversaries, i.e., when they spill the tea. Enterprises face the same challenge when they want to use LLMs for internal communication and decision-making. In this whitepaper, we present Whistledown, a best-effort privacy layer that modifies prompts before they are sent to the LLM. Whistledown combines pseudonymization and $ε$-local differential privacy ($ε$-LDP) with transformation caching to provide best-effort privacy protection without sacrificing conversational utility. Whistledown is designed to have low compute and memory overhead, allowing it to be deployed directly on a client's device in the case of individual users. For enterprise users, Whistledown is deployed centrally within a zero-trust gateway that runs on an enterprise's trusted infrastructure. Whistledown requires no changes to the existing APIs of popular LLM providers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。