arXiv:2506.17336cs.CRcs.AI2025-06被引 10

让大模型在不碰用户隐私数据的情况下,通过加密搜索完成复杂任务。

PPMI: Privacy-Preserving LLM Interaction with Socratic Chain-of-Thought Reasoning and Homomorphically Encrypted Vector Databases

  • 用苏格拉底式思维链生成子问题,远程大模型不接触真实数据
  • 对百万级私密数据进行秒级加密语义搜索,结果解密后本地生成回复
  • 适合注重隐私的个人助手场景,尤其对医疗、邮件等敏感信息保护有优势

大型语言模型(LLM)正越来越多地作为个人代理使用,访问日历、邮件和医疗记录等敏感用户数据。当前用户面临权衡:将私人记录发送给强大但不可信的LLM服务商,增加泄露风险;或在可信设备上运行较弱的本地模型。本文提出解决方案:首先将通用非隐私查询发送至不可信的强大LLM,生成思维链(CoT)提示和详细子查询,不访问用户数据;随后将子查询嵌入并使用同态加密向量数据库,在单个用户的百万级私密数据中执行加密的亚秒级语义搜索;最后将解密后的记录与CoT提示输入本地语言模型,生成最终回答。在LoCoMo长上下文问答基准上,结合GPT-4o与本地Llama-3.2-1B模型的混合框架,相比仅使用GPT-4o提升最高达7.1个百分点。这标志着首次实现任务在不可信强模型与本地弱模型间分解协作,同时保障用户隐私。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly used as personal agents, accessing sensitive user data such as calendars, emails, and medical records. Users currently face a trade-off: They can send private records, many of which are stored in remote databases, to powerful but untrusted LLM providers, increasing their exposure risk. Alternatively, they can run less powerful models locally on trusted devices. We bridge this gap. Our Socratic Chain-of-Thought Reasoning first sends a generic, non-private user query to a powerful, untrusted LLM, which generates a Chain-of-Thought (CoT) prompt and detailed sub-queries without accessing user data. Next, we embed these sub-queries and perform encrypted sub-second semantic search using our Homomorphically Encrypted Vector Database across one million entries of a single user's private data. This represents a realistic scale of personal documents, emails, and records accumulated over years of digital activity. Finally, we feed the CoT prompt and the decrypted records to a local language model and generate the final response. On the LoCoMo long-context QA benchmark, our hybrid framework, combining GPT-4o with a local Llama-3.2-1B model, outperforms using GPT-4o alone by up to 7.1 percentage points. This demonstrates a first step toward systems where tasks are decomposed and split between untrusted strong LLMs and weak local ones, preserving user privacy.

隐私保护大模型加密搜索本地推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。