arXiv:2601.08739cs.CL2026-01被引 12

保护隐私的图检索框架,让大模型安全使用私有知识图谱推理。

PrivGemo: Privacy-Preserving Dual-Tower Graph Retrieval for Empowering LLM Reasoning with Memory Augmentation

  • 双塔结构本地保留知识图谱,远程仅交互匿名化视图。
  • 支持多跳多实体推理,实验显示性能领先基线17.1%。
  • 适合需保护数据隐私的医疗、金融等场景下的智能问答。

知识图谱(KG)为知识密集型问答提供结构化证据,可增强大语言模型(LLM)的推理能力。然而,许多实际知识图谱为私有数据,向闭源LLM API传输检索三元组或探索路径存在泄露风险。现有隐私保护方法仅掩码实体名称,仍存在语义掩码下的结构泄露、不可控远程交互、多跳多实体推理脆弱及经验复用有限等问题。为此,本文提出PrivGemo,一种隐私保护的检索增强型知识图谱推理框架,采用记忆引导的暴露控制机制。PrivGemo通过双塔设计在本地保留原始知识图谱,远程仅交互匿名化视图,超越名称掩码,限制语义与结构暴露。通过检索连接所有主题实体的匿名化长路径,支持多跳、多实体推理,同时保持推理与验证在本地进行。引入分层控制器和隐私感知经验记忆,减少不必要的探索与远程交互。在六个基准上的综合实验表明,PrivGemo达到当前最优整体性能,较最强基线提升最高达17.1%。此外,该框架使较小模型(如Qwen3-4B)推理性能媲美GPT-4-Turbo。

原文摘要 · Abstract (English)

Knowledge graphs (KGs) provide structured evidence that can ground large language model (LLM) reasoning for knowledge-intensive question answering. However, many practical KGs are private, and sending retrieved triples or exploration traces to closed-source LLM APIs introduces leakage risk. Existing privacy treatments focus on masking entity names, but they still face four limitations: structural leakage under semantic masking, uncontrollable remote interaction, fragile multi-hop and multi-entity reasoning, and limited experience reuse for stability and efficiency. To address these issues, we propose PrivGemo, a privacy-preserving retrieval-augmented framework for KG-grounded reasoning with memory-guided exposure control. PrivGemo uses a dual-tower design to keep raw KG knowledge local while enabling remote reasoning over an anonymized view that goes beyond name masking to limit both semantic and structural exposure. PrivGemo supports multi-hop, multi-entity reasoning by retrieving anonymized long-hop paths that connect all topic entities, while keeping grounding and verification on the local KG. A hierarchical controller and a privacy-aware experience memory further reduce unnecessary exploration and remote interactions. Comprehensive experiments on six benchmarks show that PrivGemo achieves overall state-of-the-art results, outperforming the strongest baseline by up to 17.1%. Furthermore, PrivGemo enables smaller models (e.g., Qwen3-4B) to achieve reasoning performance comparable to that of GPT-4-Turbo.

知识图谱隐私保护大模型推理检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。