保护隐私的KG问答系统,让大模型无法窥探实体细节仍能准确检索。
Privacy-protected Retrieval-Augmented Generation for Knowledge Graph Question Answering
- 用关系和结构抽象将实体转为可检索概念
- 在不暴露实体语义下实现精准知识检索
- 适合需保护数据隐私的医疗/金融问答场景
大模型常出现幻觉或知识过时问题,RAG通过引入外部知识如知识图谱(KG)来缓解。然而,使用第三方API调用大模型时,私有KG存在隐私泄露风险。本文首次研究隐私保护下的RAG场景:让大模型无法访问实体语义,仅能看到匿名标识符。为此提出ARoG框架,解决两大挑战:(1) 如何将匿名实体转化为可检索信息;(2) 如何检索与问题相关的匿名实体。第一策略采用关系中心抽象,动态捕捉邻接关系语义,赋予实体高层概念;第二策略将自然语言问题转化为结构化抽象概念路径,提升与图谱中抽象概念的对齐能力。两策略严格保护隐私,实验在三个数据集上验证了ARoG在性能与隐私鲁棒性上的优越性。
原文摘要 · Abstract (English)
LLMs often suffer from hallucinations and outdated or incomplete knowledge. RAG is proposed to address these issues by integrating external knowledge like that in KGs into LLMs. However, leveraging private KGs in RAG systems poses significant privacy risks due to the black-box nature of LLMs and potential insecure data transmission, especially when using third-party LLM APIs lacking transparency and control. In this paper, we investigate the privacy-protected RAG scenario for the first time, where entities in KGs are anonymous for LLMs, thus preventing them from accessing entity semantics. Due to the loss of semantics of entities, previous RAG systems cannot retrieve question-relevant knowledge from KGs by matching questions with the meaningless identifiers of anonymous entities. To realize an effective RAG system in this scenario, two key challenges must be addressed: (1) How can anonymous entities be converted into retrievable information. (2) How to retrieve question-relevant anonymous entities. Hence, we propose a novel ARoG framework including relation-centric abstraction and structure-oriented abstraction strategies. For challenge (1), the first strategy abstracts entities into high-level concepts by dynamically capturing the semantics of their adjacent relations. It supplements meaningful semantics which can further support the retrieval process. For challenge (2), the second strategy transforms unstructured natural language questions into structured abstract concept paths. These paths can be more effectively aligned with the abstracted concepts in KGs, thereby improving retrieval performance. To guide LLMs to effectively retrieve knowledge from KGs, the two strategies strictly protect privacy from being exposed to LLMs. Experiments on three datasets demonstrate that ARoG achieves strong performance and privacy-robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。