arXiv:2608.25489cs.LGcs.CL2026-08中稿 · SKGi 2026

用参数化适配器存储知识图谱,查询时零开销,但知识不靠语义相似性恢复。

A Storage-Retrieval Gap in Parametric Knowledge Graph Memory

  • 将知识图谱转为实体专属的LoRA适配器,通过权重注入实现零上下文开销查询
  • 单值关系上准确率提升0.243,正确适配器才能恢复知识(差距0.283)
  • 知识局部存储,语义相似性无法检索,需新机制实现适配器组合

图检索增强生成在查询时需重复加载子图,产生持续的令牌开销并暴露源数据。本文提出替代方案:离线将知识图谱编译为每个实体对应的LoRA适配器库,作为参数化知识层,通过注入权重而非文本进行查询,实现零查询时上下文成本。在MetaQA数据集上,子图训练的适配器可编码无上下文的事实知识并泛化至未见问题:对单值关系,适配器相比几乎盲目的基础模型(0.007)提升0.243的精确匹配分数,且仅正确适配器能恢复该知识(典例差距达+0.283)。然而,当查询无子图时,基于嵌入和权重空间几何的检索均表现随机,因语义相近实体的适配器不包含答案——知识是局部存储,不具备迁移性。权重几何与子图语义相关(ρ= +0.329),但不决定可检索性。我们量化了字节与上下文令牌成本,并讨论部署影响。结果表明参数化知识图谱记忆可行,但如何选择与组合适配器超越语义相似性成为核心开放问题,亟需学习型、查询条件化的组合机制。

原文摘要 · Abstract (English)

Graph retrieval-augmented generation places retrieved subgraphs into the model's context window at query time, paying a recurring token cost and exposing source data on every call. We study an alternative: compiling a knowledge graph offline into a bank of LoRA adapters, one per entity, that serve as a parametric knowledge layer queried by injecting weights rather than text, at zero query-time context cost. On the MetaQA dataset, we find that subgraph-trained adapters encode context-free factual knowledge that generalizes to unseen questions: on single-valued relations the adapter gains $+0.243$ exact-match score over a base model that is nearly blind closed-book ($0.007$), and only the correct adapter recovers this knowledge (an oracle gap of $+0.283$ over the base model). However, the stored knowledge is not recoverable by similarity: given a query with no subgraph, embedding-based and weight-space geometry retrieval both perform at chance, because a semantically neighbouring entity's adapter does not contain the answer - knowledge is stored locally and does not transfer. Weight geometry correlates with subgraph semantics ($ρ= +0.329$) but not with functional retrievability. We quantify the byte and context-token costs against graph retrieval-augmented generation and discuss deployment implications. Our results establish that parametric knowledge graph memory is feasible for storing knowledge, and identify selecting and composing the right adapters by a mechanism other than semantic similarity as the central open problem - motivating a learned, query-conditioned composition mechanism.

知识图谱参数化记忆LoRA检索机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。