让大模型主动调用内部知识,还能验证其真实性。
From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning

- 分两阶段训练:先显式插入证据,再隐式推理
- 80%以上插入的三元组是上下文无法推导出的事实
- 适合需要可验证知识的问答系统研究者
尽管大语言模型(LLMs)在其参数中编码了丰富的事实知识,但可靠地召回和验证这些知识仍是事实问答中的关键瓶颈。现有端到端方法将知识提取与推理纠缠在一起,难以判断正确答案是源于参数化知识还是输入上下文。为此,我们提出VAKE(Verifiable Activation of Parametric Knowledge),一个两阶段强化学习框架,通过显式提示(Priming)外化潜在的参数化知识,并将获取的知识提取能力迁移到隐式推理(Reasoning)中。给定查询和不充分的检索子图,提示策略显式插入桥接三元组作为可验证证据,奖励由在增强子图上运行的独立冻结模型生成的答案提供。基于提示阶段学习到的策略,推理阶段训练模型从原始输入作答,测试知识提取能力是否可迁移至隐式推理。在七个基准测试和3B至14B规模的多个模型上,VAKE始终优于标准基线,包括直接从HotpotQA迁移到分布外(OOD)数据集的情况。基于LLM的评估显示,超过80%插入的三元组提供了上下文无法推导出的桥接事实知识,且超过一半能激发直接提示无法获取的知识。结果表明,VAKE激活的是潜在的参数化知识,而非复制输入上下文或记忆数据集特定关联。
原文摘要 · Abstract (English)
Although Large Language Models (LLMs) encode rich factual knowledge in their parameters, reliably recalling and verifying such knowledge remains a key bottleneck in factual question answering. Existing end-to-end methods entangle knowledge elicitation with reasoning, making it difficult to determine whether correct answers arise from parametric knowledge or the input context. To address this challenge, we propose VAKE (Verifiable Activation of Parametric KnowledgE), a two-stage reinforcement-learning framework that externalizes latent parametric knowledge through explicit Priming and transfers the acquired elicitation capability to implicit Reasoning. Given a query and an insufficient retrieved subgraph, the Priming policy explicitly inserts bridging triples as verifiable evidence, with supervision provided by rewards derived from answers generated by a separate frozen model over the augmented subgraph. Building on the policy learned during Priming, the Reasoning stage trains the model to answer from the original input, testing whether the capability acquired through explicit knowledge elicitation transfers to implicit reasoning. Experiments across seven benchmarks and models from 3B to 14B show that VAKE consistently outperforms standard baselines, including when transferring directly from HotpotQA to OOD datasets. LLM-based evaluation further shows that over 80% of the inserted triples provide factual bridging knowledge not derivable from the retrieved context, while more than half elicit knowledge inaccessible through direct prompting. These results suggest that VAKE activates latent parametric knowledge rather than copying the input context or memorizing dataset-specific associations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。