让大模型学会推理新知识,而非仅记忆事实。
PropMEND: Hypernetworks for Knowledge Propagation in LLMs
- 用超网络元学习调整梯度,让注入知识可被推理使用。
- 在多跳问答任务上准确率接近翻倍,答案不直接来自原文。
- 适合需要知识推理的场景,如智能助手、知识库问答。
大型语言模型的知识编辑技术可实现知识的精准复现,但难以实现知识传播:模型无法基于注入知识进行推理回答。本文提出基于超网络的知识传播方法PropMEND,通过元学习调整语言建模损失的梯度,使知识注入后能支持多跳推理。该方法扩展了MEND的元目标,使知识更新后的梯度变化可促进推理能力。在RippleEdit数据集上,多跳问题准确率几乎提升2倍,且答案未显式存在于注入事实中。此外,我们引入新数据集Controlled RippleEdit,评估超网络在训练时未见的关系与实体上的泛化能力。PropMEND在未见过的实体-关系对上仍优于现有方法,但性能差距显著缩小,表明未来需进一步提升跨关系的知识传播能力。
原文摘要 · Abstract (English)
Knowledge editing techniques for large language models (LLMs) can inject knowledge that is later reproducible verbatim, but they fall short on propagating that knowledge: models cannot answer questions that require reasoning with the injected knowledge. We present a hypernetwork-based approach for knowledge propagation, named PropMEND, where we meta-learn how to modify gradients of a language modeling loss to encourage injected information to propagate. Our approach extends the meta-objective of MEND [29] so that gradient updates on knowledge are transformed to enable answering multi-hop questions involving that knowledge. We show improved performance on the RippleEdit dataset, showing almost 2x accuracy on challenging multi-hop questions whose answers are not explicitly stated in the injected fact. We further introduce a new dataset, Controlled RippleEdit, to evaluate the generalization of our hypernetwork, testing knowledge propagation along relations and entities unseen during hypernetwork training. PropMEND still outperforms existing approaches in unseen entity-relation pairs, yet the performance gap decreases substantially, suggesting future work in propagating knowledge to a wide range of relations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。