arXiv:2504.00472cs.CLcs.AI2025-04ACL被引 4

提出四层知识注入框架,突破单纯记忆,实现深度知识融合。

Memorizing is Not Enough: Deep Knowledge Injection Through Reasoning

  • 构建记忆、检索、推理、关联四层知识注入框架
  • 实验证明不同知识类型需匹配不同注入方法
  • 适合需要动态更新知识的领域应用者参考

尽管大语言模型在知识回忆与推理方面表现优异,但其静态特性导致信息随现实变化而过时,或在适配特定领域知识时存在局限,亟需高效的知識注入机制。然而现有研究多停留在知识记忆与检索层面。本文提出一个四层知识注入框架,系统定义了知识注入的四个层次:记忆、检索、推理与关联。基于此框架,设计了DeepKnowledge合成测试平台,用于对三类知识(新知识、增量知识、更新知识)进行细粒度评估。通过探索多种知识注入场景并在基准上评估其深度,实验揭示了达到各层级知识注入的关键因素,并建立了知识注入层级与对应方法之间的映射关系,旨在为不同层级的知识注入提供全面高效的解决方案。

原文摘要 · Abstract (English)

Although large language models (LLMs) excel in knowledge recall and reasoning, their static nature leads to outdated information as the real world evolves or when adapting to domain-specific knowledge, highlighting the need for effective knowledge injection. However, current research on knowledge injection remains superficial, mainly focusing on knowledge memorization and retrieval. This paper proposes a four-tier knowledge injection framework that systematically defines the levels of knowledge injection: memorization, retrieval, reasoning, and association. Based on this framework, we introduce DeepKnowledge, a synthetic experimental testbed designed for fine-grained evaluation of the depth of knowledge injection across three knowledge types (novel, incremental, and updated). We then explore various knowledge injection scenarios and evaluate the depth of knowledge injection for each scenario on the benchmark. Experimental results reveal key factors to reach each level of knowledge injection for LLMs and establish a mapping between the levels of knowledge injection and the corresponding suitable injection methods, aiming to provide a comprehensive approach for efficient knowledge injection across various levels.

知识注入LLM推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。