arXiv:2502.05478cs.CL2025-02中稿 · WWW25被引 17

用知识图谱引导大模型自我训练,提升医学领域知识组织能力。

OntoTune: Ontology-Driven Self-training for Aligning Large Language Models

  • 基于本体的自训练框架,通过上下文学习识别知识缺口并补全
  • 在医疗本体任务中超越现有方法,问答准确率显著提升
  • 无需新数据收集,降低维护成本且更好保留原始模型知识

现有领域专用大语言模型通常通过大规模领域语料微调通用大模型构建,但此类训练难以有效组织模型中的领域知识,导致理解碎片化。受人类通过思维导图关联概念的启发,我们提出一种基于本体的自训练框架 OntoTune,利用具有层级结构的概念知识重组织大模型的领域知识。该方法通过上下文学习判断模型是否掌握特定概念的本体知识,并将未掌握条目作为训练集进一步对齐模型与本体,实现基于本体引导的响应生成。相比依赖新收集大规模领域语料的方法,OntoTune 仅使用已有的长期积累本体(如医学标准本体 SNOMED CT)和模型自身,显著降低数据维护成本,且具备更强泛化能力。在医疗领域实验表明,OntoTune 在本体内超类发现与本体外医疗问答任务上均达到当前最优性能;相较于最新的本体注入方法 TaxoLLaMA,其更能有效保留模型原有知识。代码与数据已公开于 https://github.com/zjukg/OntoTune。

原文摘要 · Abstract (English)

Existing domain-specific Large Language Models (LLMs) are typically developed by fine-tuning general-purposed LLMs with large-scale domain-specific corpora. However, training on large-scale corpora often fails to effectively organize domain knowledge of LLMs, leading to fragmented understanding. Inspired by how humans connect concepts and organize knowledge through mind maps, we aim to emulate this approach by using ontology with hierarchical conceptual knowledge to reorganize LLM's domain knowledge. From this perspective, we propose an ontology-driven self-training framework called OntoTune, which aims to align LLMs with ontology through in-context learning, enabling the generation of responses guided by the ontology. We leverage in-context learning to identify whether the LLM has acquired the specific concept's ontology knowledge, and select the entries not yet mastered by LLM as the training set to further align the LLM with ontology. Compared to existing domain LLMs based on newly collected large-scale domain-specific corpora, our OntoTune, which relies on the existing, long-term developed ontology and LLM itself, significantly reduces data maintenance costs and offers improved generalization ability. We conduct our study in the medical domain to evaluate the effectiveness of OntoTune, utilizing a standardized medical ontology, SNOMED CT as our ontology source. Experimental results demonstrate that OntoTune achieves state-of-the-art performance in both in-ontology task hypernym discovery and out-of-ontology task medical domain QA. Moreover, compared to the latest direct ontology injection method TaxoLLaMA, our OntoTune better preserves original knowledge of LLM. The code and data are available at https://github.com/zjukg/OntoTune.

大模型对齐知识图谱自训练医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。