用大模型端到端构建知识图谱骨架,提升结构与语义准确性。
End-to-End Ontology Learning with Large Language Models
- 通过微调大模型并引入正则化,整体学习知识图谱组件
- 在维基百科上生成的本体比分解任务方法更准确且结构完整
- 只需少量样本即可适配新领域,如arXiv论文知识体系
本体有助于机器自动处理领域知识,但构建过程需大量人工。现有方法利用大语言模型(LLM)解决部分子任务,但未考虑任务间的相互作用。本文提出OLLM,一种从零开始构建本体分类骨架的通用可扩展方法。不聚焦于单个实体关系,而是通过定制正则化微调LLM,减少对高频概念的过拟合,整体建模目标本体子组件。设计了一套新型评估指标,基于深度学习技术衡量生成本体与真实本体在语义和结构上的相似性,相比传统指标更具鲁棒性。在维基百科上的实验表明,OLLM优于子任务组合方法,在保持结构完整性的同时实现更高语义准确性。进一步验证了模型仅需少量训练样本即可有效迁移至arXiv等新领域。代码与数据集已开源。
原文摘要 · Abstract (English)
Ontologies are useful for automatic machine processing of domain knowledge as they represent it in a structured format. Yet, constructing ontologies requires substantial manual effort. To automate part of this process, large language models (LLMs) have been applied to solve various subtasks of ontology learning. However, this partial ontology learning does not capture the interactions between subtasks. We address this gap by introducing OLLM, a general and scalable method for building the taxonomic backbone of an ontology from scratch. Rather than focusing on subtasks, like individual relations between entities, we model entire subcomponents of the target ontology by finetuning an LLM with a custom regulariser that reduces overfitting on high-frequency concepts. We introduce a novel suite of metrics for evaluating the quality of the generated ontology by measuring its semantic and structural similarity to the ground truth. In contrast to standard metrics, our metrics use deep learning techniques to define more robust distance measures between graphs. Both our quantitative and qualitative results on Wikipedia show that OLLM outperforms subtask composition methods, producing more semantically accurate ontologies while maintaining structural integrity. We further demonstrate that our model can be effectively adapted to new domains, like arXiv, needing only a small number of training examples. Our source code and datasets are available at https://github.com/andylolu2/ollm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。