用大模型补全知识图谱语义,提升节点重要性评估效果
Node Importance Estimation Leveraging LLMs for Semantic Augmentation in Knowledge Graphs
- 通过聚类采样和自适应提示,融合大模型与图谱知识
- 在多个数据集上显著提升节点重要性评分准确率
- 适合做知识图谱增强、节点排序的研究者使用
节点重要性估计(NIE)旨在量化图中节点的重要性。现有方法依赖知识图谱(KG)中的信息,但其语义常不完整、缺失或错误,限制了模型性能。为此,我们利用大语言模型(LLMs)的外部知识,提出LENIE方法,通过聚类采样策略提取节点多样知识,结合节点特定自适应提示,将原始描述与采样三元组输入LLM,生成更丰富精确的增强描述,用于初始化节点嵌入,从而提升下游NIE模型表现。实验表明,该方法有效缓解知识图谱语义不足问题,实现当前最优性能。代码已开源。
原文摘要 · Abstract (English)
Node Importance Estimation (NIE) is a task that quantifies the importance of node in a graph. Recent research has investigated to exploit various information from Knowledge Graphs (KGs) to estimate node importance scores. However, the semantic information in KGs could be insufficient, missing, and inaccurate, which would limit the performance of existing NIE models. To address these issues, we leverage Large Language Models (LLMs) for semantic augmentation thanks to the LLMs' extra knowledge and ability of integrating knowledge from both LLMs and KGs. To this end, we propose the LLMs Empowered Node Importance Estimation (LENIE) method to enhance the semantic information in KGs for better supporting NIE tasks. To our best knowledge, this is the first work incorporating LLMs into NIE. Specifically, LENIE employs a novel clustering-based triplet sampling strategy to extract diverse knowledge of a node sampled from the given KG. After that, LENIE adopts the node-specific adaptive prompts to integrate the sampled triplets and the original node descriptions, which are then fed into LLMs for generating richer and more precise augmented node descriptions. These augmented descriptions finally initialize node embeddings for boosting the downstream NIE model performance. Extensive experiments demonstrate LENIE's effectiveness in addressing semantic deficiencies in KGs, enabling more informative semantic augmentation and enhancing existing NIE models to achieve the state-of-the-art performance. The source code of LENIE is freely available at \url{https://github.com/XinyuLin-FZ/LENIE}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。