arXiv:2501.06628cs.AI2025-01被引 2

用大模型和数学方法量化文物知识图谱关系有趣度,提升探索效果。

Quantifying Relational Exploration in Cultural Heritage Knowledge Graphs with LLMs: A Neuro-Symbolic Approach

  • 结合大模型生成解释,设计数学公式量化关系有趣度。
  • 在文物数据集上实现精确率0.70、召回率0.68、F1 0.69,显著优于基线。
  • 有趣度与解释质量强相关,适合文化遗产智能探索研究者。

本文提出一种神经符号方法,用于文化遗产品知识图谱中的关系探索,利用大语言模型(LLMs)生成解释,并引入新颖的数学框架量化关系有趣度。通过定量分析验证了有趣度度量的重要性,其对系统整体性能有显著影响,尤其在精确率、召回率和F1分数方面。基于Wikidata文化遗产品开放数据(WCH-LOD)数据集,本方法取得精确率0.70、召回率0.68、F1分数0.69,优于基于图的方法(精确率0.28、召回率0.25、F1 0.26)和基于知识的基线(精确率0.45、召回率0.42、F1 0.43)。此外,大模型生成的解释质量更高,BLEU为0.52,ROUGE-L为0.58,METEOR为0.63,均高于基线。有趣度度量与解释质量间存在0.65的强相关性,验证其有效性。结果表明,大模型与有趣度形式化对提升文化遗产品知识图谱的关系探索能力至关重要,且成果可测量、可验证。系统相较纯知识或图方法更具探索效率。

原文摘要 · Abstract (English)

This paper introduces a neuro-symbolic approach for relational exploration in cultural heritage knowledge graphs, leveraging Large Language Models (LLMs) for explanation generation and a novel mathematical framework to quantify the interestingness of relationships. We demonstrate the importance of interestingness measure using a quantitative analysis, by highlighting its impact on the overall performance of our proposed system, particularly in terms of precision, recall, and F1-score. Using the Wikidata Cultural Heritage Linked Open Data (WCH-LOD) dataset, our approach yields a precision of 0.70, recall of 0.68, and an F1-score of 0.69, representing an improvement compared to graph-based (precision: 0.28, recall: 0.25, F1-score: 0.26) and knowledge-based baselines (precision: 0.45, recall: 0.42, F1-score: 0.43). Furthermore, our LLM-powered explanations exhibit better quality, reflected in BLEU (0.52), ROUGE-L (0.58), and METEOR (0.63) scores, all higher than the baseline approaches. We show a strong correlation (0.65) between interestingness measure and the quality of generated explanations, validating its effectiveness. The findings highlight the importance of LLMs and a mathematical formalization for interestingness in enhancing the effectiveness of relational exploration in cultural heritage knowledge graphs, with results that are measurable and testable. We further show that the system enables more effective exploration compared to purely knowledge-based and graph-based methods.

知识图谱大模型文化遗产有趣度量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。