用知识图谱和大模型从论文中自动提取问答对,快速提炼核心贡献。
Question-Answer Extraction from Scientific Articles Using Knowledge Graphs and Large Language Models
- 结合知识图谱与大模型,从科学文献中生成高质量问答对。
- 基于实体关系三元组的中心性度量,精准识别文章关键内容。
- 在真实专家评估中表现优异,适合科研人员快速筛选论文。
学者在决定是否阅读或引用某篇论文时,常需快速把握其核心思想。本文旨在将科学论文中的关键概念与贡献以问答对(QA)形式自动提取。提出两种方法:第一种仅依赖文章内容,通过大模型生成问题并根据答案可得性排序,再生成答案;第二种引入知识图谱(KG),先在科学文献上微调实体关系(ER)抽取模型构建图谱,再利用三元组的中心性度量(类似TF-IDF)筛选最相关的实体关系。该度量衡量三元组在单篇文章中的重要性与其在文献中的普遍性之比。通过领域专家评估,两种方法均有效,其中基于知识图谱的方法更准确捕捉论文核心思想。结果表明,在科学语料上微调ER模型对生成高质量三元组至关重要。
原文摘要 · Abstract (English)
When deciding to read an article or incorporate it into their research, scholars often seek to quickly identify and understand its main ideas. In this paper, we aim to extract these key concepts and contributions from scientific articles in the form of Question and Answer (QA) pairs. We propose two distinct approaches for generating QAs. The first approach involves selecting salient paragraphs, using a Large Language Model (LLM) to generate questions, ranking these questions by the likelihood of obtaining meaningful answers, and subsequently generating answers. This method relies exclusively on the content of the articles. However, assessing an article's novelty typically requires comparison with the existing literature. Therefore, our second approach leverages a Knowledge Graph (KG) for QA generation. We construct a KG by fine-tuning an Entity Relationship (ER) extraction model on scientific articles and using it to build the graph. We then employ a salient triplet extraction method to select the most pertinent ERs per article, utilizing metrics such as the centrality of entities based on a triplet TF-IDF-like measure. This measure assesses the saliency of a triplet based on its importance within the article compared to its prevalence in the literature. For evaluation, we generate QAs using both approaches and have them assessed by Subject Matter Experts (SMEs) through a set of predefined metrics to evaluate the quality of both questions and answers. Our evaluations demonstrate that the KG-based approach effectively captures the main ideas discussed in the articles. Furthermore, our findings indicate that fine-tuning the ER extraction model on our scientific corpus is crucial for extracting high-quality triplets from such documents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。