用大模型构建科学知识图谱,一键洞察跨领域研究趋势
What's In Your Field? Mapping Scientific Research with Knowledge Graphs and Large Language Models
- 用大模型从论文中提取结构化科学概念,构建跨领域知识图谱
- 基于3万篇arXiv论文,识别出天体物理、流体力学等领域的新兴趋势
- 仅需20篇人工标注即可生成通用科学概念框架,适合科研人员快速导航
科学文献的指数级增长使得跨学科知识的导航与整合日益困难。大语言模型(LLMs)虽能理解科学文本,却难以捕捉大规模文献间的精细关系。传统检索增强生成方法可筛选相关事实,但在数百万条信息影响答案时成本过高。结构化表示提供天然补充——支持对整个语料库的系统分析。现有工作将非结构化或半结构化概念融入LLM;本文则尝试用LLM提取结构化表示。结合LLM的语义理解能力与科学概念的预定义模式,我们构建了一个系统,能精准回答关于文献整体的问题。该模式适用于多个科学领域,且仅用20篇人工标注摘要即完成概念提取。为验证效果,我们在涵盖天体物理、流体力学和进化生物学的3万篇arXiv论文上进行实验。生成的知识图谱揭示了新兴研究趋势,并通过可视化呈现科学知识不断扩展的全景。演示:abby101/surveyor-0 on HF Spaces。代码:https://github.com/chiral-carbon/kg-for-science。
原文摘要 · Abstract (English)
The scientific literature's exponential growth makes it increasingly challenging to navigate and synthesize knowledge across disciplines. Large language models (LLMs) are powerful tools for understanding scientific text, but they fail to capture detailed relationships across large bodies of work. Unstructured approaches, like retrieval augmented generation, can sift through such corpora to recall relevant facts; however, when millions of facts influence the answer, unstructured approaches become cost prohibitive. Structured representations offer a natural complement -- enabling systematic analysis across the whole corpus. Recent work enhances LLMs with unstructured or semistructured representations of scientific concepts; to complement this, we try extracting structured representations using LLMs. By combining LLMs' semantic understanding with a schema of scientific concepts, we prototype a system that answers precise questions about the literature as a whole. Our schema applies across scientific fields and we extract concepts from it using only 20 manually annotated abstracts. To demonstrate the system, we extract concepts from 30,000 papers on arXiv spanning astrophysics, fluid dynamics, and evolutionary biology. The resulting database highlights emerging trends and, by visualizing the knowledge graph, offers new ways to explore the ever-growing landscape of scientific knowledge. Demo: abby101/surveyor-0 on HF Spaces. Code: https://github.com/chiral-carbon/kg-for-science.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。