用小模型和知识图谱挖掘论文中的创新点与概念路径
Constraint-Driven Small Language Models Based on Agent and OpenAlex Knowledge Graph: Mining Conceptual Pathways and Discovering Innovation Points in Academic Papers
- 基于提示工程与小模型,提取论文关键概念路径
- 发现概念路径分布与创新点、罕见路径强相关
- 适合科研人员快速定位前沿与突破点
近年来,各领域学术论文数量激增,科学家难以及时全面跟踪最新研究成果与方法。关键概念提取已被证明是有效的分析范式,语言模型的广泛应用使其自动化成为可能。然而,现有论文数据库多局限于概念相似匹配与基础分类,未能深入探索概念间的关联网络。本文基于OpenAlex开源知识图谱,分析了来自新西伯利亚国立大学近8,000篇开源论文数据,发现论文关键概念路径的分布模式与创新点及罕见路径存在显著相关性。提出一种基于提示工程的关键概念路径分析方法,利用小语言模型实现精准概念提取与创新点识别,并构建基于知识图谱约束机制的智能体以提升分析准确性。通过对Qwen与DeepSeek模型进行微调,显著提升了准确率,相关模型已公开发布于Hugging Face平台。
原文摘要 · Abstract (English)
In recent years, the rapid increase in academic publications across various fields has posed severe challenges for academic paper analysis: scientists struggle to timely and comprehensively track the latest research findings and methodologies. Key concept extraction has proven to be an effective analytical paradigm, and its automation has been achieved with the widespread application of language models in industrial and scientific domains. However, existing paper databases are mostly limited to similarity matching and basic classification of key concepts, failing to deeply explore the relational networks between concepts. This paper is based on the OpenAlex opensource knowledge graph. By analyzing nearly 8,000 open-source paper data from Novosibirsk State University, we discovered a strong correlation between the distribution patterns of paper key concept paths and both innovation points and rare paths. We propose a prompt engineering-based key concept path analysis method. This method leverages small language models to achieve precise key concept extraction and innovation point identification, and constructs an agent based on a knowledge graph constraint mechanism to enhance analysis accuracy. Through fine-tuning of the Qwen and DeepSeek models, we achieved significant improvements in accuracy, with the models publicly available on the Hugging Face platform.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。