arXiv:2410.09112cs.DLcs.AI2024-10NeurIPS被引 22

用混合模型区分论文引用中的核心与表面引用,提升预测准确性。

HLM-Cite: Hybrid Language Model Workflow for Text-based Scientific Citation Prediction

  • 先用嵌入模型粗筛候选文献,再用大模型进行一次推理精排。
  • 在19个学科中比现有方法提升17.6%性能,可处理10万篇候选文献。
  • 适合需要精准引文推荐的科研写作与知识图谱构建场景。

引文网络在现代科学中至关重要,预测新论文(查询)会引用哪些已有论文(候选)是一项关键任务。然而,论文引用的作用差异显著,从基础理论支撑到表面提及不等。区分这些角色需超越引文网络中简单边关系的深层逻辑理解。尽管具备文本推理能力的大语言模型(LLM)提供了新可能,但仍面临两大挑战:一是新论文可能从海量文献中选引,其文本超出LLM上下文长度;二是论文间的逻辑关系隐含,直接提示模型可能导致仅依赖表面文本相似性而非深层推理。本文提出“核心引用”新概念,识别超越表面提及的关键参考文献。由此将引文预测任务从二分类升级为区分核心引用、表面引用与非引用。为此,我们提出HLM-Cite——一种结合嵌入与生成式大模型的混合工作流。设计课程式微调流程,使预训练文本嵌入模型从海量候选中粗筛高可能性的核心引用,再设计大模型智能体工作流,通过单次推理对检索结果排序,揭示论文间隐含逻辑关系。该流程可将候选集扩展至10万篇。我们在19个科学领域评估,相比当前最优方法性能提升17.6%。

原文摘要 · Abstract (English)

Citation networks are critical in modern science, and predicting which previous papers (candidates) will a new paper (query) cite is a critical problem. However, the roles of a paper's citations vary significantly, ranging from foundational knowledge basis to superficial contexts. Distinguishing these roles requires a deeper understanding of the logical relationships among papers, beyond simple edges in citation networks. The emergence of LLMs with textual reasoning capabilities offers new possibilities for discerning these relationships, but there are two major challenges. First, in practice, a new paper may select its citations from gigantic existing papers, where the texts exceed the context length of LLMs. Second, logical relationships between papers are implicit, and directly prompting an LLM to predict citations may result in surface-level textual similarities rather than the deeper logical reasoning. In this paper, we introduce the novel concept of core citation, which identifies the critical references that go beyond superficial mentions. Thereby, we elevate the citation prediction task from a simple binary classification to distinguishing core citations from both superficial citations and non-citations. To address this, we propose $\textbf{HLM-Cite}$, a $\textbf{H}$ybrid $\textbf{L}$anguage $\textbf{M}$odel workflow for citation prediction, which combines embedding and generative LMs. We design a curriculum finetune procedure to adapt a pretrained text embedding model to coarsely retrieve high-likelihood core citations from vast candidates and then design an LLM agentic workflow to rank the retrieved papers through one-shot reasoning, revealing the implicit relationships among papers. With the pipeline, we can scale the candidate sets to 100K papers. We evaluate HLM-Cite across 19 scientific fields, demonstrating a 17.6% performance improvement comparing SOTA methods.

引文预测大模型混合方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。