用大模型直接匹配论文与期刊语义,无需训练即可推荐
An LLM-Powered Semantic Alignment Framework for Journal Recommendation

- 将论文与期刊匹配转为语义对齐问题,不依赖训练
- Top-3准确率达40.23%,Top-10达70.05%
- 输出可解释推理过程,适合科研人员决策参考
期刊推荐是学术信息系统中的关键任务。现有方法多依赖监督学习、人工特征或历史交互数据,限制了泛化性和可解释性。本文提出一种基于大语言模型(LLM)的语义对齐框架,将期刊推荐建模为论文内容与期刊范围描述之间的语义匹配问题。该框架使大模型能直接根据论文标题、摘要、关键词及候选期刊信息判断适配度,无需特定任务训练。在涵盖49个统计学相关期刊、共23,609篇论文的数据集上,基于DeepSeek-V3的实验显示,该框架在Top-3、Top-5和Top-10的准确率分别为40.23%、53.67%和70.05%。额外分析表明,引入参考文献信息通常能提升性能,且推荐结果在多次运行中保持高度稳定,平均Top-5 Jaccard相似度达84%。框架还能生成可解释的推理输出,揭示推荐依据。这些结果证明大模型作为无训练、可扩展的期刊推荐范式具有巨大潜力。
原文摘要 · Abstract (English)
Journal recommendation is an important task in scholarly information systems. Existing approaches typically rely on supervised learning models, manually engineered features, or historical interaction data, which may limit their generalizability and interpretability. We propose an LLM-powered semantic alignment framework that formulates journal recommendation as a semantic matching problem between manuscript content and journal scope descriptions. The framework enables large language models (LLMs) to infer journal suitability directly from article titles, abstracts, keywords, and candidate journal information without task-specific training. Experiments are conducted using DeepSeek-V3 on a dataset of 23,609 articles from 49 journals in statistics and related fields. The proposed framework achieves Top-3, Top-5, and Top-10 accuracies of 40.23\%, 53.67\%, and 70.05\%, respectively. Additional analyses show that incorporating reference information generally improves recommendation performance and that recommendations remain highly stable across repeated runs, with an average Top-5 Jaccard similarity of 84\%. The framework also generates interpretable reasoning outputs that provide insights into the recommendation process. These findings demonstrate the potential of LLMs as a training-free and scalable paradigm for journal recommendation and scholarly decision support.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。