arXiv:2606.08589cs.CLcs.DL2026-06

用大模型自动检测引用错误,提升学术引用准确性。

Detection and Interpretability Analysis of Quotation Errors by Large Language Models

  • 用微调大模型检测引用错误,结合文献全文数据增强训练。
  • 基于摘要的全文整合方法效果最佳,显著提升检测准确率。
  • 通过可解释性分析揭示模型判断依据,适合学术审查与研究者使用。

引用错误指引用信息与原始文献不一致,导致研究误解、学术评价失真等问题。现有研究表明该现象普遍存在,而人工核查耗时低效。本文提出自动化引用错误检测任务,采用大语言模型(LLM)方法,从两方面提升性能:一是对LLM进行微调以检测错误;二是将被引文献全文数据融入数据集构建,对比三种全文整合方式,确定最优方案。在此基础上,利用TokenSHAP工具对模型预测结果进行可解释性分析。实验表明,微调后的模型在检测性能上有所提升,其中基于源文献摘要的全文整合方法表现最佳。

原文摘要 · Abstract (English)

Purpose - Quotation error refers to the inconsistency between cited information and its original source. This phenomenon leads to a series of negative impacts, such as misinterpretation of the original research, undermining the academic community's collective understanding of relevant issues, and weakening the accuracy and fairness of the citation-based academic evaluation system. Existing studies have shown that quotation error is prevalent in the academic community; moreover, manual verification of quotation error is not only labor-intensive but also inefficient. Therefore, this paper proposes the task of 'automated detection of quotation errors'. Methodology - Adopting a large language model (LLM)-based approach, this paper improves detection performance from two aspects on the basis of existing research: first, employ the fine-tuning approach for LLMs to detect quotation errors; second, incorporating full-text data of the cited literature into dataset construction, and exploring the optimal scheme for building such datasets by comparing three types of full-text integration methods. Based on this, this paper further uses the TokenSHAP tool to conduct interpretability experimental analysis on the model's prediction results. Findings - The fine-tuning approach for LLMs has improved the performance in detecting quotation errors. Among the different methods for incorporating full-text information, the approach based on using the source abstract yielded the best performance. Originality - The fine-tuning approach for large language models (LLMs) is applied to the task of automated detection of quotation errors, and interpretability analysis is conducted on the model's output results.

引用错误大模型可解释性学术评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。