arXiv:2502.20581cs.CL2025-02ACL被引 3

量化论文引用时信息失真程度,揭示引用质量背后的规律。

The Noisy Path from Source to Citation: Measuring How Scholars Engage with Past Research

  • 用模型分析引文句子级信息保真度,实现大规模评估。
  • 近五年内、作者团队适中、第一作者H指数较低的论文引用更准确。
  • 发现引用失真会逐级传递,影响后续研究可信度,适合关注学术质量者阅读。

学术引用常用于评估研究影响力并追踪知识传播,但现有方法多依赖引用数量,忽视引用质量差异。引用可能在转述、总结或误读中发生信息失真,导致原文知识被改变。本文提出一种计算流程,利用论文全文识别引文与被引内容,并通过监督模型在句子级别测量引用保真度。基于约1300万条跨学科引用句对的分析,发现当被引论文更近期、领域相近、可获取性高,且第一作者H指数较低、作者团队规模适中时,引用保真度更高。通过准实验验证了‘电话效应’:若引用论文对原观点保真度低,则后续引用该引用论文的论文也更可能失真。研究揭示引用保真度存在系统性差异,表明仅依赖引用数量的分析存在局限,可能导致证据扭曲。

原文摘要 · Abstract (English)

Academic citations are widely used for evaluating research and tracing knowledge flows. Such uses typically rely on raw citation counts and neglect variability in citation types. In particular, citations can vary in their fidelity as original knowledge from cited studies may be paraphrased, summarized, or reinterpreted, possibly wrongly, leading to variation in how much information changes from cited to citing paper. In this study, we introduce a computational pipeline to quantify citation fidelity at scale. Using full texts of papers, the pipeline identifies citations in citing papers and the corresponding claims in cited papers, and applies supervised models to measure fidelity at the sentence level. Analyzing a large-scale multi-disciplinary dataset of approximately 13 million citation sentence pairs, we find that citation fidelity is higher when authors cite papers that are 1) more recent and intellectually close, 2) more accessible, and 3) the first author has a lower H-index and the author team is medium-sized. Using a quasi-experiment, we establish the "telephone effect" - when citing papers have low fidelity to the original claim, future papers that cite the citing paper and the original have lower fidelity to the original. Our work reveals systematic differences in citation fidelity, underscoring the limitations of analyses that rely on citation quantity alone and the potential for distortion of evidence.

引用质量学术评估信息失真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。