arXiv:2608.30145cs.IR2026-08

通过规范化引用主张提升文献验证准确率,效果优于传统两阶段方法。

Understanding before verifying: Claim normalization for automated citation verification

  • 先对原始引用主张进行三类重写,拆解复杂表述
  • 在18个分类器上平均提升12%(编码器)和10%(大模型)的宏F1
  • 自动归一化后的证据质量接近人工标注,适合论文验证场景

引用准确性对研究可靠性至关重要。内容级引用验证评估学术主张的可信度。现有工作采用源自事实核查的两阶段检索-分类框架,但忽视原始引用主张的复杂性,引入范围错位、视角错位和命题纠缠三个问题,增加检索与分类难度,制约模型性能。为解决此问题,我们提出引用主张归一化,对原始引用主张应用三种重写策略后进行检索与分类,使下游模型执行单一明确任务。基于此,我们构建了三阶段框架CNCV:主张归一化、带定位的证据检索、引用分类。我们在人工标注的引用实例上开展因子实验,评估18个分类器表现。相比先前两阶段框架,CNCV在编码器上平均提升12%宏F1,生成式大模型上提升10%,主要得益于证据质量提升。自动归一化所得证据的下游分类性能与人工标注证据无显著差异。

原文摘要 · Abstract (English)

Citation accuracy has been studied for decades because of its importance to research reliability. Content-level citation verification assesses the reliability of scholarly claims. Recent work adopts a two-stage retrieval-classification framework inherited from fact-checking. However, this design overlooks the complexity of the raw citing claim and introduces three issues into the verification system, namely scope mismatch, perspective mismatch, and proposition entanglement. These issues increase the difficulty of retrieval and classification, thereby limiting model performance. Motivated by this gap, we propose claim normalization, which applies three rewriting strategies to the raw citing claim before retrieval and classification, allowing each downstream model to perform a single, well-defined task. Building on this method, we develop Claim-Normalized Citation Verification (CNCV), a new three-stage framework consisting of claim normalization, evidence retrieval with grounding, and citation classification. We evaluate CNCV across 18 classifiers using a factorial experiment on human-annotated citation instances. Compared with the prior two-stage framework, CNCV improves macro F1 by an average of 12% for encoders and 10% for generative LLMs, driven by improved evidence quality, the dominant factor identified in our experiments. Evidence retrieved from automatically normalized claims yields downstream classification performance statistically equivalent to that obtained with manually annotated evidence.

文献验证主张归一化大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。