用多智能体框架精准识别学术论文中伪造的参考文献。
Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection

- 构建12类参考文献分类体系,实现领域级精准判定。
- 在合成数据集上准确率达97.1%,真实伪造文献检测率97.1%。
- 适合审稿人、期刊编辑和科研诚信核查人员使用。
大型语言模型在科学写作中被广泛应用,但会生成看似合理却无法验证的虚构参考文献。现有检测方法多依赖二元判断,解析脆弱且检索不全,难以提供领域级证据。本文将引用幻觉检测重构为与领域分类对齐的判别任务,提出涵盖真实、潜在和幻觉三类的12级分类体系。基于此,我们构建了CiteTracer多智能体检测框架,可从PDF和BibTeX中提取结构化引用,通过缓存查询、网页抓取、学者连接器与网络搜索获取证据,执行确定性领域匹配,并将模糊案例转交专业评审员。我们发布了包含2,450个由真实引用变异生成的合成引用,以及来自ICLR 2026和匿名会议拒稿稿件中的957个真实伪造引用的基准数据集。CiteTracer在合成基准上达到97.1%准确率,各类别F1分别为97.0(真实)、95.8(潜在)、98.5(幻觉),在真实数据集上无弃权地检测出97.1%的伪造引用。
原文摘要 · Abstract (English)
Large language models are increasingly used in scientific writing, yet they can fabricate citation-shaped references that appear plausible but fail bibliographic verification. Existing detectors often reduce verification to binary found/not-found decisions and rely on brittle parsing or incomplete retrieval, offering little field-level signal to auditors. We reframe citation hallucination detection as taxonomy-aligned field-level adjudication and introduce a 12-code taxonomy spanning Real, Potential, and Hallucinated citations. Based on this taxonomy, we build CiteTracer, a cascading multi-agent detector that extracts structured citations from PDF and BibTeX, retrieves evidence through cache lookup, URL fetch, scholar connectors, and web search, applies deterministic field matching, and routes ambiguous cases to class-specialist judgers. We release a benchmark of 2,450 synthetic citations built from real seeds with controlled LLM mutations, paired with 957 real-world fabricated citations drawn from ICLR 2026 and an anonymous conference desk-rejected submissions. CiteTracer reaches 97.1% accuracy on the synthetic benchmark, with class-level F1 scores of 97.0, 95.8, and 98.5 for Real, Potential, and Hallucinated, respectively, and detects 97.1% of fabrications on the real-world set without abstaining. Code: https://github.com/aaFrostnova/CiteTracer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。