arXiv:2606.21155cs.CL2026-06被引 3

AI常虚构法律引用,新模型仍难识别细微错误。

Who Checks the Citations? Benchmarking Legal Hallucination Detection

  • 构建法律引用幻觉分类体系,创建1300条含伪造引用的文书数据集。
  • 最新模型GPT-5在主动验证框架下召回率达84.4%,但平均需15.3步推理。
  • 受限于数据库访问权限,顶尖模型仍难应对复杂错误,影响公平性。

律师、法官及自诉人越来越多地使用AI起草法律文件,但这些工具常编造引用。尽管预测新模型会减少幻觉或法院制裁可遏制疏忽,我们仍发现超1000份文件存在虚构引用,且数量逐年增长。本研究评估了AI系统自动检测此类错误的能力。提出基于真实法庭文件的法律引用幻觉分类体系,并构建包含1300个注入错误片段的数据集。在非代理与代理设置下对五种模型进行基准测试,结果显示最新版本表现更优——GPT-5在代理框架中达到84.4%召回率和55.0% F1分数,但所有模型在细微错误类别上仍表现不佳。代理验证资源消耗大,GPT-5平均每个片段需15.3步推理。此外,即使最优模型也受限于对商业法律数据库的访问权限。这一差距引发政策担忧,因不利于缺乏订阅的AI系统与诉讼当事人。我们的数据集、工具与政策建议为构建和审计可靠法律引用核查工具奠定了基础。

原文摘要 · Abstract (English)

Attorneys, judges, and pro se filers increasingly use AI to draft legal documents, yet these tools frequently fabricate citations. Despite predictions that newer models would hallucinate less or that court sanctions would deter negligent filers, we found over 1,000 filings containing fabricated citations---with this number growing year-over-year. This study evaluates whether AI-based systems can mitigate these errors by automatically detecting hallucinations. We propose a taxonomy of legal citation hallucinations grounded in actual court filings and introduce a dataset of 1,300 brief excerpts containing injected errors. Benchmarking five models in agentic and non-agentic settings as well as Claude Code reveals that while the latest iterations perform better---GPT-5 achieves 84.4% recall and a 55.0% F1 score in an agentic framework---all models struggle with subtle error categories. Agentic verification remains resource-intensive, with GPT-5 averaging 15.3 steps per excerpt. Furthermore, restricted information access limits the efficacy of even the best agents. This gap creates policy concerns, as it disadvantages both AI systems and litigants who lack subscriptions to commercial legal databases. Together, our dataset, tools, and policy recommendations provide a foundation for building and auditing reliable legal citation checking tools.

法律AI幻觉检测数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。