arXiv:2512.03278cs.DBcs.AI2025-12中稿 · AAAI被引 4

用大模型多智能体系统自动跨库验证事实,支持透明查证。

Thucy: An LLM-based Multi-Agent System for Claim Verification across Relational Databases

  • 构建多智能体系统自动发现并推理跨数据库结构化数据
  • 在TabFact上准确率达94.3%,比之前最好方法高5.6个百分点
  • 输出具体SQL查询,适合需可解释性验证的科研与政策分析者

如今辨别真相愈发困难,政客、媒体常做出可被结构化数据验证的声明,如犯罪率、经济增速或医疗数据。尽管大模型和智能体技术已使自动验证成为可能,但现有系统大多仅限于小规模单表数据(数百行),难以处理真实场景。本文提出Thucy,首个支持跨数据库、跨表格的多智能体事实验证系统,无需预先知道数据源即可自主发现、检查并推理所有可用关系型数据库。Thucy能提供支持判断的精确SQL查询,实现完全透明。在标准基准TabFact上,其准确率达到94.3%,较此前最优方法(88.7%)提升5.6个百分点。

原文摘要 · Abstract (English)

In today's age, it is becoming increasingly difficult to decipher truth from lies. Every day, politicians, media outlets, and public figures make conflicting claims -- often about topics that can, in principle, be verified against structured data. For instance, statements about crime rates, economic growth or healthcare can all be verified against official public records and structured datasets. Building a system that can automatically do that would have sounded like science fiction just a few years ago. Yet, with the extraordinary progress in LLMs and agentic AI, this is now within reach. Still, there remains a striking gap between what is technically possible and what is being demonstrated by recent work. Most existing verification systems operate only on small, single-table databases -- typically a few hundred rows -- that conveniently fit within an LLM's context window. In this paper we report our progress on Thucy, the first cross-database, cross-table multi-agent claim verification system that also provides concrete evidence for each verification verdict. Thucy remains completely agnostic to the underlying data sources before deployment and must therefore autonomously discover, inspect, and reason over all available relational databases to verify claims. Importantly, Thucy also reports the exact SQL queries that support its verdict (whether the claim is accurate or not) offering full transparency to expert users familiar with SQL. When evaluated on the TabFact dataset -- the standard benchmark for fact verification over structured data -- Thucy surpasses the previous state of the art by 5.6 percentage points in accuracy (94.3% vs. 88.7%).

事实核查多智能体结构化数据LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。