多智能体协作识别假新闻并生成可解释的验证报告
TRUST Agents: A Collaborative Multi-Agent Framework for Fake News Detection, Explainable Verification, and Logic-Aware Claim Reasoning
- 四类专用智能体协同完成提取、检索、验证与解释
- 在复杂命题上推理能力更强,证据引用透明可查
- 适合需要可解释性与逻辑严谨性的事实核查场景
TRUST Agents 是一个用于可解释事实验证和假新闻检测的协作式多智能体框架。该系统不将验证简化为真假二分类,而是识别可验证命题,检索相关证据,对比命题与证据,在不确定性下进行推理,并生成人类可审查的解释报告。基础流程包含四个专用智能体:声明提取器利用命名实体识别、依存分析和大模型抽取技术识别事实性陈述;检索智能体采用混合稀疏与稠密搜索(BM25 与 FAISS);验证智能体将命题与检索到的证据比对,输出带校准置信度的判断;解释智能体生成包含明确证据引用的人类可读报告。为进一步处理复杂命题,引入扩展版本:基于 LoCal 风格的分解智能体、受 Delphi 启发的多智能体评审团(含不同验证角色),以及使用合取、析取、否定和蕴含组合原子判断的逻辑聚合器。在 LIAR 基准上评估,尽管监督编码器在原始指标上仍占优,但 TRUST Agents 显著提升可解释性、证据透明性和复合命题推理能力。结果也表明,检索质量与不确定性校准仍是可信自动化事实验证的主要瓶颈。
原文摘要 · Abstract (English)
TRUST Agents is a collaborative multi-agent framework for explainable fact verification and fake news detection. Rather than treating verification as a simple true-or-false classification task, the system identifies verifiable claims, retrieves relevant evidence, compares claims against that evidence, reasons under uncertainty, and generates explanations that humans can inspect. The baseline pipeline consists of four specialized agents. A claim extractor uses named entity recognition, dependency parsing, and LLM-based extraction to identify factual claims. A retrieval agent performs hybrid sparse and dense search using BM25 and FAISS. A verifier agent compares claims with retrieved evidence and produces verdicts with calibrated confidence. An explainer agent then generates a human-readable report with explicit evidence citations. To handle complex claims more effectively, we introduce a research-oriented extension with three additional components: a decomposer agent inspired by LoCal-style claim decomposition, a Delphi-inspired multi-agent jury with specialized verifier personas, and a logic aggregator that combines atomic verdicts using conjunction, disjunction, negation, and implication. We evaluate both pipelines on the LIAR benchmark against fine-tuned BERT, fine-tuned RoBERTa, and a zero-shot LLM baseline. Although supervised encoders remain stronger on raw metrics, TRUST Agents improves interpretability, evidence transparency, and reasoning over compound claims. Results also show that retrieval quality and uncertainty calibration remain the main bottlenecks in trustworthy automated fact verification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。