用搜索和验证工具动态检测多源伪造信息,不依赖训练。
T^2Agent A Tool-augmented Multimodal Misinformation Detection Agent with Monte Carlo Tree Search
- 用蒙特卡洛树搜索动态选工具,分步验证多源伪造。
- 在多个基准上超越现有方法,准确率提升显著。
- 适合需要快速响应的虚假信息检测场景。
现实中的多模态虚假信息常由多种伪造来源混合而成,需动态推理与自适应验证。现有方法多依赖静态流程和有限工具,难以应对复杂多样性。为此,我们提出 extmethod,一种集成可扩展工具集与蒙特卡洛树搜索(MCTS)的检测代理。工具集包含网络搜索、伪造检测与一致性分析等模块,均采用标准化模板描述,支持无缝集成与扩展。为避免同时使用所有工具带来的低效,设计基于贪心搜索的筛选器,仅选取任务相关工具子集作为MCTS的动作空间,动态收集证据并进行多源验证。针对虚假信息的多源特性, extmethod~扩展传统MCTS,将任务分解为协调子任务,分别针对不同伪造来源。引入双奖励机制,结合推理路径得分与置信度评分,平衡跨源探索与可靠证据挖掘。消融实验验证了树搜索与工具使用的效果。大量实验表明, extmethod~在多个具有挑战性的多源多模态虚假信息基准上持续优于现有基线,展现出无需训练的强大检测潜力。
原文摘要 · Abstract (English)
Real-world multimodal misinformation often arises from mixed forgery sources, requiring dynamic reasoning and adaptive verification. However, existing methods mainly rely on static pipelines and limited tool usage, limiting their ability to handle such complexity and diversity. To address this challenge, we propose \method, a novel misinformation detection agent that incorporates an extensible toolkit with Monte Carlo Tree Search (MCTS). The toolkit consists of modular tools such as web search, forgery detection, and consistency analysis. Each tool is described using standardized templates, enabling seamless integration and future expansion. To avoid inefficiency from using all tools simultaneously, a greedy search-based selector is proposed to identify a task-relevant subset. This subset then serves as the action space for MCTS to dynamically collect evidence and perform multi-source verification. To better align MCTS with the multi-source nature of misinformation detection, \method~ extends traditional MCTS with multi-source verification, which decomposes the task into coordinated subtasks targeting different forgery sources. A dual reward mechanism containing a reasoning trajectory score and a confidence score is further proposed to encourage a balance between exploration across mixed forgery sources and exploitation for more reliable evidence. We conduct ablation studies to confirm the effectiveness of the tree search mechanism and tool usage. Extensive experiments further show that \method~ consistently outperforms existing baselines on challenging mixed-source multimodal misinformation benchmarks, demonstrating its strong potential as a training-free detector.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。