arXiv:2607.23581cs.AI2026-07

用可读笔记记录验证经验,提升多模态假信息检测准确率

Verification-Notebook Learning for Source-Aware Multimodal Misinformation Detection

论文配图:Verification-Notebook Learning for Source-Aware Multimodal Misinformation Detection
图 1 · 摘自论文原文
  • 构建外部验证笔记,存贮决策原则与证据线索
  • 在多个数据集上优于现有方法,源属性识别更精准
  • 无需训练模型,笔记可直接查看,适合安全可信场景

多模态假信息验证因误导信号分散且需不同证据支持而困难。虽然视觉-语言大模型(LVLM)适合此任务,但其验证效果常依赖具体推理流程。现有方法通过更强提示、检索或反思改进流程,却很少保留过往案例的学习模式。本文提出非参数化框架验证笔记学习(VNL),在推理前为冻结的LVLM构建外部验证程序。VNL从先前验证经验中提取紧凑的笔记,包含决策原则、证据线索和常见陷阱。该笔记在推理时保持固定,指导新样本的验证。不同于参数更新或示范存储,VNL将知识以可检查的实体形式记录。实验表明,VNL持续优于多种基线方法。进一步分析显示,验证笔记提升了细粒度源归属能力,同时保持小体积与可解释性,实现无训练的知识积累。

原文摘要 · Abstract (English)

Multimodal misinformation verification is challenging because misleading signals may come from different parts of a post and require different forms of evidence. LVLMs are well suited to this task, but their verification performance often depends on the inference procedure applied to each instance. Existing methods improve this procedure through stronger prompting, retrieval, or deliberation, but rarely retain the verification patterns learned from previous examples. We propose Verification-Notebook Learning (VNL), a non-parametric framework that learns an external verification procedure for a frozen LVLM before inference. VNL builds a compact notebook of decision principles, evidence cues, and recurring pitfalls from prior verification experience. The notebook remains fixed during inference and guides the verification of new examples. Rather than updating model parameters or storing demonstrations, VNL records learned knowledge in an artifact that can be inspected directly. Experiments show that VNL consistently outperforms a range of competitive baselines. Further analyses show that the Verification Notebook improves fine-grained source attribution while remaining compact and interpretable, providing an effective way to accumulate verification knowledge without model training.

假信息检测多模态可解释性知识记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。