arXiv:2605.19285cs.CLcs.AI2026-05KDD被引 1

让大模型生成更精准的谣言检测解释,避免冗余或不足。

Are Rationales Necessary and Sufficient? Tuning LLMs for Explainable Misinformation Detection

论文配图:Are Rationales Necessary and Sufficient? Tuning LLMs for Explainable Misinformation Detection
图 1 · 摘自论文原文
  • 设计新数据合成流程,精准定位必要且充分的推理步骤
  • 发现仅按对错筛选会遗漏关键解释,导致理由不足或过长
  • 适合需要高透明度、可解释的谣言检测场景

社交媒体上虚假信息的快速传播已成为严峻挑战。为应对这一问题,谣言检测(MD)成为关键研究方向。传统基于小模型的MD方法通过黑箱过程进行二分类。近年来,大语言模型(LLMs)的兴起使得可解释的MD成为可能,模型可生成解释其判断的理由,从而提升透明度。现有方法主要依赖复杂提示工程,从现成的LLMs中诱导理由。本文提出一个专用微调管道,专门用于可解释的谣言检测。首先收集大规模已验证文章,再利用多个强模型生成真伪判断和理由。为确保训练数据质量,采用过滤策略,仅保留正确样本。然而实验表明,仅基于标签正确性的简单过滤在实践中不足:(1) 粗粒度标签导致理由不充分;(2) 强模型存在过度验证行为,生成冗长无用的理由。为此,本文提出LONSREX——一种新数据合成流程,用于定位可解释谣言检测中必要且充分的理由。具体地,引入一个度量指标,量化每个验证步骤对最终预测的贡献,从而评估其必要性和充分性。实验结果证明了LONSREX的有效性。

原文摘要 · Abstract (English)

The rapid spread of misinformation on social media platforms has become a formidable challenge. To mitigate its proliferation, Misinformation Detection (MD) has emerged as a critical research topic. Traditional MD approaches based on small models typically perform binary classification through a black-box process. Recently, the rise of Large Language Models (LLMs) has enabled explainable MD, where models generate rationales that explain their decisions, thereby enhancing transparency. Existing explainable MD methods primarily focus on crafting sophisticated prompts to elicit rationales from off-the-shelf LLMs. In this work, we propose a pipeline to fine-tune a dedicated LLM specifically for explainable MD. Our pipeline begins by collecting large-scale fact-checked articles, and then uses multiple strong LLMs to produce veracity predictions and rationales. To ensure high-quality training data, we leverage a filtering strategy that selects only the correct instances for fine-tuning. While this pipeline is intuitive and prevalent, our experiments reveal that naive filtering based solely on label correctness is insufficient in practice and suffers from two critical limitations: (1) Coarse-grained labels cause insufficient rationales: Rationales filtered solely based on binary labels are insufficient to adequately support their decisions; (2) Over-verification behavior causes unnecessary rationales: Stronger LLMs tend to exhibit over-verification behavior, producing excessively verbose and unnecessary rationales. To address these issues, we introduce LONSREX, a novel data synthesis pipeline to Locate Necessary and Sufficient Rationales for Explainable MD. Specifically, we propose a metric that quantifies the contribution of each verification step to the final prediction, thereby evaluating its necessity and sufficiency. Experimental results demonstrate the effectiveness of LONSREX.

可解释性谣言检测大模型推理生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。