arXiv:2506.05924cs.CL2025-06IJCAI

用轻量级细粒度批评模型,让AI生成反驳假消息的可信回应。

Generating Grounded Responses to Counter Misinformation via Learning Efficient Fine-Grained Critiques

  • 用小模型分析事实核查网站数据,精准指出LLM输出中的数字、实体等错误
  • 生成效果接近自反馈,但提速5倍,模型规模更小
  • 适合需要大规模低成本反假新闻的应用场景

假新闻和误导性信息对社会构成重大威胁,高效应对至关重要。然而人工核查成本高且难以扩展。大语言模型(LLMs)有望自动化生成反误导回应,但存在幻觉问题。现有方法多依赖LLM自反馈减少幻觉,但计算开销大。本文提出MisMitiFact——基于事实的假消息缓解框架,通过生成简洁的批评反馈来优化LLM输出,确保回应有据可依。我们构建了轻量级、细粒度的批评模型,利用公开事实核查网站数据,识别并修正LLM生成中关于数值、实体和主题的关键错误。实验表明,MisMitiFact在回应质量上与自反馈相当,但使用更小的批评模型,反馈生成吞吐量提升约5倍,适合低成本大规模假消息应对。代码与提示模板见https://github.com/xxfwin/MisMitiFact。

原文摘要 · Abstract (English)

Fake news and misinformation poses a significant threat to society, making efficient mitigation essential. However, manual fact-checking is costly and lacks scalability. Large Language Models (LLMs) offer promise in automating counter-response generation to mitigate misinformation, but a critical challenge lies in their tendency to hallucinate non-factual information. Existing models mainly rely on LLM self-feedback to reduce hallucination, but this approach is computationally expensive. In this paper, we propose MisMitiFact, Misinformation Mitigation grounded in Facts, an efficient framework for generating fact-grounded counter-responses at scale. MisMitiFact generates simple critique feedback to refine LLM outputs, ensuring responses are grounded in evidence. We develop lightweight, fine-grained critique models trained on data sourced from readily available fact-checking sites to identify and correct errors in key elements such as numerals, entities, and topics in LLM generations. Experiments show that MisMitiFact generates counter-responses of comparable quality to LLMs' self-feedback while using significantly smaller critique models. Importantly, it achieves ~5x increase in feedback generation throughput, making it highly suitable for cost-effective, large-scale misinformation mitigation. Code and LLM prompt templates are at https://github.com/xxfwin/MisMitiFact.

反假新闻LLM纠错轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。