arXiv:2503.18293cs.CL2025-03被引 2

测试大模型能否自检生成新闻的真假,发现对静态、宏观内容更可信。

Fact-checking AI-generated news reports: Can LLMs catch their own lies?

  • 用检索增强生成(RAG)提升模型自检能力
  • 对真实陈述判断准确率高于虚假陈述,宏观新闻优于本地新闻
  • 动态事件和本地新闻需人工介入,检索结果质量影响判断准确性

本文评估大型语言模型(LLMs)在判断自身或其它模型生成的新闻报告中声明真实性方面的表现。研究发现,模型在评估国家或国际新闻时比本地新闻更有效,对静态信息的判断优于动态信息,且对真实声明的验证优于虚假声明。这可能源于训练数据中前类声明的更好覆盖。此外,在检索增强生成(RAG)设置下引入搜索引擎结果可显著减少模型无法评估的声明数量,但同时也增加了错误判断的概率,部分原因在于检索结果的相关性与质量不足。本诊断研究强调未来需优先提升检索信息的精度与相关性,以支持机器生成内容的事实核查;对于动态事件和本地新闻,建议采用人机协同事实核查系统以确保准确性与可靠性。

原文摘要 · Abstract (English)

In this paper, we evaluate the ability of Large Language Models (LLMs) to assess the veracity of claims in ''news reports'' generated by themselves or other LLMs. Our goal is to determine whether LLMs can effectively fact-check their own content, using methods similar to those used to verify claims made by humans. Our findings indicate that LLMs are more effective at assessing claims in national or international news stories than in local news stories, better at evaluating static information than dynamic information, and better at verifying true claims compared to false ones. We hypothesize that this disparity arises because the former types of claims are better represented in the training data. Additionally, we find that incorporating retrieved results from a search engine in a Retrieval-Augmented Generation (RAG) setting significantly reduces the number of claims an LLM cannot assess. However, this approach also increases the occurrence of incorrect assessments, partly due to irrelevant or low-quality search results. This diagnostic study highlights the need for future research on fact-checking machine-generated reports to prioritize improving the precision and relevance of retrieved information to better support fact-checking efforts. Furthermore, claims about dynamic events and local news may require human-in-the-loop fact-checking systems to ensure accuracy and reliability.

大模型事实核查RAG生成内容

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。