arXiv:2410.19064cs.SIcs.AI2024-10EMNLP被引 32

用AI模拟新闻如何一步步变假,揭示虚假信息演化路径。

The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agents

  • 构建四类角色代理模拟社交传播,逐步扭曲真实新闻。
  • 能准确复现已知假新闻演变过程,与人类判断高度一致。
  • 适合研究虚假信息演化、舆情监测与早期干预的学者。

随着网络谣言传播加剧,理解真实新闻如何演变为假新闻对早期识别和预防至关重要。以往研究多假设假新闻本就存在,未探讨其渐进形成过程。为此,我们提出FUSE(Fake news evolUtion Simulation framEwork),一种基于大语言模型的仿真框架,专注从真实新闻生成假新闻的演化过程。框架模拟包含四类常见社交角色的LLM代理:传播者、评论者、验证者和旁观者,以还原日常互动中信息逐渐失真的机制。为量化这种渐进扭曲,我们开发了FUSE-EVAL评估体系,从语言和语义多个维度衡量真实性偏差。实验表明,FUSE能有效捕捉假新闻演化模式,准确复现已知假新闻案例,且与人类评价高度一致。结果强调了在早期阶段及时干预的重要性。该框架具备可扩展性,支持未来更广泛的假新闻研究。

原文摘要 · Abstract (English)

With the growing spread of misinformation online, understanding how true news evolves into fake news has become crucial for early detection and prevention. However, previous research has often assumed fake news inherently exists rather than exploring its gradual formation. To address this gap, we propose FUSE (Fake news evolUtion Simulation framEwork), a novel Large Language Model (LLM)-based simulation approach explicitly focusing on fake news evolution from real news. Our framework model a social network with four distinct types of LLM agents commonly observed in daily interactions: spreaders who propagate information, commentators who provide interpretations, verifiers who fact-check, and bystanders who observe passively to simulate realistic daily interactions that progressively distort true news. To quantify these gradual distortions, we develop FUSE-EVAL, a comprehensive evaluation framework measuring truth deviation along multiple linguistic and semantic dimensions. Results show that FUSE effectively captures fake news evolution patterns and accurately reproduces known fake news, aligning closely with human evaluations. Experiments demonstrate that FUSE accurately reproduces known fake news evolution scenarios, aligns closely with human judgment, and highlights the importance of timely intervention at early stages. Our framework is extensible, enabling future research on broader scenarios of fake news.

假新闻演化LLM代理信息扭曲

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。