arXiv:2412.04859cs.CLcs.MA2024-12被引 8

用多智能体辩论提升突发新闻谣言检测准确率

Breaking Event Rumor Detection via Stance-Separated Multi-Agent Debate

  • 将评论立场分离,分类型生成初始观点
  • 多轮辩论后达成共识,未达成则由裁判裁决
  • 在真实数据集上显著优于现有方法

突发事件中社交媒体谣言的快速传播严重阻碍了真相的传播。以往研究发现,缺乏标注资源使得无法直接检测未被昨日新闻覆盖的突发事件谣言。利用大语言模型(LLMs)进行谣言检测具有重要潜力,但受限于多样性不足,难以应对复杂或有争议的问题。本文提出立场分离的多智能体辩论框架(S2MAD),首先将评论分为支持或反对原声明,再根据声明为客观或主观分别采用不同提示策略生成初始观点。辩论者通过多轮对话寻求共识;若未能达成,则由裁判智能体评估意见并给出最终真伪判断。在两个真实数据集上的大量实验表明,所提模型在性能上超越当前最优方法,并有效提升了LLM在突发事件谣言检测中的表现。

原文摘要 · Abstract (English)

The rapid spread of rumors on social media platforms during breaking events severely hinders the dissemination of the truth. Previous studies reveal that the lack of annotated resources hinders the direct detection of unforeseen breaking events not covered in yesterday's news. Leveraging large language models (LLMs) for rumor detection holds significant promise. However, it is challenging for LLMs to provide comprehensive responses to complex or controversial issues due to limited diversity. In this work, we propose the Stance Separated Multi-Agent Debate (S2MAD) to address this issue. Specifically, we firstly introduce Stance Separation, categorizing comments as either supporting or opposing the original claim. Subsequently, claims are classified as subjective or objective, enabling agents to generate reasonable initial viewpoints with different prompt strategies for each type of claim. Debaters then follow specific instructions through multiple rounds of debate to reach a consensus. If a consensus is not reached, a judge agent evaluates the opinions and delivers a final verdict on the claim's veracity. Extensive experiments conducted on two real-world datasets demonstrate that our proposed model outperforms state-of-the-art methods in terms of performance and effectively improves the performance of LLMs in breaking event rumor detection.

谣言检测多智能体LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。