arXiv:2503.23329cs.AI2025-03EMNLP被引 6

用多智能体自动优化判断规则,提升跨领域假消息检测效果

A Multi-Agent Framework with Automated Decision Rule Optimization for Cross-Domain Misinformation Detection

  • 多个专家智能体分析目标领域新闻,通过反思机制提升分析质量
  • 基于跨域验证任务迭代优化判断规则,在多个数据集上显著提升效果
  • 无需人工设计规则,适合需要快速适配新领域的检测场景

虚假信息涉及多个领域,但针对特定领域训练的检测方法在其他领域表现不佳。随着大语言模型(LLMs)的发展,研究者开始尝试利用LLM进行跨领域假消息检测。然而,现有基于LLM的方法往往无法充分分析目标领域新闻,限制了检测能力。更重要的是,这些方法通常依赖人工设计的判断规则,受限于领域知识和专家经验,导致规则泛化性差。为此,我们提出一种多智能体框架——带自动决策规则优化的MARO。该框架首先使用多个专家智能体分析目标领域新闻;随后引入问题反思机制,引导专家智能体进行更高质量的分析;进一步提出基于精心设计的跨域验证任务的决策规则优化方法,迭代提升规则在不同领域的有效性。在常用数据集上的实验结果与深入分析表明,MARO相比现有方法有显著提升。

原文摘要 · Abstract (English)

Misinformation spans various domains, but detection methods trained on specific domains often perform poorly when applied to others. With the rapid development of Large Language Models (LLMs), researchers have begun to utilize LLMs for cross-domain misinformation detection. However, existing LLM-based methods often fail to adequately analyze news in the target domain, limiting their detection capabilities. More importantly, these methods typically rely on manually designed decision rules, which are limited by domain knowledge and expert experience, thus limiting the generalizability of decision rules to different domains. To address these issues, we propose a MultiAgent Framework for cross-domain misinformation detection with Automated Decision Rule Optimization (MARO). Under this framework, we first employs multiple expert agents to analyze target-domain news. Subsequently, we introduce a question-reflection mechanism that guides expert agents to facilitate higherquality analysis. Furthermore, we propose a decision rule optimization approach based on carefully-designed cross-domain validation tasks to iteratively enhance the effectiveness of decision rules in different domains. Experimental results and in-depth analysis on commonlyused datasets demonstrate that MARO achieves significant improvements over existing methods.

多智能体假消息检测LLM应用跨域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。