arXiv:2609.04841cs.CLcs.AI2026-09

用多智能体辩论检测新闻偏见,无需训练即可达到顶尖水平。

MABPD: Multi-Agent Bias Probing & Detection via Structured Argument Debate

论文配图:MABPD: Multi-Agent Bias Probing & Detection via Structured Argument Debate
图 1 · 摘自论文原文
  • 三智能体从不同视角分析文本,通过结构化辩论达成共识。
  • 在BABE数据集上达83.4%宏F1,仅比最优监督模型低0.7个百分点。
  • 零样本迁移至新数据集仍表现良好,适合无标注场景的偏见检测。

新闻偏见通过微妙的语言线索——如倾向性用语、选择性框架和战略性省略——体现,传统方法依赖大规模标注数据进行监督训练,难以被单一模型有效识别。本文提出MABPD(多智能体偏见探测与检测),通过三个专业化大模型智能体从互补视角分析文章,并在结构化论辩协议(SAD)下解决分歧。SAD采用领域驱动的非对称举证责任机制:无文本证据支持的偏见主张不具权重,结合角色加权投票与共识后验证,以显式讨论结构替代任务特定的监督决策边界。消融实验表明,结构化论辩而非简单并行处理是性能关键:移除辩论模块导致F1下降最高达10.6点。在包含4,121句专家标注句子的BABE基准上,MABPD在留出测试集上取得83.4%宏F1,仅比最优监督模型(MAGPIE,84.1%宏F1;Horych et al., 2024)低0.7个百分点,且无需任何任务特定训练或阈值调优。跨数据集评估在SemEval 2019超党派新闻语料库(644篇文章)上实现75.0%零样本准确率,距离最优监督结果(82.2%;Kiesel et al., 2019)仅差7.2个百分点,证实其在不同标注体系间的迁移能力。代码与完整流程已公开。

原文摘要 · Abstract (English)

Media bias in news articles operates through subtle linguistic cues---loaded language, selective framing, and strategic omission---that resist single-model detection and have traditionally required large annotated corpora for supervised training. We ask whether structured multi-agent deliberation can serve as a principled, training-free alternative to supervised classification for this task. We introduce MABPD (Multi-Agent Bias Probing & Detection), a pipeline in which three specialized LLM agents analyze an article from complementary perspectives and resolve disagreements through a Structured Argument Debate (SAD) protocol. SAD implements a domain-motivated asymmetric burden of proof---biased claims without grounded textual evidence carry zero weight---combined with role-weighted voting and post-consensus verification, replacing task-specific supervised decision boundaries with explicit deliberative structure. Ablation confirms that this structured deliberation, not mere agent parallelism, drives performance: removing the debate module reduces F1 by up to 10.6 points. On the BABE benchmark (4,121 expert-annotated sentences), MABPD achieves 83.4% macro F1 on the held-out test split---within 0.7 percentage points (pp) of the supervised SOTA (MAGPIE, 84.1% macro F1; Horych et al., 2024)---without any task-specific training or threshold tuning on annotated data. Cross-dataset evaluation on the SemEval 2019 HyperPartisan corpus (644 articles) yields 75.0% zero-shot accuracy, within 7.2 pp of the supervised SOTA accuracy (82.2%; Kiesel et al. 2019), confirming transfer across annotation regimes. We release the full pipeline and evaluation code.

偏见检测多智能体零样本论辩系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。