arXiv:2605.06028cs.LG2026-05

用信息论框架分析多智能体决策,证明投票辩论不如直接合并信息。

Multi-agent decision making: A Blackwell's informativeness approach

  • 基于黑威尔信息框架,形式化分析多LLM决策的优劣。
  • 实验表明新方法在6个QA基准上超越现有最佳辩论与投票策略。
  • 适合关注多智能体协作效率与理论保障的研究者参考。

大型语言模型(LLMs)的快速发展推动了多智能体系统中协同决策的研究。现有聚合方法如投票和辩论多为经验性,缺乏对决策信息量的正式保证。本文利用黑威尔信息结构抽象,证明投票和辩论所生成的信息结构,其信息量不超过所有代理私有信息的汇总。该结果将贝叶斯信息池化后验最大化确立为黑威尔序下的信息理论上限决策规则。受此启发,我们提出一种面向LLM问答任务的实用方法:估计各代理后验,并通过后验乘积估计器近似联合后验。在六个问答基准上的大量实验表明,该方法显著优于当前最先进的多LLM辩论与投票方法。

原文摘要 · Abstract (English)

The rapid development of large language models (LLMs) has motivated research on decision-making in multi-agent systems, where multiple agents collaborate to achieve shared objectives. Existing aggregation approaches, such as voting and debate, are largely ad-hoc and lack formal guarantees regarding the informativeness of the resulting decisions. In this paper, we provide a principled approach to analyse decisions made in the multi-LLM setting using Blackwell's informativeness framework. Within the Blackwell information-structure abstraction, we show that voting and debate induce information structures that are no more informative than the pooled private information of all agents. This result identifies Bayesian pooled posterior maximisation as an information-theoretic upper-bound decision rule under the Blackwell ordering. Motivated by this theoretical analysis, we introduce a practical method for LLM-based question-answering (QA) tasks that estimates each agent's posterior and approximates the pooled posterior using a product-of-posteriors estimator. Extensive experiments on six QA benchmarks demonstrate that our approach outperforms state-of-the-art multi-LLM debate and voting methods.

多智能体信息论推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。