arXiv:2602.08586cs.AI2026-02中稿 · EMNLP

提出可诊断多智能体推理瓶颈的新框架,让设计更精准高效。

DIANOIA: Diagnostic Decomposition and Joint Optimization for Multi-Agent Reasoning

  • 将推理优势分解为覆盖、真实性和合成三通道,可实测定位瓶颈。
  • 在多个基准上以少至1/5的计算量超越强基线,最高提升4.6个百分点。
  • 适合想优化多智能体系统性能或理解失败原因的研究者和工程师。

多智能体大模型系统持续优于单智能体基线,但从业者仍难以预测哪种设计适用于新任务或诊断失败原因。我们认为这一差距源于缺乏具备可测量基础单元和可验证预测的诊断框架。本文提出 extbf{DIANOIA},将多智能体推理增益分解为覆盖、真实性和合成三个可实证测量的通道。基于此分解,我们构建了诊断协议,能识别任意任务的瓶颈通道。我们实现该协议为一个多智能体系统,其三个组件分别对应三通道:角色多样化的提案者负责覆盖,基于执行的验证者保障真实性,迭代式合成模块完成整合。在 GSM8K、AIME-2025、MBPP 和 BFCL-SP 上,本方法在匹配令牌预算下优于强基线,在 MBPP 上实现约 5 倍的令牌节省并达到 +4.6 个百分点的性能提升。所有基准上,诊断协议均准确识别瓶颈;基于该协议构建的系统在不同模型间表现领先。代码、适配器、诊断指标及 Claude Code 插件已开源。

原文摘要 · Abstract (English)

Multi-agent LLM systems consistently outperform single-agent baselines, yet practitioners still cannot predict which design works for a new task or diagnose why one fails. We argue this gap persists largely because the field lacks a diagnostic framework with measurable primitives and testable predictions. We introduce \textbf{DIANOIA}, a three-channel decomposition of multi-agent reasoning gain into coverage, fidelity, and synthesis, each of which is empirically measurable. From this decomposition, we derive a diagnostic protocol that identifies the bottleneck channels for any given task. We instantiate the protocol as a multi-agent system whose three components mirror the channels: role-diverse proposers for coverage, execution-grounded verification for fidelity, and iterative synthesis. On GSM8K, AIME-2025, MBPP, and BFCL-SP, our method outperforms strong multi-agent baselines under matched token budgets, dominating the Pareto frontier on MBPP at $\sim$$5{\times}$ token savings and reaching $+4.6$pp at matched cost. On every benchmark, the protocol picks the right bottleneck channels; the system we built around it leads across models. We release code, adapters, diagnostic metrics, and a Claude Code skill at https://anonymous.4open.science/r/DIANOIA4MAS. DIANOIA reframes multi-agent design as channel-aware resource allocation: diagnose which channel is the bottleneck for your task, then invest tokens accordingly.

多智能体推理优化诊断框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。