arXiv:2604.08708cs.LGcs.AI2026-04ACL被引 6

用张量分解量化多智能体系统推理中的不确定性

Every Response Counts: Quantifying Uncertainty of LLM-based Multi-Agent Systems through Tensor Decomposition

论文配图:Every Response Counts: Quantifying Uncertainty of LLM-based Multi-Agent Systems through Tensor Decomposition
图 1 · 摘自论文原文
  • 将推理轨迹建模为嵌入矩阵,构建高阶张量分析多轮交互
  • 有效捕捉多步推理中不确定性的级联、通信路径变异和拓扑多样性
  • 适用于不同结构的多智能体系统,提升复杂任务可靠性评估

基于大语言模型的多智能体系统(MAS)在复杂任务上持续优于单智能体系统,但其复杂的交互带来了通信动态与角色依赖引发的可靠性挑战。现有不确定性量化方法通常针对单轮输出设计,难以应对MAS特有的三重挑战:多步推理中的不确定性级联、智能体间通信路径的变异性以及通信拓扑的多样性。为此,我们提出MATU框架,通过张量分解量化不确定性。MATU不局限于最终文本输出,而是将完整推理轨迹表示为嵌入矩阵,并将多次运行结果组织成高阶张量。通过张量分解,可解耦并量化不同来源的不确定性,提供一种可泛化于不同智能体结构的综合可靠性度量。实验表明,MATU在多种任务与通信拓扑下均能有效估计全面且稳健的不确定性。

原文摘要 · Abstract (English)

While Large Language Model-based Multi-Agent Systems (MAS) consistently outperform single-agent systems on complex tasks, their intricate interactions introduce critical reliability challenges arising from communication dynamics and role dependencies. Existing Uncertainty Quantification methods, typically designed for single-turn outputs, fail to address the unique complexities of the MAS. Specifically, these methods struggle with three distinct challenges: the cascading uncertainty in multi-step reasoning, the variability of inter-agent communication paths, and the diversity of communication topologies. To bridge this gap, we introduce MATU, a novel framework that quantifies uncertainty through tensor decomposition. MATU moves beyond analyzing final text outputs by representing entire reasoning trajectories as embedding matrices and organizing multiple execution runs into a higher-order tensor. By applying tensor decomposition, we disentangle and quantify distinct sources of uncertainty, offering a comprehensive reliability measure that is generalizable across different agent structures. We provide comprehensive experiments to show that MATU effectively estimates holistic and robust uncertainty across diverse tasks and communication topologies.

多智能体不确定性量化张量分解LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。