提出新方法精准量化大模型多智能体系统中各智能体的贡献。
Semantic Cooperative Games for Contribution Attribution in LLM-Based Multi-Agent Systems

- 构建语义生成超图,用语义支撑逻辑计算贡献值。
- 单次运行降低93.3%计算开销,结果与基准高度一致。
- 无需反事实推理,适合复杂协作任务的可解释性分析。
在基于大语言模型的多智能体系统中,最终输出由多个智能体通过消息交互和有序工作流生成,贡献归因成为核心问题。现有方法依赖反事实估值(如移除智能体或比较子集得分变化),在语言驱动流程中需重复调用模型,导致高方差且难以捕捉中间语义状态。本文提出语义协同博弈(SCG)框架,将真实语言流表示为语义生成超图,并在其上定义智能体级语义价值函数。引入语义沙普利值(SSV)以语义支撑逻辑分配贡献,提出SLIC算法:单轨迹构建语义超图、恢复最小语义支撑、应用布尔吸收并计算SSV,无需重跑智能体子集。证明在标准集合、全可观测、无顺序依赖条件下,SSV退化为经典沙普利值。在满足条件的医疗基准上,SLIC降低93.3%计算成本,与蒙特卡洛沙普利基线高度一致;在更一般的多角色工作流中,SSV与扰动引发的得分下降趋势一致,并揭示语义贡献与故障影响可能不一致的情况。总体而言,SLIC提供了一种快速、免反事实、可解释的归因方法。
原文摘要 · Abstract (English)
Contribution attribution has become a central problem in LLM-based multi-agent systems, where final outputs are produced through multiple agents, message exchanges, and ordered workflow dependencies. Existing attribution methods often rely on counterfactual valuation, such as removing agents or comparing score changes across altered agent subsets. In language-mediated workflows, these methods require repeated model calls, introduce high variance, and do not explicitly capture the intermediate semantic states through which agents produce, preserve, and transform task-relevant information. We propose Semantic Cooperative Games (SCG), a framework that represents a realized language flow as a semantic generation hypergraph and induces an agent-level semantic value function on this structure. We define the Semantic Shapley Value (SSV) to allocate contribution over semantic support logic, and introduce SLIC, a single-trajectory algorithm that constructs the semantic hypergraph, recovers minimal semantic supports, applies Boolean absorption, and computes SSV without rerunning agent subsets. We prove that SSV reduces to the classical Shapley value under standard set-based, fully observable, and no-order-dependence conditions. On a medical benchmark satisfying these conditions, SLIC reduces computation cost by 93.3% while remaining highly consistent with a Monte Carlo Shapley baseline. In more general multi-role workflows, SSV aligns with perturbation-induced score-drop profiles and exposes cases where semantic contribution and failure impact diverge. Overall, SLIC provides a fast, counterfactual-free, and interpretable attribution method for complex LLM-based multi-agent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。