arXiv:2511.15716cs.AI2025-11被引 1

提出可解释多智能体决策的因果分析框架,精准追踪个体贡献与集体涌现行为。

MACIE: Multi-Agent Causal Intelligence Explainer for Collective Behavior Understanding

  • 基于因果模型与干预反事实,量化每个智能体的决策贡献。
  • 检测协作任务中正向涌现性,协同指数最高达0.461,个体贡献分离准确。
  • 生成自然语言解释,适合实时部署,单数据集计算仅需0.79秒。

随着多智能体强化学习系统在安全关键场景中的应用,理解智能体决策原因及其如何形成集体行为至关重要。现有可解释AI方法在多智能体环境下表现不足,难以归因集体结果、量化涌现行为或捕捉复杂交互。本文提出MACIE——多智能体因果智能解释框架,融合结构因果模型、干预反事实和Shapley值,回答三个核心问题:第一,通过干预归因分数衡量每个智能体的因果贡献;第二,利用协同度量分离集体效应与个体贡献,揭示系统层面的涌现智能;第三,生成自然语言叙事,提供可操作的解释。我们在四种MARL场景(合作、竞争、混合动机)中评估了MACIE,结果表明其能准确归因结果,平均phi_i为5.07,标准差小于0.05;在合作任务中检测到正向涌现,协同指数最高达0.461;且计算高效,单数据集在CPU上仅需0.79秒。MACIE首次结合因果严谨性、涌现量化与多智能体支持,兼具实用性与可解释性,推动可信、可问责的多智能体AI发展。

原文摘要 · Abstract (English)

As Multi Agent Reinforcement Learning systems are used in safety critical applications. Understanding why agents make decisions and how they achieve collective behavior is crucial. Existing explainable AI methods struggle in multi agent settings. They fail to attribute collective outcomes to individuals, quantify emergent behaviors, or capture complex interactions. We present MACIE Multi Agent Causal Intelligence Explainer, a framework combining structural causal models, interventional counterfactuals, and Shapley values to provide comprehensive explanations. MACIE addresses three questions. First, each agent's causal contribution using interventional attribution scores. Second, system level emergent intelligence through synergy metrics separating collective effects from individual contributions. Third, actionable explanations using natural language narratives synthesizing causal insights. We evaluate MACIE across four MARL scenarios: cooperative, competitive, and mixed motive. Results show accurate outcome attribution, mean phi_i equals 5.07, standard deviation less than 0.05, detection of positive emergence in cooperative tasks, synergy index up to 0.461, and efficient computation, 0.79 seconds per dataset on CPU. MACIE uniquely combines causal rigor, emergence quantification, and multi agent support while remaining practical for real time use. This represents a step toward interpretable, trustworthy, and accountable multi agent AI.

多智能体因果推理可解释AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。