arXiv:2411.13932cs.AIcs.MA2024-11被引 2

用规则驱动的多智能体协作框架,提升大模型推理可解释性。

XAgents: A Framework for Interpretable Rule-Based Multi-Agents Cooperation

  • 基于IF-THEN规则系统,分角色执行逻辑推理与领域内容生成。
  • 在三个数据集上优于最新AutoAgents,有效减少幻觉与错误知识。
  • 通过规则和SHAP分析实现输入输出关联可解释,适合高可信场景。

从大语言模型中提取隐含知识与逻辑推理能力始终是重大挑战。多智能体系统的进展进一步增强了大模型的能力。受多极神经元结构启发,我们提出XAgents框架,一种基于规则的可解释多智能体协作系统。规则的IF部分负责逻辑推理与领域归属计算,THEN部分由领域专家智能体组成,生成特定领域内容。在完成归属计算后,XAgents将任务分发至不同领域规则,生成多样响应,类似不同专家对同一问题的回答。最终响应通过归属计算与语义对抗生成机制,消除大模型的幻觉与错误知识。规则驱动的设计提升了用户对系统的信任度。我们在三个不同数据集上对比最新AutoAgents,结果表明XAgents性能更优。通过SHAP算法与案例研究,验证了其在输入输出特征关联与规则语义上的可解释性。

原文摘要 · Abstract (English)

Extracting implicit knowledge and logical reasoning abilities from large language models (LLMs) has consistently been a significant challenge. The advancement of multi-agent systems has further en-hanced the capabilities of LLMs. Inspired by the structure of multi-polar neurons (MNs), we propose the XAgents framework, an in-terpretable multi-agent cooperative framework based on the IF-THEN rule-based system. The IF-Parts of the rules are responsible for logical reasoning and domain membership calculation, while the THEN-Parts are comprised of domain expert agents that generate domain-specific contents. Following the calculation of the member-ship, XAgetns transmits the task to the disparate domain rules, which subsequently generate the various responses. These re-sponses are analogous to the answers provided by different experts to the same question. The final response is reached at by eliminat-ing the hallucinations and erroneous knowledge of the LLM through membership computation and semantic adversarial genera-tion of the various domain rules. The incorporation of rule-based interpretability serves to bolster user confidence in the XAgents framework. We evaluate the efficacy of XAgents through a com-parative analysis with the latest AutoAgents, in which XAgents demonstrated superior performance across three distinct datasets. We perform post-hoc interpretable studies with SHAP algorithm and case studies, proving the interpretability of XAgent in terms of input-output feature correlation and rule-based semantics.

多智能体可解释性规则系统大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。