用多个AI代理迭代优化,让AI解释更准确易懂。
An Agentic Approach to Generating XAI-Narratives
- 设计多代理框架,通过批评者反馈不断改进解释文本。
- 经三轮迭代,最佳模型使不忠实解释减少90%。
- 适合需要可信解释的AI应用开发者和研究者。
可解释人工智能(XAI)研究近年快速发展,但现有方法常因技术性强、面向专家而难以普及。为此,本文提出一种基于多智能体的XAI叙事生成与优化框架,由叙述者生成并根据多个批评者代理对忠实度和连贯性指标的反馈进行迭代修订。设计了五种智能体系统,在五个表格数据集上对五种大语言模型进行了系统评估。结果表明,基础设计、批评者设计及批评者规则设计均能有效提升所有模型的叙事忠实度;其中Claude-4.5-Sonnet在基础设计下经三轮迭代后,不忠实叙事数量减少90%。为进一步解决重复问题,引入基于多数投票的集成策略,该方法对四类模型性能均有提升,仅DeepSeek-V3.2-Exp例外。研究证明了智能体系统在生成可信且连贯的XAI叙事方面具有潜力。
原文摘要 · Abstract (English)
Explainable AI (XAI) research has experienced substantial growth in recent years. Existing XAI methods, however, have been criticized for being technical and expert-oriented, motivating the development of more interpretable and accessible explanations. In response, large language model (LLM)-generated XAI narratives have been proposed as a promising approach for translating post-hoc explanations into more accessible, natural-language explanations. In this work, we propose a multi-agent framework for XAI narrative generation and refinement. The framework comprises the Narrator, which generates and revises narratives based on feedback from multiple Critic Agents on faithfulness and coherence metrics, thereby enabling narrative improvement through iteration. We design five agentic systems (Basic Design, Critic Design, Critic-Rule Design, Coherent Design, and Coherent-Rule Design) and systematically evaluate their effectiveness across five LLMs on five tabular datasets. Results validate that the Basic Design, the Critic Design, and the Critic-Rule Design are effective in improving the faithfulness of narratives across all LLMs. Claude-4.5-Sonnet on Basic Design performs best, reducing the number of unfaithful narratives by 90% after three rounds of iteration. To address recurrent issues, we further introduce an ensemble strategy based on majority voting. This approach consistently enhances performance for four LLMs, except for DeepSeek-V3.2-Exp. These findings highlight the potential of agentic systems to produce faithful and coherent XAI narratives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。