MetaExplainer让AI根据用户问题生成定制化解释,提升可信度。
MetaExplainer: A Framework to Generate Multi-Type User-Centered Explanations for AI Systems
- 用大模型解析用户问题,再结合解释框架生成答案
- 在糖尿病数据集上实现70%解释忠实度和67%上下文利用率
- 支持对比、反事实等五类解释,适合需要透明决策的场景
解释对构建可信AI系统至关重要,但模型输出与用户需求常存在差距。为此,我们提出MetaExplainer,一个神经符号框架,用于生成以用户为中心的解释。该方法分三阶段:首先使用先进大语言模型(LLM)将用户问题转化为机器可读格式;其次由模型解释方法生成系统推荐;最后合成自然语言解释,总结解释输出。整个过程借助解释本体论引导语言模型和解释方法。通过利用LLM与结构化解释生成流程,MetaExplainer旨在提升AI系统的可解释性与可信度,在多种应用中提供定制化、问题驱动的解释。全面评估显示各阶段表现优异:问题重构F1得分为59.06%,模型解释忠实度达70%,自然语言合成上下文利用率67%。用户研究验证了生成解释的创造性和完整性。在糖尿病(PIMA Indian)表格数据集上,框架支持对比、反事实、理由、案例和数据五类解释。从本体引导到生成全过程的可追溯性,表明其具有超越测试场景的广泛适用性,为提升跨领域AI可解释性提供了有力工具。
原文摘要 · Abstract (English)
Explanations are crucial for building trustworthy AI systems, but a gap often exists between the explanations provided by models and those needed by users. To address this gap, we introduce MetaExplainer, a neuro-symbolic framework designed to generate user-centered explanations. Our approach employs a three-stage process: first, we decompose user questions into machine-readable formats using state-of-the-art large language models (LLM); second, we delegate the task of generating system recommendations to model explainer methods; and finally, we synthesize natural language explanations that summarize the explainer outputs. Throughout this process, we utilize an Explanation Ontology to guide the language models and explainer methods. By leveraging LLMs and a structured approach to explanation generation, MetaExplainer aims to enhance the interpretability and trustworthiness of AI systems across various applications, providing users with tailored, question-driven explanations that better meet their needs. Comprehensive evaluations of MetaExplainer demonstrate a step towards evaluating and utilizing current state-of-the-art explanation frameworks. Our results show high performance across all stages, with a 59.06% F1-score in question reframing, 70% faithfulness in model explanations, and 67% context-utilization in natural language synthesis. User studies corroborate these findings, highlighting the creativity and comprehensiveness of generated explanations. Tested on the Diabetes (PIMA Indian) tabular dataset, MetaExplainer supports diverse explanation types, including Contrastive, Counterfactual, Rationale, Case-Based, and Data explanations. The framework's versatility and traceability from using ontology to guide LLMs suggest broad applicability beyond the tested scenarios, positioning MetaExplainer as a promising tool for enhancing AI explainability across various domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。