用大模型生成既专业又易懂的AI解释,让普通人也能看懂复杂算法。
Mind the XAI Gap: A Human-Centered LLM Framework for Democratizing Explainable AI
- 利用大模型和上下文学习,自动整合领域与可解释性知识。
- 对非专家解释的人类友好度提升,与真实解释相关性达0.92。
- 适合需要透明AI解释的科研、医疗、金融等领域的专家与公众。
人工智能正快速嵌入关键决策系统,但其“黑箱”特性亟需可解释AI(XAI)来增强透明度。现有XAI多面向专家,难以被非专业人士理解。本文提出一个领域、模型、解释无关的通用框架,利用大语言模型(LLMs)通过上下文学习,将领域与可解释性相关知识注入模型。该框架在单一响应中同时输出非专家可理解的通俗解释和专家可用的技术信息,均基于领域与可解释性原则。为验证效果,我们构建了包含40余种数据集、模型与XAI组合的基准测试,用于可解释聚类分析身心健康场景。用户研究(N=56)表明,该框架显著提升非专家对解释的理解力与友好度;内容质量方面,与真实解释的斯皮尔曼等级相关系数达0.92,证明高保真。整体评估确认大模型作为人本可解释AI(HCXAI)使能者的价值:既保持与基础XAI方法一致的技术严谨性,又能为非专家提供清晰高效、易于理解的解释。
原文摘要 · Abstract (English)
Artificial Intelligence (AI) is rapidly embedded in critical decision-making systems, however their foundational ``black-box'' models require eXplainable AI (XAI) solutions to enhance transparency, which are mostly oriented to experts, making no sense to non-experts. Alarming evidence about AI's unprecedented human values risks brings forward the imperative need for transparent human-centered XAI solutions. In this work, we introduce a domain-, model-, explanation-agnostic, generalizable and reproducible framework that ensures both transparency and human-centered explanations tailored to the needs of both experts and non-experts. The framework leverages Large Language Models (LLMs) and employs in-context learning to convey domain- and explainability-relevant contextual knowledge into LLMs. Through its structured prompt and system setting, our framework encapsulates in one response explanations understandable by non-experts and technical information to experts, all grounded in domain and explainability principles. To demonstrate the effectiveness of our framework, we establish a ground-truth contextual ``thesaurus'' through a rigorous benchmarking with over 40 data, model, and XAI combinations for an explainable clustering analysis of a well-being scenario. Through a comprehensive quality and human-friendliness evaluation of our framework's explanations, we prove high content quality through strong correlations with ground-truth explanations (Spearman rank correlation=0.92) and improved interpretability and human-friendliness to non-experts through a user study (N=56). Our overall evaluation confirms trust in LLMs as HCXAI enablers, as our framework bridges the above Gaps by delivering (i) high-quality technical explanations aligned with foundational XAI methods and (ii) clear, efficient, and interpretable human-centered explanations for non-experts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。