arXiv:2512.07178cs.AIcs.HC2025-12中稿 · and presented at t…被引 4

用大模型让SHAP解释更易懂,特别适合非技术用户。

ContextualSHAP : Enhancing SHAP Explanations Through Contextual Language Generation

  • 将SHAP与大语言模型结合,生成带上下文的自然语言解释。
  • 医疗案例用户调研显示,文本解释理解度显著提升。
  • 适合需要可解释性的人群,如医生、管理者或普通用户。

可解释人工智能(XAI)在高风险领域愈发重要。尽管SHAP能提供全局与局部特征重要性,但对非技术人员而言,其可视化结果常缺乏上下文意义。为此,我们提出一个Python工具包,将SHAP与OpenAI GPT集成,基于用户定义的参数(如特征别名、描述和背景)生成个性化文本解释。我们在一个医疗相关案例中应用该工具,并通过李克特量表调查与访谈开展用户评估。结果显示,相较于纯可视化输出,生成的文本解释被感知为更具可理解性和情境相关性。尽管结果尚属初步,但表明结合可视化与上下文文本有助于构建更友好、可信的模型解释。

原文摘要 · Abstract (English)

Explainable Artificial Intelligence (XAI) has become an increasingly important area of research, particularly as machine learning models are deployed in high-stakes domains. Among various XAI approaches, SHAP (SHapley Additive exPlanations) has gained prominence due to its ability to provide both global and local explanations across different machine learning models. While SHAP effectively visualizes feature importance, it often lacks contextual explanations that are meaningful for end-users, especially those without technical backgrounds. To address this gap, we propose a Python package that extends SHAP by integrating it with a large language model (LLM), specifically OpenAI's GPT, to generate contextualized textual explanations. This integration is guided by user-defined parameters (such as feature aliases, descriptions, and additional background) to tailor the explanation to both the model context and the user perspective. We hypothesize that this enhancement can improve the perceived understandability of SHAP explanations. To evaluate the effectiveness of the proposed package, we applied it in a healthcare-related case study and conducted user evaluations involving real end-users. The results, based on Likert-scale surveys and follow-up interviews, indicate that the generated explanations were perceived as more understandable and contextually appropriate compared to visual-only outputs. While the findings are preliminary, they suggest that combining visualization with contextualized text may support more user-friendly and trustworthy model explanations.

可解释AISHAP大模型用户研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。