arXiv:2410.00250cs.CL2024-10被引 7

用可解释方法揭示阿尔茨海默病患者语言中的关键特征

A Methodology for Explainable Large Language Models with Integrated Gradients and Linguistic Analysis in Text Classification

  • 结合积分梯度与语言分析,定位模型决策的关键词汇
  • 发现阿尔茨海默病患者语言中社会性词汇显著减少
  • 适合医学研究者和需要可解释AI的临床场景

阿尔茨海默病(AD)等神经退行性疾病严重影响患者与照护者的社交与心理状态。尽管大语言模型(LLM)能通过自发言语识别疾病特征,但其决策过程缺乏可解释性。本文提出可解释方法SLIME(Statistical and Linguistic Insights for Model Explanation),利用英文语料库中来自‘饼干盗窃’图片描述任务的转录文本,基于双向编码器表示模型(BERT)对文本进行AD与对照组分类。通过集成梯度(IG)、语言询问与词频分析(LIWC)及统计分析的流程,识别出反映社会性词汇减少的代表性词汇,并确定其对模型判断的重要性。结果表明,这些词汇显著提升模型准确率,为在神经退行性疾病研究中应用大语言模型提供了可信的可解释工具。

原文摘要 · Abstract (English)

Neurological disorders that affect speech production, such as Alzheimer's Disease (AD), significantly impact the lives of both patients and caregivers, whether through social, psycho-emotional effects or other aspects not yet fully understood. Recent advancements in Large Language Model (LLM) architectures have developed many tools to identify representative features of neurological disorders through spontaneous speech. However, LLMs typically lack interpretability, meaning they do not provide clear and specific reasons for their decisions. Therefore, there is a need for methods capable of identifying the representative features of neurological disorders in speech and explaining clearly why these features are relevant. This paper presents an explainable LLM method, named SLIME (Statistical and Linguistic Insights for Model Explanation), capable of identifying lexical components representative of AD and indicating which components are most important for the LLM's decision. In developing this method, we used an English-language dataset consisting of transcriptions from the Cookie Theft picture description task. The LLM Bidirectional Encoder Representations from Transformers (BERT) classified the textual descriptions as either AD or control groups. To identify representative lexical features and determine which are most relevant to the model's decision, we used a pipeline involving Integrated Gradients (IG), Linguistic Inquiry and Word Count (LIWC), and statistical analysis. Our method demonstrates that BERT leverages lexical components that reflect a reduction in social references in AD and identifies which further improve the LLM's accuracy. Thus, we provide an explainability tool that enhances confidence in applying LLMs to neurological clinical contexts, particularly in the study of neurodegeneration.

可解释AI阿尔茨海默病语言分析大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。