arXiv:2604.18311cs.CLcs.AI2026-04

让AI解释更像故事,提升人类理解力

On the Importance and Evaluation of Narrativity in Natural Language AI Explanations

  • 用叙事结构替代静态特征列表,增强解释逻辑性
  • 新指标可有效区分有解释力与无意义的文本
  • 提供通用生成规则,适合希望提升解释可读性的研究者

可解释人工智能(XAI)旨在使机器学习模型的行为可理解,但现有解释方法仍难被人类掌握。将自然语言生成融入XAI可使解释以文本形式呈现,更易被实践者理解。然而当前方法多生成静态的特征重要性列表,仅说明影响预测的因素,未解释为何产生该预测。本研究借鉴社会科学与语言学见解,主张XAI解释应采用叙事形式。叙事解释通过四个核心特征支持人类理解:连续结构、因果机制、语言流畅性和词汇多样性。我们发现,仅基于词元概率或词频的标准NLP指标无法捕捉这些特性,且可能被无实质内容的重复文本轻易超越。为此,我们提出七项自动度量指标,从上述四维度量化解释的叙事质量。在六个数据集上对当前主流解释生成方法进行基准测试,结果表明新指标比传统指标更可靠地区分描述性与叙事性解释。最后,为推动领域发展,我们提出一组无需特定任务的XAI叙事生成规则,使生成的解释具备更强叙事特征,并符合语言学与社会科学的研究发现。

原文摘要 · Abstract (English)

Explainable AI (XAI) aims to make the behaviour of machine learning models interpretable, yet many explanation methods remain difficult to understand. The integration of Natural Language Generation into XAI aims to deliver explanations in textual form, making them more accessible to practitioners. Current approaches, however, largely yield static lists of feature importances. Although such explanations indicate what influences the prediction, they do not explain why the prediction occurs. In this study, we draw on insights from social sciences and linguistics, and argue that XAI explanations should be presented in the form of narratives. Narrative explanations support human understanding through four defining properties: continuous structure, cause-effect mechanisms, linguistic fluency, and lexical diversity. We show that standard Natural Language Processing (NLP) metrics based solely on token probability or word frequency fail to capture these properties and can be matched or exceeded by tautological text that conveys no explanatory content. To address this issue, we propose seven automatic metrics that quantify the narrative quality of explanations along the four identified dimensions. We benchmark current state-of-the-art explanation generation methods on six datasets and show that the proposed metrics separate descriptive from narrative explanations more reliably than standard NLP metrics. Finally, to further advance the field, we propose a set of problem-agnostic XAI Narrative generation rules for producing natural language XAI explanations, so that the resulting XAI Narratives exhibit stronger narrative properties and align with the findings from the linguistic and social science literature.

可解释AI自然语言生成叙事生成评估指标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。