用图神经网络提升模型解释的可信度
Graph-Guided Textual Explanation Generation Framework
- 先提取关键输入片段,再用图网络引导生成过程
- 在三个数据集上使解释可信度提升最高12.18%
- 生成更接近人类写作、冗余更少的自然语言解释
自然语言解释(NLEs)常用于提供模型预测理由的自由文本说明。然而,近期研究质疑其可信度,因其可能不准确反映模型内部推理过程。相比之下,突出解释——即对模型预测至关重要的输入片段——具有可测量的可信性。基于此,我们提出G-Tex框架,通过图神经网络层编码突出解释作为忠实线索,引导NLE生成,使其与模型对预测答案的内在推理保持一致。在T5和BART模型上,使用三个推理数据集的实验表明,G-Tex相比基线方法将NLE可信度提升最高达12.18%。此外,G-Tex生成的解释在语义和词汇层面与人工撰写版本更相似。人工评估显示,G-Tex能减少冗余内容并提升整体解释质量。本工作提出了一个显式引导NLE生成以增强可信性的新方法,为解决更广泛的NLE生成标准提供了基础。
原文摘要 · Abstract (English)
Natural language explanations (NLEs) are commonly used to provide plausible free-text explanations of a model's reasoning about its predictions. However, recent work has questioned their faithfulness, as they may not accurately reflect the model's internal reasoning process regarding its predicted answer. In contrast, highlight explanations--input fragments critical for the model's predicted answers--exhibit measurable faithfulness. Building on this foundation, we propose G-Tex, a Graph-Guided Textual Explanation Generation framework designed to enhance the faithfulness of NLEs. Specifically, highlight explanations are first extracted as faithful cues reflecting the model's reasoning logic toward answer prediction. They are subsequently encoded through a graph neural network layer to guide the NLE generation, which aligns the generated explanations with the model's underlying reasoning toward the predicted answer. Experiments on T5 and BART using three reasoning datasets show that G-Tex improves NLE faithfulness by up to 12.18% compared to baseline methods. Additionally, G-Tex generates NLEs with greater semantic and lexical similarity to human-written ones. Human evaluations show that G-Tex can decrease redundant content and enhance the overall quality of NLEs. Our work presents a novel method for explicitly guiding NLE generation to enhance faithfulness, serving as a foundation for addressing broader criteria in NLE and generated text.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。