arXiv:2411.04649cs.AIcs.CL2024-11

发现文本模型的过拟合规则,揭示虚假关联。

DISCO: DISCovering Overfittings as Causal Rules for Text Classification Models

  • 通过序列挖掘找出与预测相关的因果n-gram规则
  • 100%检测到人为引入的模型捷径,性能下降18.8%
  • 支持交互式解释,适合评估模型在分布外数据的风险

随着神经语言模型快速发展,参数量庞大的模型部署激增,对人类可理解的可解释性解释需求随之上升。现有事后可解释方法多聚焦单个输入实例的单字特征,难以全面捕捉模型决策过程,且常无法区分基于虚假相关性的判断与整体语义理解。本文提出DISCO,一种通过识别与模型预测存在因果关系的n-gram关联,发现全局规则化解释的新方法。该方法采用可扩展的序列挖掘技术,从训练数据中提取相关文本片段,关联模型预测并进行因果检验,提炼出能揭示模型行为的稳健规则。这些规则暴露潜在过拟合现象,揭示误导性特征组合。在大量测试中验证,DISCO显著优于现有方法,能够100%检测到人工植入的训练数据捷径(MultiRC数据集),导致模型性能下降18.8%,此能力为其他方法所不及。此外,DISCO支持交互式解释,帮助人类检查员区分规则输出中的虚假原因,减轻大量实例级解释负担,并有助于评估模型在分布外(OOD)数据下的风险。

原文摘要 · Abstract (English)

With the rapid advancement of neural language models, the deployment of over-parameterized models has surged, increasing the need for interpretable explanations comprehensible to human inspectors. Existing post-hoc interpretability methods, which often focus on unigram features of single input textual instances, fail to capture the models' decision-making process fully. Additionally, many methods do not differentiate between decisions based on spurious correlations and those based on a holistic understanding of the input. Our paper introduces DISCO, a novel method for discovering global, rule-based explanations by identifying causal n-gram associations with model predictions. This method employs a scalable sequence mining technique to extract relevant text spans from training data, associate them with model predictions, and conduct causality checks to distill robust rules that elucidate model behavior. These rules expose potential overfitting and provide insights into misleading feature combinations. We validate DISCO through extensive testing, demonstrating its superiority over existing methods in offering comprehensive insights into complex model behaviors. Our approach successfully identifies all shortcuts manually introduced into the training data (100% detection rate on the MultiRC dataset), resulting in an 18.8% regression in model performance -- a capability unmatched by any other method. Furthermore, DISCO supports interactive explanations, enabling human inspectors to distinguish spurious causes in the rule-based output. This alleviates the burden of abundant instance-wise explanations and helps assess the model's risk when encountering out-of-distribution (OOD) data.

可解释性文本分类因果推理过拟合检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。