arXiv:2602.24149cs.LGq-bio.GN2026-02

让文本分类的解释更直观,通过掩码突出关键片段。

What You Read is What You Classify: Highlighting Attributions to Text and Text-Like Inputs

  • 用神经网络生成掩码,筛选出对分类无关的文本片段。
  • 被掩码部分的序列在分类中重要性更低,验证方法有效性。
  • 适合需要可读解释的生物序列分类任务,如基因分析。

当前针对离散标记输入(如文本)的可解释人工智能方法仍不成熟。主流可解释AI技术难以处理需兼顾局部与全局特征的标记序列,因现代模型(如Transformer)倾向于关注全局关联。现有方法常出现:(i) 识别出不连贯的重要标记,或 (ii) 给大量标记分配低重要性值。本文提出一种基于掩码的可解释AI方法,适用于基于标记的分类器。该方法训练一个解释器神经网络,生成用于隐藏分类无关信息的掩码。将掩码与分类器嵌入层的连续值进行哈达玛积后输入分类器,仅改变嵌入向量的幅度,保持方向不变。该方法在核苷酸序列分类任务中进行了验证,结果显示被掩码的片段比未掩码片段对分类的影响更小。该方法聚焦于整个标记段的重要性,生成人类可读的解释。

原文摘要 · Abstract (English)

At present, there are no easily understood explainable artificial intelligence (AI) methods for discrete token inputs, like text. Most explainable AI techniques do not extend well to token sequences, where both local and global features matter, because state-of-the-art models, like transformers, tend to focus on global connections. Therefore, existing explainable AI algorithms fail by (i) identifying disparate tokens of importance, or (ii) assigning a large number of tokens a low value of importance. This method for explainable AI for tokens-based classifiers generalizes a mask-based explainable AI algorithm for images. It starts with an Explainer neural network that is trained to create masks to hide information not relevant for classification. Then, the Hadamard product of the mask and the continuous values of the classifier's embedding layer is taken and passed through the classifier, changing the magnitude of the embedding vector but keeping the orientation unchanged. The Explainer is trained for a taxonomic classifier for nucleotide sequences and it is shown that the masked segments are less relevant to classification than the unmasked ones. This method focused on the importance the token as a whole (i.e., a segment of the input sequence), producing a human-readable explanation.

可解释AI文本分类掩码机制序列分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。