arXiv:2501.00154cs.AIcs.CC2025-01

为线性模型设计可高效计算的概率化解释,提升可解释性实用性。

Probabilistic Explanations for Linear Models

  • 提出$(δ, ε)$-充分理由,放宽传统要求以支持高效计算。
  • 在概率保证下,可快速生成小型解释,适用于线性模型。
  • 适合关注模型可解释性的研究者与实际应用开发者。

形式化可解释人工智能(XAI)致力于为机器学习模型的决策提供具有数学保障的解释。该领域大量工作聚焦于计算“充分理由”:给定模型 $M$ 与输入 $ar{x}$,一个充分理由是 $ar{x}$ 特征的一个子集 $S$,使得任意在 $S$ 上与 $ar{x}$ 取值相同的实例 $ar{z}$,均有 $M(ar{x}) = M(ar{z})$。直观上,$S$ 中的特征足以完全解释 $ar{x}$ 的分类结果。为使充分理由实用,应尽可能小;一种自然的简化方式是引入概率松弛:对随机 $ar{z}$,其在 $S$ 上与 $ar{x}$ 一致时,满足 $P(M(ar{x}) = M(ar{z})) \geq δ$,其中 $δ \in (0,1]$。已知计算小规模 $δ$-充分理由($δ$-SR)是理论困难问题,即使在传统上被认为简单可解释的决策树上,也存在强不可近似性结果。本文提出 $(δ, ε)$-充分理由这一简单松弛,并证明可在线性模型上高效计算。

原文摘要 · Abstract (English)

Formal XAI is an emerging field that focuses on providing explanations with mathematical guarantees for the decisions made by machine learning models. A significant amount of work in this area is centered on the computation of "sufficient reasons". Given a model $M$ and an input instance $\vec{x}$, a sufficient reason for the decision $M(\vec{x})$ is a subset $S$ of the features of $\vec{x}$ such that for any instance $\vec{z}$ that has the same values as $\vec{x}$ for every feature in $S$, it holds that $M(\vec{x}) = M(\vec{z})$. Intuitively, this means that the features in $S$ are sufficient to fully justify the classification of $\vec{x}$ by $M$. For sufficient reasons to be useful in practice, they should be as small as possible, and a natural way to reduce the size of sufficient reasons is to consider a probabilistic relaxation; the probability of $M(\vec{x}) = M(\vec{z})$ must be at least some value $δ\in (0,1]$, for a random instance $\vec{z}$ that coincides with $\vec{x}$ on the features in $S$. Computing small $δ$-sufficient reasons ($δ$-SRs) is known to be a theoretically hard problem; even over decision trees--traditionally deemed simple and interpretable models--strong inapproximability results make the efficient computation of small $δ$-SRs unlikely. We propose the notion of $(δ, ε)$-SR, a simple relaxation of $δ$-SRs, and show that this kind of explanation can be computed efficiently over linear models.

可解释性线性模型概率解释形式化方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。