arXiv:2511.21363cs.LGcs.AI2025-11中稿 · AAAI

提出新指标DPC,快速精准评估模型解释的可靠性

The Directed Prediction Change - Efficient and Trustworthy Fidelity Assessment for Local Feature Attribution Methods

  • 通过引入扰动与归因方向,改进预测变化度量
  • 速度提升近十倍,结果确定可复现
  • 适合医疗等高风险场景的解释可信性验证

解释方法的有效性取决于其对底层机器学习模型的忠实程度。在医疗等高风险场景中,临床医生和监管机构需要能真实反映模型决策过程的解释。现有保真度度量(如Infidelity)依赖蒙特卡洛近似,需大量模型评估并引入随机不确定性。本文在引导扰动实验框架下,改进了现有预测变化(PC)度量,提出定向预测变化(DPC)指标,通过融合扰动与归因的方向信息,实现近十倍速度提升,消除随机性,获得确定性且可信的评估过程,测量属性与局部Infidelity一致。DPC在皮肤病变图像和金融表格数据两个数据集、两个黑盒模型、七种解释算法及广泛超参数设置下进行评估。在4,744个不同解释结果中,结果表明DPC与PC共同支持对基线导向和局部特征归因方法的全面、高效评估,并提供确定性和可复现的结果。

原文摘要 · Abstract (English)

The utility of an explanation method critically depends on its fidelity to the underlying machine learning model. Especially in high-stakes medical settings, clinicians and regulators require explanations that faithfully reflect the model's decision process. Existing fidelity metrics such as Infidelity rely on Monte Carlo approximation, which demands numerous model evaluations and introduces uncertainty due to random sampling. This work proposes a novel metric for evaluating the fidelity of local feature attribution methods by modifying the existing Prediction Change (PC) metric within the Guided Perturbation Experiment. By incorporating the direction of both perturbation and attribution, the proposed Directed Prediction Change (DPC) metric achieves an almost tenfold speedup and eliminates randomness, resulting in a deterministic and trustworthy evaluation procedure that measures the same property as local Infidelity. DPC is evaluated on two datasets (skin lesion images and financial tabular data), two black-box models, seven explanation algorithms, and a wide range of hyperparameters. Across $4\,744$ distinct explanations, the results demonstrate that DPC, together with PC, enables a holistic and computationally efficient evaluation of both baseline-oriented and local feature attribution methods, while providing deterministic and reproducible outcomes.

解释可信性保真度评估快速计算医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。