用最少的输入区域,实现更准确的模型决策解释。
Less is More: Efficient Black-box Attribution via Minimal Interpretable Subset Selection
- 将重要区域识别转化为可高效求解的子模优化问题。
- 在8个基础模型上平均提升36.3%插入/39.6%删除指标。
- 比传统方法快1.6倍,适合高精度且快速的黑盒解释场景。
为构建可信AI系统,需识别影响模型决策的关键输入区域。现有方法在处理离散输入(如图像)时面临组合爆炸难题。本文提出一种新型高效黑盒解释机制LiMA(Less input is More faithful for Attribution),将重要区域识别重构为子模子集选择的优化问题。首先设计一个能量化子集重要性并捕捉其对决策影响的子模函数;其次通过新型双向贪心搜索算法高效排序输入子区域,实现快速定位最相关与最无关区域,并确保最优解释边界以最小化误差。在8个基础模型上的实验表明,该方法以更少区域提供更忠实的解释,插入与删除任务平均分别提升36.3%和39.6%。相比朴素贪心搜索,效率提升1.6倍。此外,在解释模型预测错误原因时,其平均最高置信度比当前最优方法高出86.1%。代码已开源:https://github.com/RuoyuChen10/LIMA。
原文摘要 · Abstract (English)
To develop a trustworthy AI system, which aim to identify the input regions that most influence the models decisions. The primary task of existing attribution methods lies in efficiently and accurately identifying the relationships among input-prediction interactions. Particularly when the input data is discrete, such as images, analyzing the relationship between inputs and outputs poses a significant challenge due to the combinatorial explosion. In this paper, we propose a novel and efficient black-box attribution mechanism, LiMA (Less input is More faithful for Attribution), which reformulates the attribution of important regions as an optimization problem for submodular subset selection. First, to accurately assess interactions, we design a submodular function that quantifies subset importance and effectively captures their impact on decision outcomes. Then, efficiently ranking input sub-regions by their importance for attribution, we improve optimization efficiency through a novel bidirectional greedy search algorithm. LiMA identifies both the most and least important samples while ensuring an optimal attribution boundary that minimizes errors. Extensive experiments on eight foundation models demonstrate that our method provides faithful interpretations with fewer regions and exhibits strong generalization, shows an average improvement of 36.3% in Insertion and 39.6% in Deletion. Our method also outperforms the naive greedy search in attribution efficiency, being 1.6 times faster. Furthermore, when explaining the reasons behind model prediction errors, the average highest confidence achieved by our method is, on average, 86.1% higher than that of state-of-the-art attribution algorithms. The code is available at https://github.com/RuoyuChen10/LIMA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。