用分布差异替代预测变化,让大模型表格分类更可解释。
TabSHAP

- 以特征掩码后类别分布的差异衡量贡献,而非简单预测改变。
- 在成人收入和心脏病数据集上,对关键诊断特征的识别准确率显著优于基线。
- 适合需要高可信度解释的金融、医疗等高风险领域应用。
基于序列化表格数据微调的大语言模型正成为传统树模型的有力替代,尤其适用于异构或上下文丰富的数据集。然而,其在高风险领域的部署受限于缺乏可靠的可解释性;现有方法多依赖全局线性代理或标量概率变化,无法捕捉模型的完整概率不确定性。本文提出TabSHAP,一种面向基于LLM的表格分类器的模型无关可解释性框架。通过将类比Shapley值的采样联盟估计器与全输入与掩码输入类别分布间的Jensen-Shannon散度结合,直接量化每个特征对整体分布的影响。为契合表格语义,掩码操作作用于序列化提示中的键值字段(原子级),而非子词标记。在Adult Income与Heart Disease基准上的实验表明,TabSHAP能有效识别关键诊断特征,其忠实度显著高于随机基线和XGBoost代理。进一步在相同测试实例与设置下进行距离度量消融:分别用KL散度与L1距离替换相似性计算中的JSD(结果缓存于各度量),对比三者删除忠实度,验证了方法有效性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) fine-tuned on serialized tabular data are emerging as powerful alternatives to traditional tree-based models, particularly for heterogeneous or context-rich datasets. However, their deployment in high-stakes domains is hindered by a lack of faithful interpretability; existing methods often rely on global linear proxies or scalar probability shifts that fail to capture the model's full probabilistic uncertainty. In this work, we introduce TabSHAP, a model-agnostic interpretability framework designed to directly attribute local query decision logic in LLM-based tabular classifiers. By adapting a Shapley-style sampled-coalition estimator with Jensen-Shannon divergence between full-input and masked-input class distributions, TabSHAP quantifies the distributional impact of each feature rather than simple prediction flips. To align with tabular semantics, we mask at the level of serialized key:value fields (atomic in the prompt string), not individual subword tokens. Experimental validation on the Adult Income and Heart Disease benchmarks demonstrates that TabSHAP isolates critical diagnostic features, achieving significantly higher faithfulness than random baselines and XGBoost proxies. We further run a distance-metric ablation on the same test instances and TabSHAP settings: attributions are recomputed with KL or L1 replacing JSD in the similarity step (results cached per metric), and we compare deletion faithfulness across all three.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。