将自解释模型的可视化能力迁移到预测模型,无需重新训练。
Transferring Visual Explainability of Self-Explaining Models to Prediction-Only Models without Additional Training
- 基于任务算术框架,从源域迁移解释能力到目标域。
- 在多个数据集上实现高质量解释,且分类准确率基本不变。
- 适合已有预测模型但需解释能力的用户快速部署。
在图像分类中,同时要求预测与解释效率时,自解释模型通过一次推理完成两项任务,效果良好。然而,对于已有预测模型的用户,从头训练新的自解释模型需付出高昂的标注与计算成本。本文提出一种方法,基于任务算术框架,将源域中训练好的自解释模型的视觉解释能力迁移到目标域的预测仅模型中,无需额外训练。所提自解释模型扩展了基于视觉变换器的预测仅模型架构,使该方法可应用于大量已训练的预测模型。在多个图像分类数据集上的实验表明,除源域与目标域差异较大外,解释能力迁移成功,目标域的解释质量提升,同时分类准确率未显著下降。
原文摘要 · Abstract (English)
In image classification scenarios where both prediction and explanation efficiency are required, self-explaining models that perform both tasks in a single inference are effective. However, for users who already have prediction-only models, training a new self-explaining model from scratch imposes significant costs in terms of both labeling and computation. This study proposes a method to transfer the visual explanation capability of self-explaining models learned in a source domain to prediction-only models in a target domain based on a task arithmetic framework. Our self-explaining model comprises an architecture that extends Vision Transformer-based prediction-only models, enabling the proposed method to endow explanation capability to many trained prediction-only models without additional training. Experiments on various image classification datasets demonstrate that, except for transfers between less-related domains, the transfer of visual explanation capability from source to target domains is successful, and explanation quality in the target domain improves without substantially sacrificing classification accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。