arXiv:2604.22540cs.LGcs.AI2026-04

对比学习让模型更透明,解释性优于传统分类方法。

On the Properties of Feature Attribution for Supervised Contrastive Learning

论文配图:On the Properties of Feature Attribution for Supervised Contrastive Learning
图 1 · 摘自论文原文
  • 用监督对比学习训练图像分类模型,生成更可信的特征重要性解释。
  • 在忠实性、复杂度和连续性上,监督对比学习的解释质量显著更高。
  • 适合关注模型可解释性与安全性的研究者和应用开发者。

大多数分类神经网络使用交叉熵作为损失函数,需显式分类层。而对比学习(CL)通过构建嵌入空间,使相似数据投影靠近、相异数据投影远离。监督对比学习(SCL)利用标签作为相似性标准,形成聚类良好的嵌入空间。相比交叉熵,SCL在对抗鲁棒性和分布外检测方面表现更优,更适合安全关键场景。本文实证表明,采用SCL训练的图像分类模型,在特征归因的忠实性、复杂度和连续性方面均优于普通对比学习。这些结果支持了基于对比学习提升模型可解释性的方向,有助于实践者在追求准确率的同时,兼顾模型透明性。

原文摘要 · Abstract (English)

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive Learning (CL). Instead of explicitly operating a classification, CL has the NN produce an embedding space where projections of similar data are pulled together, while projections of dissimilar data are pushed apart. In the case of Supervised CL (SCL), labels are adopted as similarity criteria, thus creating an embedding space where the projected data points are well-clustered. SCL provides crucial advantages over CE with regard to adversarial robustness and out-of-distribution detection, thus making it a more natural choice in safety-critical scenarios. In the present paper, we empirically show that NNs for image classification trained with SCL present higher-quality feature attribution explanations than CL with regard to faithfulness, complexity, and continuity. These results reinforce previous findings about CL-based approaches when targeting more trustworthy and transparent NNs and can guide practitioners in the selection of training objectives targeting not only accuracy, but also transparency of the models.

对比学习可解释性模型透明

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。