解决深层模型概念解释不一致问题,统一跨层语义表示。
GCAV: A Global Concept Activation Vector Framework for Cross-Layer Consistency in Interpretability
- 用对比学习对齐各层概念表征,融合生成全局一致向量。
- 跨层TCAV分数方差降低,对抗扰动下仍保持稳定。
- 适合需要可信、连贯概念解释的研究者使用。
概念激活向量(CAVs)通过量化神经网络对人类定义概念的敏感度,为深度模型提供有力的解释手段。然而,在不同层级独立计算时,CAVs常出现语义不一致,导致跨层比较不可靠。为此,本文提出全局概念激活向量(GCAV)框架,将多层CAVs统一为一个语义一致的表示。方法采用对比学习对齐各层概念表征,并利用注意力融合机制构建全局整合的CAV。该方法显著降低了TCAV评分的方差,同时保持概念相关性,确保概念归因更稳定可靠。我们进一步提出基于GCAV的TCAV测试方法(TGCAV),在多个深度神经网络上进行实验,结果表明:GCAV有效缓解了跨层概念不一致性,提升了概念定位精度,并增强了对对抗扰动的鲁棒性。通过整合跨层信息,本方法提供了更全面、可解释的深度模型概念编码理解。代码与模型开源:https://github.com/Zhenghao-He/GCAV。
原文摘要 · Abstract (English)
Concept Activation Vectors (CAVs) provide a powerful approach for interpreting deep neural networks by quantifying their sensitivity to human-defined concepts. However, when computed independently at different layers, CAVs often exhibit inconsistencies, making cross-layer comparisons unreliable. To address this issue, we propose the Global Concept Activation Vector (GCAV), a novel framework that unifies CAVs into a single, semantically consistent representation. Our method leverages contrastive learning to align concept representations across layers and employs an attention-based fusion mechanism to construct a globally integrated CAV. By doing so, our method significantly reduces the variance in TCAV scores while preserving concept relevance, ensuring more stable and reliable concept attributions. To evaluate the effectiveness of GCAV, we introduce Testing with Global Concept Activation Vectors (TGCAV) as a method to apply TCAV to GCAV-based representations. We conduct extensive experiments on multiple deep neural networks, demonstrating that our method effectively mitigates concept inconsistency across layers, enhances concept localization, and improves robustness against adversarial perturbations. By integrating cross-layer information into a coherent framework, our method offers a more comprehensive and interpretable understanding of how deep learning models encode human-defined concepts. Code and models are available at https://github.com/Zhenghao-He/GCAV.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。