无需标注数据,用语言描述就能训练任意概念激活向量。
LG-CAV: Train Any Concept Activation Vector with Language Guidance
- 用预训练视觉语言模型的描述作为指导,无监督训练概念激活向量。
- 在九种模型上验证,新方法生成的CAV质量显著优于现有方法。
- 适合想解释模型决策且缺乏标注数据的研究者使用。
概念激活向量(CAV)在可解释人工智能中备受关注,能将模型预测归因于特定概念。然而,传统CAV训练需大量高质量图像,成本高且仅限于预定义概念。为此,我们提出语言引导的CAV(LG-CAV),利用预训练视觉语言模型(如CLIP)中的丰富概念知识,无需标注数据即可训练任意概念的CAV。通过在一组共用图像(探针图像)上计算概念描述的激活值,作为语言指导来训练LG-CAV。进一步地,在目标模型所有预测类别上训练出高质量的LG-CAV后,我们提出激活样本重加权(ASR)作为模型校正技术,反向提升目标模型性能。在四个数据集、九种架构上的实验表明,LG-CAV在任意概念下均显著优于以往方法,其模型校正效果也达到当前基于概念方法的领先水平。代码已开源。
原文摘要 · Abstract (English)
Concept activation vector (CAV) has attracted broad research interest in explainable AI, by elegantly attributing model predictions to specific concepts. However, the training of CAV often necessitates a large number of high-quality images, which are expensive to curate and thus limited to a predefined set of concepts. To address this issue, we propose Language-Guided CAV (LG-CAV) to harness the abundant concept knowledge within the certain pre-trained vision-language models (e.g., CLIP). This method allows training any CAV without labeled data, by utilizing the corresponding concept descriptions as guidance. To bridge the gap between vision-language model and the target model, we calculate the activation values of concept descriptions on a common pool of images (probe images) with vision-language model and utilize them as language guidance to train the LG-CAV. Furthermore, after training high-quality LG-CAVs related to all the predicted classes in the target model, we propose the activation sample reweighting (ASR), serving as a model correction technique, to improve the performance of the target model in return. Experiments on four datasets across nine architectures demonstrate that LG-CAV achieves significantly superior quality to previous CAV methods given any concept, and our model correction method achieves state-of-the-art performance compared to existing concept-based methods. Our code is available at https://github.com/hqhQAQ/LG-CAV.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。