arXiv:2409.16865cs.CV2024-09ECCV

用生成模型可视化CNN的抽象特征,让深层学习的决策过程变得可理解。

Linking in Style: Understanding learned features in deep learning models

论文配图:Linking in Style: Understanding learned features in deep learning models
图 1 · 摘自论文原文
  • 构建连接网络,将分类器最后一层映射到StyleGAN的潜在空间。
  • 发现两类空间语义顺序一致,支持直接线性映射,计算成本低。
  • 可批量分析数千个神经元,识别特定语义概念的响应单元。

卷积神经网络(CNN)通过学习抽象特征进行物体分类,但理解这些特征仍具挑战性,原因在于结果难以解释或计算成本过高。本文提出一种自动方法,通过引入连接网络,将预训练分类器的倒数第二层映射到生成模型(StyleGAN-XL)的潜在空间,实现对分类器表征的可解释、人友好的可视化。研究发现,两类空间存在一致的语义排序,支持直接线性映射。连接网络训练计算开销小,且与生成模型和分类器的训练解耦。我们构建了自动化流程,利用基于生成模型的可视化,通过分析图像域中分类器激活变化来量化学习表征。该量化方法可系统研究数千个神经元的表示,并提取与特定语义概念相关的神经元进行可视化。此外,展示了如何利用该方法通过反事实样例量化并解读分类器的决策边界。总体而言,本方法为理解CNN中的抽象表征提供了系统化、客观的视角。

原文摘要 · Abstract (English)

Convolutional neural networks (CNNs) learn abstract features to perform object classification, but understanding these features remains challenging due to difficult-to-interpret results or high computational costs. We propose an automatic method to visualize and systematically analyze learned features in CNNs. Specifically, we introduce a linking network that maps the penultimate layer of a pre-trained classifier to the latent space of a generative model (StyleGAN-XL), thereby enabling an interpretable, human-friendly visualization of the classifier's representations. Our findings indicate a congruent semantic order in both spaces, enabling a direct linear mapping between them. Training the linking network is computationally inexpensive and decoupled from training both the GAN and the classifier. We introduce an automatic pipeline that utilizes such GAN-based visualizations to quantify learned representations by analyzing activation changes in the classifier in the image domain. This quantification allows us to systematically study the learned representations in several thousand units simultaneously and to extract and visualize units selective for specific semantic concepts. Further, we illustrate how our method can be used to quantify and interpret the classifier's decision boundary using counterfactual examples. Overall, our method offers systematic and objective perspectives on learned abstract representations in CNNs. https://github.com/kaschube-lab/LinkingInStyle.git

特征可视化CNN解析生成模型可解释AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。