arXiv:2511.02720cs.CVcs.AI2025-11

用大模型自动解释卷积网络的决策,让普通人也能看懂AI怎么想的。

LLEXICORP: End-user Explainability of Convolutional Neural Networks

  • 把概念相关性传播结果交给大模型,自动生成名称和说明
  • 能为专家提供技术细节,也能为非专业人士生成通俗解释
  • 通过提示工程保证解释准确,避免胡编乱造

卷积神经网络(CNN)支撑着众多现代计算机视觉系统。随着应用范围从日常到关键领域扩展,对模型决策过程进行解释(XAI)的需求日益迫切。已有研究发现,CNN顶层通道可对应人类可理解的概念。概念相关性传播(CRP)方法能回溯预测结果,定位激活这些通道的图像。但现有CRP流程高度依赖人工:专家需手动观察激活图像来命名概念,并从相关性图中拼凑冗长解释,限制了可读性和可扩展性。为此,我们提出大型语言模型解释概念相关性传播(LLEXICORP),一个将CRP与多模态大语言模型结合的模块化流程。该方法自动为概念原型分配描述性名称,并将定量相关性分布转化为直观自然语言叙述。为确保忠实性,我们设计提示词,通过示例教导语言模型理解CRP语义,并强制分离命名与解释任务。生成文本可适配不同受众,既支持专家获取低层次技术描述,也适合非技术利益相关者获取高层级摘要。我们在ImageNet上使用VGG16模型对多种图像进行了定性评估,结果表明,将基于概念的归因方法与大语言模型结合,能显著降低解读深度神经网络的门槛,推动更透明的人工智能系统发展。

原文摘要 · Abstract (English)

Convolutional neural networks (CNNs) underpin many modern computer vision systems. With applications ranging from common to critical areas, a need to explain and understand the model and its decisions (XAI) emerged. Prior works suggest that in the top layers of CNNs, the individual channels can be attributed to classifying human-understandable concepts. Concept relevance propagation (CRP) methods can backtrack predictions to these channels and find images that most activate these channels. However, current CRP workflows are largely manual: experts must inspect activation images to name the discovered concepts and must synthesize verbose explanations from relevance maps, limiting the accessibility of the explanations and their scalability. To address these issues, we introduce Large Language model EXplaIns COncept Relevance Propagation (LLEXICORP), a modular pipeline that couples CRP with a multimodal large language model. Our approach automatically assigns descriptive names to concept prototypes and generates natural-language explanations that translate quantitative relevance distributions into intuitive narratives. To ensure faithfulness, we craft prompts that teach the language model the semantics of CRP through examples and enforce a separation between naming and explanation tasks. The resulting text can be tailored to different audiences, offering low-level technical descriptions for experts and high-level summaries for non-technical stakeholders. We qualitatively evaluate our method on various images from ImageNet on a VGG16 model. Our findings suggest that integrating concept-based attribution methods with large language models can significantly lower the barrier to interpreting deep neural networks, paving the way for more transparent AI systems.

AI解释大模型卷积网络可视化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。