改进神经网络解释性方法,精准定位关键神经元并可视化决策路径。
Neural network interpretability with layer-wise relevance propagation: novel techniques for neuron selection and visualization
- 通过优化LRP反向传播中的神经元选择策略,提升解释精度。
- 在VGG16上实现更低的MSE与SMAPE误差,显著提高解释准确性。
- 结合热力图与反卷积技术,直观展示模型决策关键路径,适合安全敏感场景使用。
理解复杂神经网络的决策过程对透明性和可问责性至关重要的应用至关重要。本文针对层间相关性传播(LRP)技术,提出一种新方法以改进神经元贡献评估的精确度。该方法以VGG16为案例,在反向传播过程中优化神经元选择,利用均方误差(MSE)和对称平均绝对百分比误差(SMAPE)等指标进行精度评估。通过构建神经网络图谱并生成热力图,突出关键信息传递路径,并采用反卷积可视化技术重建特征图,全面揭示模型内部运作机制。大量实验表明,该方法有效提升可解释性,推动计算机视觉领域更透明的人工智能系统发展,增强真实机器视觉应用中AI模型的可信度与可靠性。
原文摘要 · Abstract (English)
Interpreting complex neural networks is crucial for understanding their decision-making processes, particularly in applications where transparency and accountability are essential. This proposed method addresses this need by focusing on layer-wise Relevance Propagation (LRP), a technique used in explainable artificial intelligence (XAI) to attribute neural network outputs to input features through backpropagated relevance scores. Existing LRP methods often struggle with precision in evaluating individual neuron contributions. To overcome this limitation, we present a novel approach that improves the parsing of selected neurons during LRP backward propagation, using the Visual Geometry Group 16 (VGG16) architecture as a case study. Our method creates neural network graphs to highlight critical paths and visualizes these paths with heatmaps, optimizing neuron selection through accuracy metrics like Mean Squared Error (MSE) and Symmetric Mean Absolute Percentage Error (SMAPE). Additionally, we utilize a deconvolutional visualization technique to reconstruct feature maps, offering a comprehensive view of the network's inner workings. Extensive experiments demonstrate that our approach enhances interpretability and supports the development of more transparent artificial intelligence (AI) systems for computer vision applications. This advancement has the potential to improve the trustworthiness of AI models in real-world machine vision applications, thereby increasing their reliability and effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。