用闪烁频率分析神经元响应,让神经网络更可解释。
Adapting the Biological SSVEP Response to Artificial Neural Networks
- 借鉴神经科学的频率标记法,通过正弦调制图像刺激神经元。
- 发现神经网络中存在显著的谐波与互调响应,类似生物脑电活动。
- 适合关注模型可解释性、剪枝优化的研究者使用。
神经元重要性评估对于理解人工神经网络(ANNs)内部机制、提升其可解释性与效率至关重要。本文提出一种受神经科学中频率标记技术启发的新方法:对图像输入施加正弦对比度调制,并分析由此引发的神经元激活模式,实现对网络决策过程的细粒度分析。在用于图像分类的卷积神经网络实验中,部分基于频率的标记条件下,观察到显著的谐波与互调现象。这些结果表明,人工神经网络在响应闪烁频率时表现出类似生物大脑的行为特征,为通过频率标记进行神经元/滤波器重要性评估开辟了新路径。该方法在模型剪枝和可解释性方面具有应用前景,有助于推动可解释人工智能发展,缓解神经网络透明性不足的问题。未来研究方向包括设计新型损失函数,以鼓励人工神经网络呈现更符合生物学规律的行为。
原文摘要 · Abstract (English)
Neuron importance assessment is crucial for understanding the inner workings of artificial neural networks (ANNs) and improving their interpretability and efficiency. This paper introduces a novel approach to neuron significance assessment inspired by frequency tagging, a technique from neuroscience. By applying sinusoidal contrast modulation to image inputs and analyzing resulting neuron activations, this method enables fine-grained analysis of a network's decision-making processes. Experiments conducted with a convolutional neural network for image classification reveal notable harmonics and intermodulations in neuron-specific responses under part-based frequency tagging. These findings suggest that ANNs exhibit behavior akin to biological brains in tuning to flickering frequencies, thereby opening avenues for neuron/filter importance assessment through frequency tagging. The proposed method holds promise for applications in network pruning, and model interpretability, contributing to the advancement of explainable artificial intelligence and addressing the lack of transparency in neural networks. Future research directions include developing novel loss functions to encourage biologically plausible behavior in ANNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。