用相位放大技术揭示神经网络分类决策的内在路径。
Through a Steerable Lens: Magnifying Neural Network Interpretability via Phase-Based Extrapolation
- 将梯度视为微小运动,通过可逆变换分解图像并放大梯度。
- 线性外推生成语义连贯的类间过渡图像,揭示决策方向。
- 适用于想理解模型分类逻辑的研究者与工程师。
理解深度神经网络的内部表征与决策机制仍是关键挑战。现有方法虽能定位重要输入区域,却难以阐明模型如何区分类别或输入在何种变化下会跨类。为此,我们提出新框架:将网络梯度视为微小运动,借鉴相位运动放大思想,首先使用可逆变换(复数可转向金字塔)分解图像,在变换域中计算类别条件梯度。不迭代积分梯度追踪完整路径,而是将单步梯度放大并进行线性外推,揭示模型从源类到目标类的迁移过程。在可转向金字塔域中,放大梯度生成语义合理、空间一致的形态变化,凸显分类器最敏感的方向,揭示其决策边界的几何特性。在合成与真实数据集上的实验表明,该相位导向外推生成了感知一致、语义明确的转换,为神经分类器的内部表征提供了新颖可解释的视角。
原文摘要 · Abstract (English)
Understanding the internal representations and decision mechanisms of deep neural networks remains a critical open challenge. While existing interpretability methods often identify influential input regions, they may not elucidate how a model distinguishes between classes or what specific changes would transition an input from one category to another. To address these limitations, we propose a novel framework that visualizes the implicit path between classes by treating the network gradient as a form of infinitesimal motion. Drawing inspiration from phase-based motion magnification, we first decompose images using invertible transforms-specifically the Complex Steerable Pyramid-then compute class-conditional gradients in the transformed space. Rather than iteratively integrating the gradient to trace a full path, we amplify the one-step gradient to the input and perform a linear extrapolation to expose how the model moves from source to target class. By operating in the steerable pyramid domain, these amplified gradients produce semantically meaningful, spatially coherent morphs that highlight the classifier's most sensitive directions, giving insight into the geometry of its decision boundaries. Experiments on both synthetic and real-world datasets demonstrate that our phase-focused extrapolation yields perceptually aligned, semantically meaningful transformations, offering a novel, interpretable lens into neural classifiers' internal representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。