提出可解释的光谱交互框架,让高光谱分类模型透明化。
White-Box mHC: Electromagnetic Spectrum-Aware and Interpretable Stream Interactions for Hyperspectral Image Classification
- 用结构化方向矩阵显式建模不同光谱区间的交互。
- 学习到的交互模式具有空间一致性与非对称性特征。
- 适合关注模型可解释性与光谱机制研究者使用。
在高光谱图像分类(HSIC)中,多数深度学习模型依赖于不透明的光谱-空间特征混合,限制了可解释性并阻碍对内部决策机制的理解。我们提出物理光谱感知的白盒超连接框架ES-mHC,通过结构化、方向性的矩阵显式建模不同电磁波段分组间的残差流交互。通过分离特征表示与交互结构,ES-mHC促进光谱分组专业化,减少冗余,并暴露可直接可视化和空间分析的内部信息流。以高光谱图像分类为测试场景,我们发现学习到的超连接矩阵呈现一致的空间模式与非对称交互行为,揭示了模型内部动态机制。此外,增大扩展率能加速结构化交互模式的出现。结果表明,ES-mHC将HSIC从纯黑箱预测任务转变为结构透明、部分白箱的学习过程。
原文摘要 · Abstract (English)
In hyperspectral image classification (HSIC), most deep learning models rely on opaque spectral-spatial feature mixing, limiting their interpretability and hindering understanding of internal decision mechanisms. We present physical spectrum-aware white-box mHC, named ES-mHC, a hyper-connection framework that explicitly models interactions among different electromagnetic spectrum groupings (residual stream in mHC) interactions using structured, directional matrices. By separating feature representation from interaction structure, ES-mHC promotes electromagnetic spectrum grouping specialization, reduces redundancy, and exposes internal information flow that can be directly visualized and spatially analyzed. Using hyperspectral image classification as a representative testbed, we demonstrate that the learned hyper-connection matrices exhibit coherent spatial patterns and asymmetric interaction behaviors, providing mechanistic insight into the model internal dynamics. Furthermore, we find that increasing the expansion rate accelerates the emergence of structured interaction patterns. These results suggest that ES-mHC transforms HSIC from a purely black-box prediction task into a structurally transparent, partially white-box learning process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。