提出新型无卷积张量层,高效分解高光谱图像多维特征
Convolution-Free Holistic Multivariance Decomposition Layer for Efficient Hyperspectral Image Classification Tensor Networks

- 通过可学习矩阵支持分离单模与高阶交互特征
- 在3个基准数据集上优于传统张量分解方法,精度更高
- 参数量远少于CNN,适合资源受限场景
高光谱图像分类的传统特征提取方法依赖僵化的张量分解,难以捕捉复杂的空谱耦合关系,或采用参数量巨大的卷积神经网络,计算开销高。本文提出端到端可微的全息多变性分解(HMD)框架,作为新型神经网络层。HMD-0、HMD-1 和 HMD-2 通过可学习的矩阵值支撑,显式分离单一模式变化与协同高维交互,与下游分类器联合优化。在三个基准高光谱数据集上的全面评估表明,高层 HMD 层相比经典可学习张量基线(如 Tucker、CP、TT 分解)实现了更优分类精度。此外,HMD-1 和 HMD-2 在泛化能力和训练稳定性方面达到标准 2D/3D-CNN 水平,但所需特征提取器参数显著减少。结果证明,HMD 框架为多维高光谱图像分类提供了结构稳健的卷积替代方案,兼具高参数效率和优化过程中的稳定性。
原文摘要 · Abstract (English)
Feature extraction for hyperspectral image classification is conventionally addressed using rigid tensor decompositions that fail to capture complex spatio-spectral interdependencies, or heavily parameterized convolutional neural networks that are computationally expensive. To overcome these limitations, this work introduces the Holistic Multivariance Decomposition (HMD) framework as a novel, end-to-end differentiable neural network layer. By explicitly separating independent single mode variations from cooperative higher dimensional interactions via learnable, matrix valued supports, the proposed HMD-0, HMD-1 and HMD-2 approximants are optimized jointly with a downstream classifier via backpropagation. Comprehensive evaluations across three benchmark HS datasets demonstrate that the higher level HMD layers achieve superior classification accuracy compared to classical learnable tensor baselines, including Tucker, Canonical Polyadic, and Tensor Train decompositions. Furthermore, HMD-1 and HMD-2 achieve a generalization capacity and training stability comparable to standard 2D and 3D-CNNs while requiring significantly fewer feature extractor parameters. These results demonstrate that the HMD framework provides a structurally robust substitute for traditional convolution in multidimensional HS image classification, offering high parameter efficiency and stability throughout the optimization process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。