arXiv:2501.04643cs.CV2025-01

用小波变换和注意力机制改进胶囊网络,高效分类高光谱图像

Discrete Wavelet Transform-Based Capsule Network for Hyperspectral Image Classification

  • 结合小波变换与注意力,减少胶囊网络连接冗余
  • 多尺度路由剪枝大幅降低计算量,准确率达当前最优
  • 适合需要低功耗部署的遥感图像分类场景

高光谱图像(HSI)分类是构建大规模地球监测系统的关键技术,其蕴含的信息远超传统视觉图像。近期方法利用胶囊网络(CapsNet)捕捉光谱-空间信息,但因层间全连接结构导致计算开销大。为此,本文提出DWT-CapsNet,通过在离散小波变换(DWT)下采样层中引入定制注意力机制,缓解传统下采样带来的信息损失。同时,设计新型多尺度路由算法,剪枝大量胶囊连接;构建胶囊金字塔融合机制,聚合多粒度光谱-空间关系,并在部分连接架构中引入自注意力,强化关键关联。实验表明,该方法在保持更低运行时间、浮点运算次数(FLOPs)和参数量的前提下,达到当前最优分类精度,适用于实际遥感应用。

原文摘要 · Abstract (English)

Hyperspectral image (HSI) classification is a crucial technique for remote sensing to build large-scale earth monitoring systems. HSI contains much more information than traditional visual images for identifying the categories of land covers. One recent feasible solution for HSI is to leverage CapsNets for capturing spectral-spatial information. However, these methods require high computational requirements due to the full connection architecture between stacked capsule layers. To solve this problem, a DWT-CapsNet is proposed to identify partial but important connections in CapsNet for a effective and efficient HSI classification. Specifically, we integrate a tailored attention mechanism into a Discrete Wavelet Transform (DWT)-based downsampling layer, alleviating the information loss problem of conventional downsampling operation in feature extractors. Moreover, we propose a novel multi-scale routing algorithm that prunes a large proportion of connections in CapsNet. A capsule pyramid fusion mechanism is designed to aggregate the spectral-spatial relationships in multiple levels of granularity, and then a self-attention mechanism is further conducted in a partially and locally connected architecture to emphasize the meaningful relationships. As shown in the experimental results, our method achieves state-of-the-art accuracy while keeping lower computational demand regarding running time, flops, and the number of parameters, rendering it an appealing choice for practical implementation in HSI classification.

高光谱图像胶囊网络小波变换轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。