轻量化模型实现高光谱图像分类的精度与效率平衡。
BCG-Former: Toward Pareto-Efficient Hyperspectral Image Classification via Band-Contextual Gating

- 引入频带上下文门控,动态调整光谱特征。
- 在8个数据集上准确率91.5%~99.5%,推理延迟低于1毫秒。
- 适合无人机、小卫星等资源受限场景部署。
高光谱图像(HSI)分类系统日益应用于无人机和小型星载传感器等计算资源严格受限的平台。在此类场景下,仅追求高精度已不够,模型还需满足严苛的延迟与内存约束。然而,现有大部分HSI分类器仍聚焦于精度,忽视效率。本文提出BCG-Former,一种轻量级CNN-Transformer混合架构,旨在解决这一权衡问题。模型引入三项创新:(1) 频带上下文门控(BCG),利用局部频带间上下文与可学习温度锐化实现自适应光谱重校准;(2) 光谱摘要令牌,用于连接光谱与空间特征;(3) 单次通过的频带位置编码(Band-RoPE)结合线性注意力,实现高效联合表征学习。在经典的机载(Pavia University, Salinas, Indian Pines, Houston 2013/2018)与无人机载(WHU-Hi-LongKou, HongHu, HanChuan)基准数据集上,BCG-Former整体准确率从Houston 2018的91.51%到Houston 2013的99.49%,推理延迟保持在0.91–0.95毫秒,参数量仅0.10–0.23M。在全部八个基准上,其始终位于或接近精度-延迟的帕累托前沿,优于或匹配近期基于CNN、Transformer及Mamba的方法,且计算成本仅为后者的极小部分。消融实验表明三者互补,其中BCG贡献最大。这些结果确立了BCG-Former作为实时与大规模遥感应用中强效的精度-效率帕累托候选方案。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) classification systems are increasingly deployed on platforms with strict computational budgets, such as UAVs and small spaceborne sensors. In these settings, accuracy alone is not enough; the model must also run within tight latency and memory constraints. Most recent HSI classifiers, however, focus on accuracy and pay relatively little attention to these constraints. We propose BCG-Former, a lightweight CNN-Transformer hybrid that targets this trade-off. The model introduces three innovations: (1) Band-Contextual Gating (BCG) for adaptive spectral recalibration using local inter-band context and learnable temperature sharpening, (2) a spectral summary token that bridges spectral and spatial features, and (3) single-pass Band-RoPE combined with linear attention for efficient joint representation learning. Evaluated on classical airborne (Pavia University, Salinas, Indian Pines, Houston 2013/2018) and UAV-borne benchmark datasets (WHU-Hi-LongKou, HongHu, and HanChuan), BCG-Former achieves over-all accuracy ranging from 91.51% on Houston 2018 to 99.49% on Houston 2013, while maintaining sub-millisecond inference latency (0.91-0.95ms) and using only 0.10-0.23M parameters. Across all eight benchmarks, BCG-Former consistently resides on or near the Pareto frontier of accuracy versus latency, outperforming or matching recent CNN-, Transformer-, and Mamba-based methods at a fraction of their computational cost. Ablation studies confirm that all three components are complementary, with BCG providing the largest individual contribution. These results establish BCG-Former as a strong accuracy-efficiency Pareto candidate for real-time and large-scale remote sensing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。