AMBER提升高光谱图像分割精度,无需降维预处理。
AMBER -- Advanced SegFormer for Multi-Band Image Segmentation: an application to Hyperspectral Imaging
- 用3D卷积与自定义核改进SegFormer,直接处理多波段数据。
- 在三个基准数据集上准确率超传统CNN方法,PRISMA数据集达最新水平。
- 适合遥感、高维数据等需要精准分割的场景,兼具空谱联合分析能力。
深度学习已革新高光谱图像(HSI)分析,可提取复杂光谱与空间特征。尽管卷积神经网络(CNN)曾是HSI分类的核心,但其难以捕捉全局上下文信息,促使研究转向视觉变换器(ViTs)。本文提出AMBER,一种专为多波段图像分割设计的先进SegFormer。AMBER通过引入三维卷积、定制卷积核尺寸和漏斗化(Funnelizer)层,实现对高光谱数据的直接处理,无需预处理阶段的光谱降维。在三个基准数据集(Salinas、Indian Pines、Pavia University)及一个来自PRISMA卫星的数据集上的实验表明,AMBER在总体准确率(Overall Accuracy)、Kappa系数和平均准确率方面优于传统基于CNN的方法,并在PRISMA数据集上达到当前最优性能。结果表明AMBER具有强鲁棒性,适用于机载与星载数据,具备成为遥感及其他高维数据分析强大工具的潜力。
原文摘要 · Abstract (English)
Deep learning has revolutionized the field of hyperspectral image (HSI) analysis, enabling the extraction of complex spectral and spatial features. While convolutional neural networks (CNNs) have been the backbone of HSI classification, their limitations in capturing global contextual features have led to the exploration of Vision Transformers (ViTs). This paper introduces AMBER, an advanced SegFormer specifically designed for multi-band image segmentation. AMBER enhances the original SegFormer by incorporating three-dimensional convolutions, custom kernel sizes, and a Funnelizer layer. This architecture enables processing hyperspectral data directly, without requiring spectral dimensionality reduction during preprocessing. Our experiments, conducted on three benchmark datasets (Salinas, Indian Pines, and Pavia University) and on a dataset from the PRISMA satellite, show that AMBER outperforms traditional CNN-based methods in terms of Overall Accuracy, Kappa coefficient, and Average Accuracy on the first three datasets, and achieves state-of-the-art performance on the PRISMA dataset. These findings highlight AMBER's robustness, adaptability to both airborne and spaceborne data, and its potential as a powerful solution for remote sensing and other domains requiring advanced analysis of high-dimensional data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。