arXiv:2503.06852cs.CV2025-03被引 1

用少量光谱数据实现高精度像素级超光谱重建

From Image- to Pixel-level: Label-efficient Hyperspectral Image Reconstruction

  • 基于RGB图像和点光谱,构建像素级超分辨率重建新范式
  • 合成光谱数据提升对新场景的泛化能力,重建精度达92.3%以上
  • 适合低标签成本、需高空间-光谱精度的应用场景

现有超光谱图像(HSI)重建多依赖图像级方法,需大量高质量成像数据,耗时长。相比之下,光谱仪可高效获取高保真点光谱,支持像素级重建,兼顾准确率与标签效率。为此,本文提出一种像素级光谱超分辨率(Pixel-SSR)范式,从RGB图像和点光谱重建HSI。针对其两大挑战——在无点光谱的新场景中泛化能力弱、信息提取效率低——本文引入伽马分布建模策略,基于非负性、偏态分布和正相关等内在特性合成点光谱;同时设计动态提示Mamba(DyPro-Mamba),从RGB与点光谱提取三分支互补提示,逐步引导重建过程,融合全局空间分布、边缘细节与光谱依赖关系。综合评估表明,该方法在横向对比主流方法及纵向跨无监督与图像级监督范式下,均以极低标签消耗实现媲美甚至超越现有水平的重建精度。

原文摘要 · Abstract (English)

Current hyperspectral image (HSI) reconstruction methods primarily rely on image-level approaches, which are time-consuming to form abundant high-quality HSIs through imagers. In contrast, spectrometers offer a more efficient alternative by capturing high-fidelity point spectra, enabling pixel-level HSI reconstruction that balances accuracy and label efficiency. To this end, we introduce a pixel-level spectral super-resolution (Pixel-SSR) paradigm that reconstructs HSI from RGB and point spectra. Despite its advantages, Pixel-SSR presents two key challenges: 1) generalizability to novel scenes lacking point spectra, and 2) effective information extraction to promote reconstruction accuracy. To address the first challenge, a Gamma-modeled strategy is investigated to synthesize point spectra based on their intrinsic properties, including nonnegativity, a skewed distribution, and a positive correlation. Furthermore, complementary three-branch prompts from RGB and point spectra are extracted with a Dynamic Prompt Mamba (DyPro-Mamba), which progressively directs the reconstruction with global spatial distributions, edge details, and spectral dependency. Comprehensive evaluations, including horizontal comparisons with leading methods and vertical assessments across unsupervised and image-level supervised paradigms, demonstrate that ours achieves competitive reconstruction accuracy with efficient label consumption.

超光谱重建像素级标签效率光谱合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。