arXiv:2503.12783cs.CVeess.IV2025-03中稿 · TNNLS被引 6

用隐式表示实现任意分辨率的高光谱图像重建

Mixed-granularity Implicit Representation for Continuous Hyperspectral Compressive Reconstruction

  • 提出多粒度隐式表征框架,分层提取多尺度特征
  • 可在不同压缩比下实现任意空间光谱分辨率重建
  • 适合需要灵活重构的高光谱成像系统应用

高光谱图像在众多领域至关重要,但传统光谱仪采集时间长。编码孔径快照光谱成像(CASSI)系统通过压缩技术加速采集,但受限于固定的空间与光谱分辨率。本文提出混合粒度隐式表征(MGIR)框架,包含层次化光谱-空间隐式编码器,实现多尺度特征提取;结合多粒度局部特征聚合器,自适应融合跨尺度特征,并通过解码器融合坐标信息以实现精确重建。该方法利用隐式神经表示,可在任意期望的空间-光谱分辨率下完成重建,显著提升CASSI系统的灵活性与适应性。大量实验表明,模型在不同光谱-空间压缩比下均达到或超越现有先进方法性能。代码将开源于https://github.com/chh11/MGIR。

原文摘要 · Abstract (English)

Hyperspectral Images (HSIs) are crucial across numerous fields but are hindered by the long acquisition times associated with traditional spectrometers. The Coded Aperture Snapshot Spectral Imaging (CASSI) system mitigates this issue through a compression technique that accelerates the acquisition process. However, reconstructing HSIs from compressed data presents challenges due to fixed spatial and spectral resolution constraints. This study introduces a novel method using implicit neural representation for continuous hyperspectral image reconstruction. We propose the Mixed Granularity Implicit Representation (MGIR) framework, which includes a Hierarchical Spectral-Spatial Implicit Encoder for efficient multi-scale implicit feature extraction. This is complemented by a Mixed-Granularity Local Feature Aggregator that adaptively integrates local features across scales, combined with a decoder that merges coordinate information for precise reconstruction. By leveraging implicit neural representations, the MGIR framework enables reconstruction at any desired spatial-spectral resolution, significantly enhancing the flexibility and adaptability of the CASSI system. Extensive experimental evaluations confirm that our model produces reconstructed images at arbitrary resolutions and matches state-of-the-art methods across varying spectral-spatial compression ratios. The code will be released at https://github.com/chh11/MGIR.

高光谱成像隐式表征压缩感知多尺度建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。