arXiv:2604.03572cs.CVphysics.optics2026-04

无需训练数据,用RGB图引导实现超低采样率的高保真超光谱成像。

Physics-Informed Untrained Learning for RGB-Guided Superresolution Single-Pixel Hyperspectral Imaging

  • 基于物理规律与未训练神经网络,结合RGB图先验进行联合重建。
  • 在6.25%采样率下成功恢复144波段超光谱数据,精度显著优于现有方法。
  • 适合缺乏标注数据的超光谱成像场景,尤其适用于硬件受限环境。

单像素成像(SPI)为高光谱采集提供了低成本途径,但在极低采样率下难以恢复高保真空间与光谱细节,属于严重不适定逆问题。尽管深度学习表现出潜力,但现有数据驱动方法依赖大规模预训练数据集,在高光谱成像中往往不切实际。为此,本文提出一种端到端物理信息驱动框架,利用未训练神经网络和RGB引导,实现无需外部训练数据的联合高光谱重建与超分辨率。该框架包含三个物理基础阶段:(1) 基于RGB导出灰度先验的正则化最小二乘法(LS-RGP),通过跨模态结构相关性初始化解;(2) 未训练高光谱恢复网络(UHRNet),通过测量一致性与混合正则化优化重建;(3) 基于Transformer的未训练超分辨率网络(USRNet),通过跨模态注意力将高频率细节从RGB引导图迁移至空间上采样。大量基准数据集实验表明,本方法在重建精度与光谱保真度上均显著超越现有最优算法。此外,基于真实单像素成像系统的概念验证实验成功实现了仅6.25%采样率下的144波段高光谱数据立方体重建。所提方法为计算高光谱成像提供了一种鲁棒、数据高效的解决方案。

原文摘要 · Abstract (English)

Single-pixel imaging (SPI) offers a cost-effective route to hyperspectral acquisition but struggles to recover high-fidelity spatial and spectral details under extremely low sampling rates, a severely ill-posed inverse problem. While deep learning has shown potential, existing data-driven methods demand large-scale pretraining datasets that are often impractical in hyperspectral imaging. To overcome this limitation, we propose an end-to-end physics-informed framework that leverages untrained neural networks and RGB guidance for joint hyperspectral reconstruction and super-resolution without any external training data. The framework comprises three physically grounded stages: (1) a Regularized Least-Squares method with RGB-derived Grayscale Priors (LS-RGP) that initializes the solution by exploiting cross-modal structural correlations; (2) an Untrained Hyperspectral Recovery Network (UHRNet) that refines the reconstruction through measurement consistency and hybrid regularization; and (3) a Transformer-based Untrained Super-Resolution Network (USRNet) that upsamples the spatial resolution via cross-modal attention, transferring high-frequency details from the RGB guide. Extensive experiments on benchmark datasets demonstrate that our approach significantly surpasses state-of-the-art algorithms in both reconstruction accuracy and spectral fidelity. Moreover, a proof-of-concept experiment using a physical single-pixel imaging system validates the framework's practical applicability, successfully reconstructing a 144-band hyperspectral data cube at a mere 6.25% sampling rate. The proposed method thus provides a robust, data-efficient solution for computational hyperspectral imaging.

超光谱成像单像素成像未训练网络跨模态引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。