arXiv:2605.13583cs.CV2026-05中稿 · ICML

提出新方法实现快照式光谱成像的连续光谱重建与超分辨率。

Phy-CoSF: Physics-Guided Continuous Spectral Fields Reconstruction and Super-Resolution for Snapshot Compressive Imaging

论文配图:Phy-CoSF: Physics-Guided Continuous Spectral Fields Reconstruction and Super-Resolution for Snapshot Compressive Imaging
图 1 · 摘自论文原文
  • 融合深度展开网络与隐式神经表示,构建连续光谱场模块。
  • 可在任意波长处重建高保真光谱图像,优于现有主流方法。
  • 适合需要精细光谱分析的遥感、医学成像等场景。

最近的研究表明,编码孔径快照光谱成像(CASSI)系统能够从单个二维测量中捕捉三维高光谱图像(HSIs)。尽管CASSI捕获的场景具有固有的光谱连续性,但大多数现有重建方法受限于固定离散的波长输出,无法实现连续光谱重建或光谱超分辨率。为此,我们提出Phy-CoSF,将深度展开网络与隐式神经表示相结合,建立了一种新的连续光谱重建与超分辨率范式。具体而言,我们设计了两阶段架构,连接离散波长训练与连续光谱渲染,支持在任意目标波长下合成高保真光谱图像。框架核心是嵌入每个展开阶段的连续光谱场(CoSF)模块,包含三分支跨域特征混合器以实现空间-频率-通道特征的全面融合,以及一个光谱合成头,通过查询连续波长坐标生成光谱强度。大量实验结果表明,Phy-CoSF不仅能实现任意光谱分辨率的连续建模,还在重建保真度和光谱细节保留方面超越多个先进方法。代码与更多结果见:https://github.com/PaiDii/Phy-CoSF.git。

原文摘要 · Abstract (English)

Recent advances have demonstrated that coded aperture snapshot spectral imaging (CASSI) systems show great potential for capturing 3D hyperspectral images (HSIs) from a single 2D measurement. Despite the inherent spectral continuity of scenes captured by CASSI, most existing reconstruction methods are restricted to fixed, discrete spectral outputs, thereby precluding continuous spectral reconstruction or spectral super-resolution. To address this challenge, we propose Phy-CoSF, which synergizes deep unfolding networks with implicit neural representations, establishing a new paradigm for continuous spectral reconstruction and super-resolution in CASSI. Specifically, we propose a two-phase architecture that bridges discrete-wavelength training with continuous spectral rendering, enabling the synthesis of high-fidelity HSIs at arbitrary target wavelengths. At the core of our framework lies the continuous spectral fields (CoSF) module, embedded within each unfolding stage as a dynamic prior, which comprises a triple-branch cross-domain feature mixer for comprehensive spatial-frequency-channel feature fusion, alongside a spectral synthesis head that generates spectral intensities by querying continuous wavelength coordinates. Extensive experimental results demonstrate that Phy-CoSF not only achieves continuous modeling at arbitrary spectral resolutions but also outperforms many state-of-the-art methods in both reconstruction fidelity and spectral detail preservation. Our code and more results are available at: https://github.com/PaiDii/Phy-CoSF.git.

光谱成像连续重建超分辨率隐式表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。