分离光照与反射信息,提升快照式光谱成像重建质量。
Spectral Compressive Imaging via Chromaticity-Intensity Decomposition
- 将光谱图像分解为亮度图与色彩立方体,解耦光照影响。
- 在真实和合成数据上均实现更优的光谱与色彩保真度。
- 适合做高精度光谱成像的科研人员和工程师使用。
在编码孔径快照光谱成像(CASSI)中,捕获的测量值混杂了空间与光谱信息,导致高光谱图像(HSI)重建面临严重不适定的逆问题。此外,捕获的辐射强度受场景光照影响,难以恢复不受光照变化影响的固有光谱反射率。为此,我们提出一种色度-亮度分解框架,将HSI解耦为空间平滑的亮度图与光谱变化的色度立方体。色度编码了光照不变的反射率,同时保留高频空间细节和局部光谱稀疏性。基于此分解,我们构建了CIDNet——一种双相机CASSI系统中的色度-亮度分解展开网络。CIDNet融合了面向细粒度稀疏光谱色度的混合空间-光谱Transformer,以及能捕捉迭代过程中各向异性噪声的降质感知、空间自适应噪声估计模块。在合成与真实世界CASSI数据集上的大量实验表明,该方法在光谱与色度保真度方面均取得优越性能。代码与模型将公开发布。
原文摘要 · Abstract (English)
In coded aperture snapshot spectral imaging (CASSI), the captured measurement entangles spatial and spectral information, posing a severely ill-posed inverse problem for hyperspectral images (HSIs) reconstruction. Moreover, the captured radiance inherently depends on scene illumination, making it difficult to recover the intrinsic spectral reflectance that remains invariant to lighting conditions. To address these challenges, we propose a chromaticity-intensity decomposition framework, which disentangles an HSI into a spatially smooth intensity map and a spectrally variant chromaticity cube. The chromaticity encodes lighting-invariant reflectance, enriched with high-frequency spatial details and local spectral sparsity. Building on this decomposition, we develop CIDNet, a Chromaticity-Intensity Decomposition unfolding network within a dual-camera CASSI system. CIDNet integrates a hybrid spatial-spectral Transformer tailored to reconstruct fine-grained and sparse spectral chromaticity and a degradation-aware, spatially-adaptive noise estimation module that captures anisotropic noise across iterative stages. Extensive experiments on both synthetic and real-world CASSI datasets demonstrate that our method achieves superior performance in both spectral and chromaticity fidelity. Code and models will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。