用梯度引导融合提升双相机光谱成像重建质量
TV Subgradient-Guided Multi-Source Fusion for Spectral Imaging in Dual-Camera CASSI Systems
- 基于张量模型构建物理可解释的观测框架
- 生成空间参考图作为先验,提升重建精度
- 结合梯度引导正则项,抗噪且无需配对数据
光谱成像中平衡光谱、空间和时间分辨率是关键挑战。双相机编码孔径快照光谱成像(DC-CASSI)系统缓解了这一权衡问题,但因压缩比高导致严重不适定重建难题。现有方法受限于场景特异性调参或过度依赖成对训练数据。为此,提出一种总变差(TV)子梯度引导的多源融合框架,包含三部分:(1)基于张量形式克罗内克δ的端到端单分散器CASSI(SD-CASSI)观测模型,建立严格的物理约束并实现高效伴随算子;(2)自适应空间参考生成器,融合SD-CASSI物理模型与RGB子空间约束,生成可靠的空间先验;(3)基于参考图像局部结构方向的TV子梯度正则项,实现高质量融合重建。在模拟与真实数据集上验证,结果表明该方法达到当前最优重建性能,并具备强噪声鲁棒性。本工作不仅建立了可解释的子梯度引导融合理论基础,还为DC-CASSI系统提供了高保真重建的实用融合范式。源码:https://github.com/bestwishes43/ADMM-TVDS。
原文摘要 · Abstract (English)
Balancing spectral, spatial, and temporal resolutions is a key challenge in spectral imaging. The Dual-Camera Coded Aperture Snapshot Spectral Imaging (DC-CASSI) system alleviates this trade-off but suffers from severely ill-posed reconstruction problems due to its high compression ratio. Existing methods are constrained by scene-specific tuning or excessive reliance on paired training data. To address these issues, we propose a Total Variation (TV) subgradient-guided multi-source fusion framework for DC-CASSI reconstruction, comprising three core components: (1) An end-to-end Single-Disperser CASSI (SD-CASSI) observation model based on the tensor-form Kronecker $δ$, which establishes a rigorous mathematical foundation for physical constraints while enabling efficient adjoint operator implementation; (2) An adaptive spatial reference generator that integrates SD-CASSI's physical model and RGB subspace constraint, generating the reference image as reliable spatial prior; (3) A TV subgradient-guided regularization term that encodes local structural directions from the reference image into spectral reconstruction, achieving high-quality fused results. The framework is validated on simulated datasets and real-world datasets. Experimental results demonstrate that it achieves state-of-the-art reconstruction performance and robust noise resilience. This work not only establishes an interpretable theoretical foundation for subgradient-guided fusion but also provides a practical fusion-based paradigm for high-fidelity spectral image reconstruction in DC-CASSI systems. Source code: https://github.com/bestwishes43/ADMM-TVDS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。