arXiv:2409.07417eess.IVcs.CV2024-09AAAI被引 1

用单步扩散模型高效重建高保真多光谱图像。

Self-Supervised One-Step Diffusion Refinement for Snapshot Compressive Imaging

  • 单步扩散修正初始重建,跳过迭代去噪过程。
  • 在三个数据集上分别提升3.44、1.61、0.28 dB,速度提升97.5%。
  • 无需真实标签即可训练,适合真实场景快速部署。

快照压缩成像(SCI)通过单一编码二维测量捕捉多光谱图像(MSI),但从压缩输入中重建高质量MSI仍是根本性难题。尽管基于扩散模型的方法提升了重建质量,却面临缺乏大规模MSI训练数据、由RGB预训练模型引发的域偏移以及多步采样导致的推理效率低下等关键限制。为此,我们提出一种全新的自监督单步扩散(OSD)框架,专为SCI设计。核心创新在于使用单步扩散修复器校正初始重建结果,彻底消除迭代去噪,同时保持生成质量。我们采用自监督等变学习策略,直接从原始2-D测量中训练预测器与修复器,实现对未见域的泛化,无需真实MSI标签。为缓解MSI数据稀缺问题,设计了波段选择驱动的蒸馏策略,将大规模RGB数据集中的核心生成先验迁移到MSI任务中,有效弥合域差距。大量实验表明,本方法在Harvard、NTIRE、ICVL数据集上分别取得3.44、1.61、0.28 dB的PSNR提升,重建时间减少97.5%,显著提升精度与实用性,推动了SCI重建向真实应用迈进。

原文摘要 · Abstract (English)

Snapshot compressive imaging (SCI) captures multispectral images (MSIs) using a single coded two-dimensional (2-D) measurement, but reconstructing high-fidelity MSIs from these compressed inputs remains a fundamentally ill-posed challenge. While diffusion-based reconstruction methods have recently raised the bar for quality, they face critical limitations: a lack of large-scale MSI training data, adverse domain shifts from RGB-pretrained models, and inference inefficiencies due to multi-step sampling. These drawbacks restrict their practicality in real-world applications. In contrast to existing methods, which either follow costly iterative refinement or adapt subspace-based embeddings for diffusion models (e.g. DiffSCI, PSR-SCI), we introduce a fundamentally different paradigm: a self-supervised One-Step Diffusion (OSD) framework specifically designed for SCI. The key novelty lies in using a single-step diffusion refiner to correct an initial reconstruction, eliminating iterative denoising entirely while preserving generative quality. Moreover, we adopt a self-supervised equivariant learning strategy to train both the predictor and refiner directly from raw 2-D measurements, enabling generalization to unseen domains without the need for ground-truth MSI. To further address the challenge of limited MSI data, we design a band-selection-driven distillation strategy that transfers core generative priors from large-scale RGB datasets, effectively bridging the domain gap. Extensive experiments confirm that our approach sets a new benchmark, yielding PSNR gains of 3.44 dB, 1.61 dB, and 0.28 dB on the Harvard, NTIRE, and ICVL datasets, respectively, while reducing reconstruction time by 97.5%. This remarkable improvement in efficiency and adaptability makes our method a significant advancement in SCI reconstruction, combining both accuracy and practicality for real-world deployment.

压缩成像扩散模型单步修复自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。