用扩散模型先验知识提升压缩感知图像重建效率,仅需2步即可达成顶尖效果。
Using Powerful Prior Knowledge of Diffusion Model in Deep Unfolding Networks for Image Compressive Sensing
- 将预训练扩散模型嵌入迭代算法,构建带先验的优化流程
- 在2步内完成高质量重建,性能超越现有方法
- 适合关注高效图像恢复与扩散模型应用的研究者
近期,深度展开网络(DUNs)通过将迭代优化算法展开为神经网络,在图像压缩感知(CS)领域取得了优异的重建质量。其性能依赖于学习到的先验知识,引入更强先验可进一步提升表现。预训练扩散模型具备强大先验知识、坚实的理论基础和良好的可扩展性,但通常需要大量迭代步骤才能完成重建。本文提出将预训练扩散模型的强大先验知识融入DUNs,以实现更少步骤下的高质量重建。具体而言,设计了一种名为扩散消息传递(DMP)的迭代优化算法,将预训练扩散模型嵌入每一步迭代中;随后将DMP深度展开为神经网络,命名为DMP-DUN。该方法利用轻量级网络从测量数据映射至逆扩散过程的中间步骤,并直接逼近扩散模型的漂移项,从而显著提升重建效率。大量实验表明,所提DMP-DUN达到当前最优性能,且最少仅需2步即可完成图像重建。代码已公开于 https://github.com/FengodChen/DMP-DUN-CVPR2025。
原文摘要 · Abstract (English)
Recently, Deep Unfolding Networks (DUNs) have achieved impressive reconstruction quality in the field of image Compressive Sensing (CS) by unfolding iterative optimization algorithms into neural networks. The reconstruction quality of DUNs depends on the learned prior knowledge, so introducing stronger prior knowledge can further improve reconstruction quality. On the other hand, pre-trained diffusion models contain powerful prior knowledge and have a solid theoretical foundation and strong scalability, but it requires a large number of iterative steps to achieve reconstruction. In this paper, we propose to use the powerful prior knowledge of pre-trained diffusion model in DUNs to achieve high-quality reconstruction with less steps for image CS. Specifically, we first design an iterative optimization algorithm named Diffusion Message Passing (DMP), which embeds a pre-trained diffusion model into each iteration process of DMP. Then, we deeply unfold the DMP algorithm into a neural network named DMP-DUN. The proposed DMP-DUN can use lightweight neural networks to achieve mapping from measurement data to the intermediate steps of the reverse diffusion process and directly approximate the divergence of the diffusion model, thereby further improving reconstruction efficiency. Extensive experiments show that our proposed DMP-DUN achieves state-of-the-art performance and requires at least only 2 steps to reconstruct the image. Codes are available at https://github.com/FengodChen/DMP-DUN-CVPR2025.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。