通过双路径结构和动态注意力机制,提升图像压缩感知的重建精度。
Dual-Path Hyperprior Informed Deep Unfolding Network for Image Compressive Sensing

- 分两路处理测量数据,利用超先验知识指导重建过程。
- 动态生成空间变化的步长图与注意力图,自适应优化关键区域。
- 适合需要高精度重建的医学影像、遥感图像等场景。
近期深度展开网络(DUNs)通过融合迭代优化与深度网络,在压缩感知(CS)领域取得显著进展。然而,现有DUNs仍面临两大挑战:一是依赖单一测量流,限制了不同测量子集间的信息交互;二是对所有图像区域采用统一处理,忽视了由复杂纹理引起的重建难度差异。为此,提出一种新型双路径超先验引导深度展开网络(DPH-DUN),将测量数据划分为双子集,通过双路径架构实现超先验引导的重建。在深度超先验学习分支中,设计一系列轻量级神经模块,高效生成不同域的超先验知识,为压缩感知重建提供协同指导。在超先验引导重建分支中,构建具有超先验引导的深度展开框架,用于迭代精炼重建结果。具体地,梯度下降步骤中引入超先验引导步长生成网络,动态生成空间变化的步长图,实现自适应细粒度梯度更新;在近端映射步骤中,引入两种设计良好的超先验引导注意力机制,通过基于梯度的硬/软注意力动态聚焦困难区域,提升重建精度。大量实验表明,所提DPH-DUN优于现有压缩感知方法。
原文摘要 · Abstract (English)
Recent Deep Unfolding Networks (DUNs) have significantly advanced Compressive Sensing (CS) by integrating iterative optimization with deep networks. However, existing DUNs still suffer from two challenges: 1) Reliance on a single measurement stream, which limits effective information interaction across distinct measurement subsets. 2) Uniform processing of all image regions, which overlooks varying reconstruction difficulties induced by diverse textures. To address these limitations, a novel Dual-Path Hyperprior Informed Deep Unfolding Network (DPH-DUN) is proposed, which partitions measurements into double subsets to enable hyperprior-guided reconstruction via a dual-path architecture. In the Deep Hyperprior Learning branch, a series of lightweight neural modules are designed to efficiently generate hyperprior knowledge of different domains, enabling collaborative guidance for the CS reconstruction. In the Hyperprior Informed Reconstruction branch, a deep unfolding framework with hyperprior guidance is constructed to iteratively refine reconstruction. Specifically, i) in the gradient descent step, a Hyperprior Informed Step Size Generation network is designed to dynamically generate spatially varying step maps, enabling adaptive fine-grained gradient updates. ii) In the proximal mapping step, two well-designed hyperprior informed attention mechanisms are introduced to dynamically focus on challenging regions via gradient-based hard and soft attentions, facilitating CS reconstruction accuracy. Extensive experiments demonstrate that the proposed DPH-DUN outperforms existing CS methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。