通过小波树结构采样与深度展开,提升图像压缩感知重建质量
WTDUN: Wavelet Tree-Structured Sampling and Deep Unfolding Network for Image Compressed Sensing
- 在小波域构建树状结构,捕捉多尺度特征依赖关系
- 按子带重要性自适应分配测量值,提升关键信息保留率
- 适合对细节重建要求高的医学影像、遥感图像等应用
深度展开网络因理论可解释性和优异的重建性能,在压缩感知领域受到越来越多关注。然而,现有方法普遍存在两个问题:1)直接从单通道图像学习,特征表达简单,未能充分捕捉复杂特征;2)对图像各组件一视同仁,忽略其差异特性。为此,本文提出一种新型小波域深度展开框架WTDUN,直接在多尺度小波子带间操作。利用小波系数的固有稀疏性和多尺度结构,实现树状采样与重建,有效捕获并突出图像中最重要的特征。具体而言,树状重建设计旨在捕捉多尺度子带间的相互依赖关系,能够同时识别精细和粗略特征,显著提升重建质量。此外,提出一种小波域自适应采样方法,通过根据子带重要性分配测量值,大幅提升采样效率。不同于纯深度学习方法对所有成分的均匀处理,本方法对重要子带进行针对性聚焦,结合能量与稀疏性评估,更高效地保留关键信息,舍弃次要信息,从而实现更有效、更精细的重建。在多个数据集上的大量实验验证了所提方法的优越性能。
原文摘要 · Abstract (English)
Deep unfolding networks have gained increasing attention in the field of compressed sensing (CS) owing to their theoretical interpretability and superior reconstruction performance. However, most existing deep unfolding methods often face the following issues: 1) they learn directly from single-channel images, leading to a simple feature representation that does not fully capture complex features; and 2) they treat various image components uniformly, ignoring the characteristics of different components. To address these issues, we propose a novel wavelet-domain deep unfolding framework named WTDUN, which operates directly on the multi-scale wavelet subbands. Our method utilizes the intrinsic sparsity and multi-scale structure of wavelet coefficients to achieve a tree-structured sampling and reconstruction, effectively capturing and highlighting the most important features within images. Specifically, the design of tree-structured reconstruction aims to capture the inter-dependencies among the multi-scale subbands, enabling the identification of both fine and coarse features, which can lead to a marked improvement in reconstruction quality. Furthermore, a wavelet domain adaptive sampling method is proposed to greatly improve the sampling capability, which is realized by assigning measurements to each wavelet subband based on its importance. Unlike pure deep learning methods that treat all components uniformly, our method introduces a targeted focus on important subbands, considering their energy and sparsity. This targeted strategy lets us capture key information more efficiently while discarding less important information, resulting in a more effective and detailed reconstruction. Extensive experimental results on various datasets validate the superior performance of our proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。