提出轻量级网络PCNet,实现高效图像压缩感知重建。
Practical Compact Deep Compressed Sensing
- 设计协同采样算子,结合自适应滤波与快速采样步骤。
- 在任意采样率下均实现高分辨率图像的精准重建。
- 支持硬件部署,适合单像素成像系统应用。
近年来,深度网络在压缩感知(CS)中取得显著成功,大幅降低采样成本并受到广泛关注。本文提出一种新型实用且轻量的网络PCNet,适用于通用图像压缩感知。PCNet设计了一种新型协同采样算子,包含深度条件滤波和双分支快速采样两步:前者通过少量卷积学习线性变换矩阵的隐式表示,并对输入图像进行自适应局部滤波;后者则利用离散余弦变换和随机块对角高斯矩阵生成欠采样测量值。重建采用增强型未展开的近端梯度下降网络,具备训练后对任意采样率灵活、可解释且强恢复性能的特点。此外,我们提出面向部署的提取方案,可将任意线性采样算子转换为矩阵形式,便于加载至数字微镜设备等硬件。在自然图像、量化压缩感知及自监督压缩感知任务上的大量实验表明,相比现有最优方法,PCNet在重建精度和泛化能力上表现更优,尤其在高分辨率图像上优势明显。代码已公开于https://github.com/Guaishou74851/PCNet。
原文摘要 · Abstract (English)
Recent years have witnessed the success of deep networks in compressed sensing (CS), which allows for a significant reduction in sampling cost and has gained growing attention since its inception. In this paper, we propose a new practical and compact network dubbed PCNet for general image CS. Specifically, in PCNet, a novel collaborative sampling operator is designed, which consists of a deep conditional filtering step and a dual-branch fast sampling step. The former learns an implicit representation of a linear transformation matrix into a few convolutions and first performs adaptive local filtering on the input image, while the latter then uses a discrete cosine transform and a scrambled block-diagonal Gaussian matrix to generate under-sampled measurements. Our PCNet is equipped with an enhanced proximal gradient descent algorithm-unrolled network for reconstruction. It offers flexibility, interpretability, and strong recovery performance for arbitrary sampling rates once trained. Additionally, we provide a deployment-oriented extraction scheme for single-pixel CS imaging systems, which allows for the convenient conversion of any linear sampling operator to its matrix form to be loaded onto hardware like digital micro-mirror devices. Extensive experiments on natural image CS, quantized CS, and self-supervised CS demonstrate the superior reconstruction accuracy and generalization ability of PCNet compared to existing state-of-the-art methods, particularly for high-resolution images. Code is available at https://github.com/Guaishou74851/PCNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。