无需训练样本,用神经压缩技术实现高质量图像去噪。
Zero-shot Denoising via Neural Compression: Theoretical and algorithmic framework
- 以未训练的神经压缩网络为基础,直接在单张噪声图上优化局部块。
- 在高斯和泊松噪声下均达到零样本去噪最优性能,适用于自然与非自然图像。
- 理论证明压缩去噪的重建误差上限,为方法提供数学依据,适合医学影像等专业领域。
零样本去噪旨在不依赖训练样本或干净参考图像的情况下对观测数据进行去噪,这一设定在医学成像、生物学等专业领域尤为关键。本文提出零样本神经压缩去噪器(ZS-NCD),基于神经压缩框架构建。ZS-NCD将神经压缩网络视为未训练模型,直接在单张噪声图像提取的图像块上进行优化;最终通过重叠块的输出聚合获得重建结果。得益于压缩架构的固有熵约束,该方法天然避免过拟合,无需手动正则化或早停。大量实验表明,ZS-NCD在高斯和泊松噪声下均达到当前最优的零样本去噪性能,并在自然与非自然图像上具有良好泛化能力。此外,本文还提供了新的有限样本理论结果,刻画了基于最大似然压缩的去噪器可达到的重建误差上界,进一步奠定了压缩去噪的理论基础。代码已开源:https://github.com/Computational-Imaging-RU/ZS-NCDenoiser。
原文摘要 · Abstract (English)
Zero-shot denoising aims to denoise observations without access to training samples or clean reference images. This setting is particularly relevant in practical imaging scenarios involving specialized domains such as medical imaging or biology. In this work, we propose the Zero-Shot Neural Compression Denoiser (ZS-NCD), a novel denoising framework based on neural compression. ZS-NCD treats a neural compression network as an untrained model, optimized directly on patches extracted from a single noisy image. The final reconstruction is then obtained by aggregating the outputs of the trained model over overlapping patches. Thanks to the built-in entropy constraints of compression architectures, our method naturally avoids overfitting and does not require manual regularization or early stopping. Through extensive experiments, we show that ZS-NCD achieves state-of-the-art performance among zero-shot denoisers for both Gaussian and Poisson noise, and generalizes well to both natural and non-natural images. Additionally, we provide new finite-sample theoretical results that characterize upper bounds on the achievable reconstruction error of general maximum-likelihood compression-based denoisers. These results further establish the theoretical foundations of compression-based denoising. Our code is available at: https://github.com/Computational-Imaging-RU/ZS-NCDenoiser.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。