将旋转等变性引入自监督去噪,提升模型泛化能力。
Rotation-Equivariant Self-Supervised Method in Image Denoising
- 用旋转等变卷积替代传统卷积,增强图像先验建模。
- 在三个基准方法上实现性能提升,最高改善1.23dB PSNR。
- 适合对旋转鲁棒性要求高的图像去噪场景。
近年来,自监督图像去噪方法受到广泛关注,因其减少了对大规模训练数据集的依赖。与监督方法相比,自监督方法更依赖深度网络自身所蕴含的先验知识。因此,大多数自监督方法采用卷积神经网络(CNN)架构,以捕捉重要的平移等变先验。受平移等变性成功应用的启发,本文探索如何进一步引入另一重要图像先验——旋转等变性。我们首先将高精度的旋转等变卷积应用于自监督图像去噪,并通过严格的理论分析证明,仅用旋转等变卷积层替换所有卷积层即可使网络具备旋转等变性。据我们所知,这是首次在自监督图像去噪中从网络架构层面系统引入旋转等变先验,并进行等变误差的全面理论分析,为该领域提供了新视角。此外,为进一步提升性能,我们设计了一种新的掩码机制,融合旋转等变网络与普通CNN网络的输出,构建自适应旋转等变框架。在三种典型方法上的大量实验验证了所提方法的有效性。
原文摘要 · Abstract (English)
Self-supervised image denoising methods have garnered significant research attention in recent years, for this kind of method reduces the requirement of large training datasets. Compared to supervised methods, self-supervised methods rely more on the prior embedded in deep networks themselves. As a result, most of the self-supervised methods are designed with Convolution Neural Networks (CNNs) architectures, which well capture one of the most important image prior, translation equivariant prior. Inspired by the great success achieved by the introduction of translational equivariance, in this paper, we explore the way to further incorporate another important image prior. Specifically, we first apply high-accuracy rotation equivariant convolution to self-supervised image denoising. Through rigorous theoretical analysis, we have proved that simply replacing all the convolution layers with rotation equivariant convolution layers would modify the network into its rotation equivariant version. To the best of our knowledge, this is the first time that rotation equivariant image prior is introduced to self-supervised image denoising at the network architecture level with a comprehensive theoretical analysis of equivariance errors, which offers a new perspective to the field of self-supervised image denoising. Moreover, to further improve the performance, we design a new mask mechanism to fusion the output of rotation equivariant network and vanilla CNN-based network, and construct an adaptive rotation equivariant framework. Through extensive experiments on three typical methods, we have demonstrated the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。