提出自适应旋转等变正则化,提升图像恢复精度与泛化能力。
A Regularization-Guided Equivariant Approach for Image Restoration
- 通过自监督学习动态调整网络等变性,不强制严格对称约束。
- 在三个低级视觉任务中均超越当前最优方法,提升显著。
- 适合需要高精度对称建模的图像修复场景,如去噪、超分。
等变与不变深度学习模型利用数据内在对称性,在特定场景中表现优异。然而,这些方法常受限于表示精度不足,且依赖严格的对称性假设,实际应用中难以满足。针对图像恢复任务对高精度和精确对称建模的需求,本文提出一种旋转等变正则化策略,可自适应地在数据上施加合适的对称性约束,同时保持网络表示能力。具体地,设计了EQ-Reg正则器,融合数据增强与等变方法的思想,通过特征图的空间旋转与循环通道移位实现自监督学习。该方法使非严格等变网络适用于图像恢复,提供基于任务的灵活等变调节机制。在三个低级视觉任务上的大量实验表明,本方法在准确性和泛化能力上均优于现有先进方法。
原文摘要 · Abstract (English)
Equivariant and invariant deep learning models have been developed to exploit intrinsic symmetries in data, demonstrating significant effectiveness in certain scenarios. However, these methods often suffer from limited representation accuracy and rely on strict symmetry assumptions that may not hold in practice. These limitations pose a significant drawback for image restoration tasks, which demands high accuracy and precise symmetry representation. To address these challenges, we propose a rotation-equivariant regularization strategy that adaptively enforces the appropriate symmetry constraints on the data while preserving the network's representational accuracy. Specifically, we introduce EQ-Reg, a regularizer designed to enhance rotation equivariance, which innovatively extends the insights of data-augmentation-based and equivariant-based methodologies. This is achieved through self-supervised learning and the spatial rotation and cyclic channel shift of feature maps deduce in the equivariant framework. Our approach firstly enables a non-strictly equivariant network suitable for image restoration, providing a simple and adaptive mechanism for adjusting equivariance based on task. Extensive experiments across three low-level tasks demonstrate the superior accuracy and generalization capability of our method, outperforming state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。