提出量化数据对称性的理论框架,实现图像修复模型与数据对称性自适应对齐。
Aligning Network Equivariance with Data Symmetry: A Theoretical Framework and Adaptive Approach for Image Restoration

- 从优化角度定义数据集级非严格对称性,作为修复问题的约束条件
- 证明最优修复算子的等变误差受数据对称性误差和离散化精度限制
- 设计可学习对称性的自适应网络,在超分辨率等任务中显著优于基线
图像修复是典型的病态逆问题。嵌入几何对称性先验的等变网络可缓解这一问题并提升性能,但当前对网络等变性与数据对称性关系的理解仍以经验为主。尤其对于具有不完美对称性的真实数据,缺乏系统理论框架来量化对称性、选择变换群或评估模型与数据的对齐程度。为此,本文从优化视角分析,形式化了数据对称先验、模型等变性与泛化能力之间的内在关系。首次提出在数据集层面而非样本层面的非严格对称性可量化定义,并将其作为约束引入修复逆问题。证明了在该约束下,修复模型的等变性可自然导出,且最优修复算子的等变误差严格受数据对称性误差和离散化网格大小控制。通过分析网络的经验风险,进一步表明对齐等变性与数据对称性能优化偏差-方差权衡,最小化总期望风险。基于此,提出样本自适应等变网络(SA-Conv),采用超网络与可学习等变卷积动态匹配每样本的固有对称性。在超分辨率、去噪和去雨任务上的大量实验验证了理论发现,并显著优于标准基线和传统等变模型。代码与补充材料见 https://github.com/tanfy929/SA-Conv。
原文摘要 · Abstract (English)
Image restoration is an inherently ill posed inverse problem. Equivariant networks that embed geometric symmetry priors can mitigate this ill posedness and improve performance. However, current understanding of the relationship between network equivariance and data symmetry remains largely heuristic. Particularly for real world data with imperfect symmetry, existing research lacks a systematic theoretical framework to quantify symmetry, select transformation groups, or evaluate model data alignment. To bridge this gap, we conduct an analysis from an optimization perspective and formalize the intrinsic relationship among data symmetry priors, model equivariance, and generalization capability. Specifically, we propose for the first time a quantifiable definition of non strict symmetry at the dataset level (rather than sample level) and use it as a constraint to formulate the restoration inverse problem. We then show that the equivariance for restoration models can be naturally derived from this inverse problems incorporated the proposed symmetry constraints, and that the equivariance error of the optimal restoration operator is strictly bounded by the data symmetry error and the discretization mesh size. Furthermore, by analyzing the network's empirical risk, we demonstrate that aligning equivariance with data symmetry optimizes the bias variance trade off, minimizing the total expected risk. Guided by these insights, we propose a Sample Adaptive Equivariant Network that uses a hypernetwork and transformation learnable equivariant convolutions to dynamically align with each sample's inherent symmetry. Extensive experiments on super resolution, denoising, and deraining validate our theoretical findings and show significant superiority over standard baselines and traditional equivariant models. Our code and supplementary material are available at https://github.com/tanfy929/SA-Conv.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。