提出GMR-Conv卷积核,实现高效旋转反射等变性。
GMR-Conv: An Efficient Rotation and Reflection Equivariant Convolution Kernel Using Gaussian Mixture Rings
- 用高斯环混合建模径向对称性,减少圆核离散误差。
- 在8个分类和1个分割数据集上性能持平或超越传统CNN。
- 适合处理无方向性数据的图像识别任务,兼顾效率与鲁棒性。
对称性在设计卷积神经网络时可作为强大先验。传统CNN天然支持平移等变性,但扩展至旋转和反射等变性仍具挑战,常需在等变性、效率和信息损失间权衡。本文提出高斯环混合卷积(GMR-Conv),通过高斯加权环的混合来平滑径向对称性,有效缓解圆形核的离散化误差,从而在不增加计算开销的情况下保持强旋转与反射等变性。通过新颖的参数化与计算策略,进一步优化了空间与速度效率,支持大尺寸卷积核且成本可控。在8个分类和1个分割数据集上的大量实验表明,GMR-Conv不仅性能媲美传统CNN,还在无方向性数据应用中表现更优。相比当前最先进的等变学习方法,GMR-Conv更具鲁棒性和效率。本工作为利用径向对称性缓解信息损失提供了有力实证,标志着等变网络架构的重要进展。代码已开源:https://github.com/XYPB/GMR-Conv。
原文摘要 · Abstract (English)
Symmetry, where certain features remain invariant under geometric transformations, can often serve as a powerful prior in designing convolutional neural networks (CNNs). While conventional CNNs inherently support translational equivariance, extending this property to rotation and reflection has proven challenging, often forcing a compromise between equivariance, efficiency, and information loss. In this work, we introduce Gaussian Mixture Ring Convolution (GMR-Conv), an efficient convolution kernel that smooths radial symmetry using a mixture of Gaussian-weighted rings. This design mitigates discretization errors of circular kernels, thereby preserving robust rotation and reflection equivariance without incurring computational overhead. We further optimize both the space and speed efficiency of GMR-Conv via a novel parameterization and computation strategy, allowing larger kernels at an acceptable cost. Extensive experiments on eight classification and one segmentation datasets demonstrate that GMR-Conv not only matches conventional CNNs' performance but can also surpass it in applications with orientation-less data. GMR-Conv is also proven to be more robust and efficient than the state-of-the-art equivariant learning methods. Our work provides inspiring empirical evidence that carefully applied radial symmetry can alleviate the challenges of information loss, marking a promising advance in equivariant network architectures. The code is available at https://github.com/XYPB/GMR-Conv.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。