arXiv:2505.21736cs.CVcs.LG2025-05

提出简单可扩展的旋转反射等变卷积核,3D模型训练更稳定。

Moment kernels: a simple and scalable approach for equivariance to rotations and reflections in deep convolutional networks

  • 用坐标和径向函数构造等变卷积核,无需复杂基底
  • 3D脑影像任务中提升方向一致性,避免48通道膨胀
  • 兼容标准CNN流程,适合医学图像等需要对称性的场景

平移等变性是卷积神经网络在计算机视觉中成功的关键。旋转和反射等对称性在生物医学图像分析等领域同样重要,但相关等变方法在3D场景中仍较少应用。现有方法常依赖群卷积、调和基或不可约表示,难以直观理解。本文提出矩核(moment kernels),一种针对张量场间正交变换 $O(d)$ 的简单笛卡尔参数化卷积核。我们证明:所有 $O(d)$-等变核均可表示为 $|x|$ 的径向函数与坐标分量 $x^i$ 及克罗内克δ乘积之和。该形式构成一个完整、维度无关的核族,与调和基方法互补,且可用标准卷积模块实现。我们实现了离散版矩核网络,在不同变换律的任务上评估:不变的2D图像分类与等变的3D仿射变换回归(脑MRI)。结果表明,矩核在最差方向一致性上表现更优,3D下仍可训练,且避免了群卷积所需的48个方向通道(90度旋转+反射在3D中)。模型在网格保持的旋转/反射下提供精确一致性,同时保持标准CNN工作流的实用性。

原文摘要 · Abstract (English)

Translation equivariance is a central reason convolutional neural networks have been successful in computer vision. Other symmetries, such as rotations and reflections, are similarly important in fields such as biomedical image analysis, but equivariant methods for these symmetries remain less widely adopted, especially in 3D. Existing approaches often rely on group convolutions, harmonic bases, irreducible representations, or specialized libraries, which can obscure the explicit form of admissible kernels for practitioners. We introduce moment kernels, a simple Cartesian parameterization of convolution kernels equivariant to orthogonal transformations, $O(d)$, between tensor-valued feature fields. We prove that every such $O(d)$-equivariant kernel can be represented as a sum of radial functions of $|x|$ multiplied by products of coordinate components $x^i$ and Kronecker deltas. This gives a complete, dimension-agnostic kernel family complementary to harmonic-basis approaches and implementable using standard convolution modules. We implement a discrete version of moment-kernel networks and evaluate on biomedical tasks with different transformation laws: invariant 2D image classification and equivariant 3D affine-transform regression for brain MRI. Across these tasks, moment kernels improve worst-case orientation consistency and remain trainable in 3D, while avoiding the orientation-channel expansion required by group convolutions, which reaches 48 orientations for 90-degree rotations and reflections in 3D. The resulting models provide exact consistency under grid-preserving rotations and reflections, and remain practical for standard CNN workflows.

等变网络3D图像卷积核

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。