arXiv:2605.07270cs.LG2026-05

实现高效可微的群不变特征提取,让机器学习更稳定可靠。

bispectrum: Selective $G$-Bispectra Made Practical

论文配图:bispectrum: Selective $G$-Bispectra Made Practical
图 1 · 摘自论文原文
  • 通过选择性计算,大幅降低群不变特征的计算开销。
  • 在多种对称群下实现亚毫秒级计算,保持高精度不变性。
  • 适合需要对称性建模的低数据量、中等模型场景使用。

许多机器学习任务需对群 $G$ 变换保持不变:信号分类需平移不变,图像分类需二维旋转不变,球面图像分类需三维旋转不变。$G$-bispectrum 是一种理论完备的信号不变量,能保留信号在群作用下的全部信息,在机器学习和深度网络池化层中表现优异。但其应用受限于高计算成本和依赖特定群的零散实现。本文提出 bispectrum,一个开源、全单元测试的 PyTorch 库,支持七种不同群作用下的选择性 $G$-bispectra,作为可微模块直接集成于学习流程与深度架构。对有限群 $G$,选择性将复杂度从 $O(|G|^2)$ 降至 $O(|G|)$;对平面旋转,采用圆盘双谱;对球面 3D 旋转,引入增强型选择性双谱,在带限 $L$ 下将复杂度从 $O(L^3)$ 降至 $Θ(L^2)$。我们对整个库进行性能分析,实现了近精确的 $G$-不变性,且在 GPU 上计算时间低于亚毫秒(常见带限内)。在三个经典基准数据集上评估,将 $G$-bispectra 作为池化层嵌入深度网络,相比范数池化、门控池化、傅里叶-ELU 池化、最大池化及非等变数据增强卷积基线,结果表明 $G$-bispectra 在低数据、中等容量场景下持续表现更优。

原文摘要 · Abstract (English)

Many machine learning tasks are invariant under the action of a group $G$ of transformations: signal classification can be invariant under translations, image classification under 2D rotations, and spherical-image classification under 3D rotations. The $G$-bispectrum is a principled complete invariant of a signal (retaining all all signal's information up to the group action) with proven benefits in machine learning and as a pooling layer in deep networks. However, its deployment has been hampered by high computational cost and a patchwork of group-specific implementations. We present bispectrum, an open-source, fully unit-tested PyTorch library that implements selective $G$-bispectra for seven different group actions, as differentiable modules that can be directly incorporated into machine learning pipelines and deep learning architectures. For finite groups $G$, selectivity reduces the computational cost from $O(|G|^2)$ to $O(|G|)$. For planar rotations, we leverage the disk bispectrum. For spherical 3D rotations, we introduce an augmented selective bispectrum at band-limit $L$ which reduces the cost from $O(L^3)$ to $Θ(L^2)$ coefficients. We profile the entire library (for which we implemented various compute optimizations), showing that it delivers near-exact $G$-invariance with its selective $G$-bispectra computed in sub-millisecond time on GPU (up to commonly used bandlimits). We evaluate the benefits of incorporating $G$-bispectra as pooling layers into deep learning architectures on three classical benchmark datasets --comparing against norm pooling, gated pooling, Fourier-ELU pooling, max pooling, and (non-equivariant) data-augmented convolutional baselines. Results show that $G$-bispectra consistently outperform alternatives in the low-data, moderate-capacity regime.

群不变性特征提取可微计算深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。