用特征空间采样替代几何密集采样,大幅降低3D等变网络计算开销。
Discretizing Group-Convolutional Neural Networks for 3D Geometry in Feature Space

- 在特征空间中按相似性选择代表性采样点,取代传统几何密集采样
- 粗粒度特征采样仍保持分类准确率,训练加速显著
- 适合需要高效3D等变模型的计算机视觉应用
群卷积神经网络(GCNN)通过在每个线性层中稠密采样变换群 $G$,在不同姿态间关联数据与滤波器,以引入对称性归纳偏置并保持等变性。然而,这种采样方式在处理多数据项时代价高昂,尤其在3D中涉及平移、旋转等自由度增加时,计算成本呈指数级增长,严重制约实际应用。本文提出在特征空间中采样,即用基于特征相似性的代表性样本替代几何密集采样。该方法将几何分辨率与内存及计算成本解耦,提供了一种新的计算效率与精度权衡机制。主要实证发现:即使采用粗粒度的特征空间采样,分类准确率仍能保持良好,支持基于几何相似性的预计算,从而显著加速等变3D分类器的训练。
原文摘要 · Abstract (English)
Group-convolutional neural networks (GCNNs) are among the most important methods for introducing symmetry as an inductive bias in deep learning: In each linear layer, GCNNs sample a transformation group $G$ densely and correlate data and filters in different poses (with suitable anti-aliasing for steerable GCNNs) to maintain equivariance with respect to $G$. Unfortunately, applying filters to many data items resulting from this sampling is expensive (even for translations alone, i.e., in ordinary CNNs), and costs grow exponentially with increasing degrees of freedom (such as translations and rotations in 3D), which often hinders practical applications. In this paper, we propose sampling in feature space, i.e., replacing geometrically dense samples with representative samples selected by feature similarity. This decouples geometric resolution from memory and processing costs during training and inference, providing a novel way to trade off computational effort and accuracy. Our main empirical finding is that a coarse feature-space sampling already preserves classification accuracy remarkably well, which permits precomputation based on geometric similarity, accelerating the training of equivariant 3D classifiers substantially.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。