arXiv:2511.04797cs.CV2025-11

用3D高斯点编码替代PointNet,更高效且适合部署在低资源设备。

3D Gaussian Point Encoders

  • 基于可学习的3D高斯混合构建显式点嵌入,取代传统隐式表示。
  • 相比同精度PointNet,速度提升2.7倍,内存减少46%,计算量降88%。
  • 适用于移动端或无GPU设备,可作为Mamba3D等模型的轻量组件。

本文提出3D高斯点编码器(3D Gaussian Point Encoder),一种基于可学习3D高斯混合的显式点嵌入方法,用于3D识别任务。该方法突破了传统隐式表示如PointNet的范式。然而,使用标准优化器端到端训练3D高斯编码器存在困难。为此,我们引入基于自然梯度的优化和来自PointNet的蒸馏技术,以学习能重建PointNet激活的高斯基。所得编码器在保持性能的前提下,比传统PointNet更快且参数更少。借鉴3D重建中从隐式(如NeRF)转向显式(如Gaussian Splatting)的趋势,我们进一步应用计算几何启发的过滤技术,使编码器在保持相当精度下运行速度提升2.7倍,内存占用降低46%,浮点运算量减少88%。此外,将其集成至Mamba3D中,实现1.27倍加速,内存与浮点运算分别减少42%和54%。该编码器轻量级,可在仅含CPU的设备上实现高帧率运行。

原文摘要 · Abstract (English)

In this work, we introduce the 3D Gaussian Point Encoder, an explicit per-point embedding built on mixtures of learned 3D Gaussians. This explicit geometric representation for 3D recognition tasks is a departure from widely used implicit representations such as PointNet. However, it is difficult to learn 3D Gaussian encoders in end-to-end fashion with standard optimizers. We develop optimization techniques based on natural gradients and distillation from PointNets to find a Gaussian Basis that can reconstruct PointNet activations. The resulting 3D Gaussian Point Encoders are faster and more parameter efficient than traditional PointNets. As in the 3D reconstruction literature where there has been considerable interest in the move from implicit (e.g., NeRF) to explicit (e.g., Gaussian Splatting) representations, we can take advantage of computational geometry heuristics to accelerate 3D Gaussian Point Encoders further. We extend filtering techniques from 3D Gaussian Splatting to construct encoders that run 2.7 times faster as a comparable accuracy PointNet while using 46% less memory and 88% fewer FLOPs. Furthermore, we demonstrate the effectiveness of 3D Gaussian Point Encoders as a component in Mamba3D, running 1.27 times faster and achieving a reduction in memory and FLOPs by 42% and 54% respectively. 3D Gaussian Point Encoders are lightweight enough to achieve high framerates on CPU-only devices.

3D点云高斯编码轻量化高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。