arXiv:2503.06762cs.CV2025-03被引 4

用单层高维高斯核实现高效多维信号重建,训练快、参数少、精度高。

GNF: Gaussian Neural Fields for Multidimensional Signal Representation and Reconstruction

  • 以学习的特征网格为输入,用单层高斯核映射生成连续信号。
  • 3D几何建模训练<15秒,视图合成<11分钟,参数量远低于传统MLP。
  • 适合需要快速训练与高吞吐推理的图像、3D场景与辐射场应用。

神经场已成为表示图像、视频、3D/4D物体与场景、辐射场等连续多维信号的强大框架。然而,高质量表示通常依赖宽而深的神经网络,导致训练与推理速度慢。现有加速方法或牺牲内存换取速度,或依赖数千个拟合基元且优化耗时长,或破坏神经场的平滑连续特性。本文提出高斯神经场(GNF),一种新型紧凑型神经解码器,通过高维特征空间中的单一紧凑层高斯核,将学习的特征网格映射为连续非线性信号,如RGB图像、符号距离函数(SDF)和辐射场。关键观察是:传统MLP中神经元仅执行点积加激活函数,需宽深结构或高分辨率特征网格才能建模复杂函数。本工作表明,用中心为学习特征的高斯核替代基于MLP的解码器,仅用一层即可高精度表示2D(RGB)、3D(几何)和5D(辐射场)信号。该方法高度并行,可在低分辨率网格上运行,3D几何建模训练时间低于15秒,视图合成低于11分钟。GNF在参数量远少于深度MLP解码器的前提下,达到相当的精度,并显著提升推理吞吐率。

原文摘要 · Abstract (English)

Neural fields have emerged as a powerful framework for representing continuous multidimensional signals such as images and videos, 3D and 4D objects and scenes, and radiance fields. While efficient, achieving high-quality representation requires the use of wide and deep neural networks. These, however, are slow to train and evaluate. Although several acceleration techniques have been proposed, they either trade memory for faster training and/or inference, rely on thousands of fitted primitives with considerable optimization time, or compromise the smooth, continuous nature of neural fields. In this paper, we introduce Gaussian Neural Fields (GNF), a novel compact neural decoder that maps learned feature grids into continuous non-linear signals, such as RGB images, Signed Distance Functions (SDFs), and radiance fields, using a single compact layer of Gaussian kernels defined in a high-dimensional feature space. Our key observation is that neurons in traditional MLPs perform simple computations, usually a dot product followed by an activation function, necessitating wide and deep MLPs or high-resolution feature grids to model complex functions. In this paper, we show that replacing MLP-based decoders with Gaussian kernels whose centers are learned features yields highly accurate representations of 2D (RGB), 3D (geometry), and 5D (radiance fields) signals with just a single layer of such kernels. This representation is highly parallelizable, operates on low-resolution grids, and trains in under $15$ seconds for 3D geometry and under $11$ minutes for view synthesis. GNF matches the accuracy of deep MLP-based decoders with far fewer parameters and significantly higher inference throughput.

神经场高斯核信号重建高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。