用可点阵化的神经原语实现高效高质3D场景建模
Splat the Net: Radiance Fields with Splattable Neural Primitives
- 用浅层神经网络定义可点阵化的体积原语,支持精确解析积分
- 在新视角合成上媲美3D高斯点阵,但只需1/10原语和1/6参数
- 无需复杂控制框架,原语自适应几何,适合实时3D重建应用
辐射场已成为建模三维场景外观的主要表示方法。神经形式如神经辐射场具有高表达能力,但渲染需昂贵的射线追踪;基于基元的方法如3D高斯点阵通过点阵实现实时效率,但表达能力有限。受两者启发,我们提出可点阵化的神经原语,一种融合神经模型表达力与基元点阵效率的新体素表示。每个原语编码一个有界神经密度场,由浅层神经网络参数化。该公式支持线积分的精确解析解,实现透视准确的点阵核高效计算。因此,我们的表示可在不进行昂贵射线追踪的情况下沿视图射线集成。原语灵活适应场景几何,且比以往解析基元更大,显著减少每场景所需原语数量。在新视角合成基准测试中,本方法在质量和速度上均达到3D高斯点阵水平,同时仅使用其十分之一的原语和六分之一的参数。这些优势源于表示本身,无需依赖复杂的控制或自适应框架。
原文摘要 · Abstract (English)
Radiance fields have emerged as a predominant representation for modeling 3D scene appearance. Neural formulations such as Neural Radiance Fields provide high expressivity but require costly ray marching for rendering, whereas primitive-based methods such as 3D Gaussian Splatting offer real-time efficiency through splatting, yet at the expense of representational power. Inspired by advances in both these directions, we introduce splattable neural primitives, a new volumetric representation that reconciles the expressivity of neural models with the efficiency of primitive-based splatting. Each primitive encodes a bounded neural density field parameterized by a shallow neural network. Our formulation admits an exact analytical solution for line integrals, enabling efficient computation of perspectively accurate splatting kernels. As a result, our representation supports integration along view rays without the need for costly ray marching. The primitives flexibly adapt to scene geometry and, being larger than prior analytic primitives, reduce the number required per scene. On novel-view synthesis benchmarks, our approach matches the quality and speed of 3D Gaussian Splatting while using $10\times$ fewer primitives and $6\times$ fewer parameters. These advantages arise directly from the representation itself, without reliance on complex control or adaptation frameworks. The project page is https://vcai.mpi-inf.mpg.de/projects/SplatNet/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。