arXiv:2511.18873cs.CVcs.GR2025-11SIGGRAPH被引 3

用神经纹理提升3D高斯点云,让重建更真实、动态更自然。

Neural Texture Splatting: Expressive 3D Gaussian Splatting for View Synthesis, Geometry, and Dynamic Reconstruction

  • 用全局神经场为每个点预测纹理和几何,统一建模视图与时间变化
  • 在多任务测试中超越现有方法,稀疏与密集输入下均稳定提升
  • 适合需要高保真动态场景重建的研究者与应用开发者

3D高斯点云(3DGS)已成为高质量新视角合成的主流方法,已有众多变体将其扩展至多种3D与4D场景重建任务。然而,其表达能力受限于使用3D高斯核建模局部变化。近期工作通过为每个点添加纹理信息来增强表达力,但这类方法主要针对密集新视角合成,且在更通用重建场景中表现下降。本文提出神经纹理点云(NTS),核心是用一个混合三平面与神经解码器的全局神经场,为每个点预测局部外观与几何场。该共享表示有效降低模型规模,促进全局信息交换,实现跨任务强泛化。同时,神经建模使局部纹理具备视图与时间依赖性,解决现有方法关键缺陷。大量实验表明,NTS在多个基准上持续优于现有方法,达成当前最佳性能。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has emerged as a leading approach for high-quality novel view synthesis, with numerous variants extending its applicability to a broad spectrum of 3D and 4D scene reconstruction tasks. Despite its success, the representational capacity of 3DGS remains limited by the use of 3D Gaussian kernels to model local variations. Recent works have proposed to augment 3DGS with additional per-primitive capacity, such as per-splat textures, to enhance its expressiveness. However, these per-splat texture approaches primarily target dense novel view synthesis with a reduced number of Gaussian primitives, and their effectiveness tends to diminish when applied to more general reconstruction scenarios. In this paper, we aim to achieve concrete performance improvement over state-of-the-art 3DGS variants across a wide range of reconstruction tasks, including novel view synthesis, geometry and dynamic reconstruction, under both sparse and dense input settings. To this end, we introduce Neural Texture Splatting (NTS). At the core of our approach is a global neural field (represented as a hybrid of a tri-plane and a neural decoder) that predicts local appearance and geometric fields for each primitive. By leveraging this shared global representation that models local texture fields across primitives, we significantly reduce model size and facilitate efficient global information exchange, demonstrating strong generalization across tasks. Furthermore, our neural modeling of local texture fields introduces expressive view- and time-dependent effects, a critical aspect that existing methods fail to account for. Extensive experiments show that Neural Texture Splatting consistently improves models and achieves state-of-the-art results across multiple benchmarks.

3D重建神经渲染动态场景高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。