arXiv:2509.17083cs.CV2025-09NeurIPS被引 4

用显式高斯与神经场结合,大幅降低内存占用同时保持高质量新视角生成。

HyRF: Hybrid Radiance Fields for Memory-efficient and High-quality Novel View Synthesis

  • 将场景拆分为少量关键高斯点和网格神经场,分别存储高频参数与预测其余属性。
  • 相比3DGS模型尺寸缩小20倍以上,仍实现实时渲染与顶尖画质。
  • 适合需要高效部署的3D视觉应用,如AR/VR、机器人导航等场景。

最近,3D高斯泼溅(3DGS)成为替代基于NeRF方法的强大方案,通过可优化的显式3D高斯实现实时、高质量的新视角合成。然而,3DGS因依赖每个高斯的参数来建模视图相关效应和各向异性形状,导致显著的内存开销。尽管近期工作尝试用神经场压缩3DGS,但难以捕捉高斯属性中的高频空间变化,导致细节重建质量下降。我们提出混合辐射场(HyRF),一种融合显式高斯与神经场优势的新型场景表示。HyRF将场景分解为:(1) 一组紧凑的显式高斯,仅存储关键高频参数;(2) 基于网格的神经场,用于预测剩余属性。为增强表达能力,我们引入解耦神经场架构,分别建模几何(尺度、不透明度、旋转)与视图相关颜色。此外,提出一种混合渲染方案,将高斯泼溅与神经场预测的背景进行复合,解决远距离场景表示的局限性。实验表明,HyRF在实现最先进渲染质量的同时,相比3DGS模型规模缩小超过20倍,并保持实时性能。

原文摘要 · Abstract (English)

Recently, 3D Gaussian Splatting (3DGS) has emerged as a powerful alternative to NeRF-based approaches, enabling real-time, high-quality novel view synthesis through explicit, optimizable 3D Gaussians. However, 3DGS suffers from significant memory overhead due to its reliance on per-Gaussian parameters to model view-dependent effects and anisotropic shapes. While recent works propose compressing 3DGS with neural fields, these methods struggle to capture high-frequency spatial variations in Gaussian properties, leading to degraded reconstruction of fine details. We present Hybrid Radiance Fields (HyRF), a novel scene representation that combines the strengths of explicit Gaussians and neural fields. HyRF decomposes the scene into (1) a compact set of explicit Gaussians storing only critical high-frequency parameters and (2) grid-based neural fields that predict remaining properties. To enhance representational capacity, we introduce a decoupled neural field architecture, separately modeling geometry (scale, opacity, rotation) and view-dependent color. Additionally, we propose a hybrid rendering scheme that composites Gaussian splatting with a neural field-predicted background, addressing limitations in distant scene representation. Experiments demonstrate that HyRF achieves state-of-the-art rendering quality while reducing model size by over 20 times compared to 3DGS and maintaining real-time performance. Our project page is available at https://wzpscott.github.io/hyrf/.

3D重建高斯泼溅神经场轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。