通过混合点阵技术加速反射场景的高保真渲染。
HybridSplat: Fast Reflection-baked Gaussian Tracing using Hybrid Splatting
- 将视角依赖反射信息烘焙进高斯原语，结合分块点阵渲染反射。
- 在复杂反射场景中实现7倍提速，仅需基线4分之1的高斯数量。
- 适合追求快速高质量反射渲染的3D重建与虚拟场景应用。
使用3D高斯点阵渲染真实场景的复杂反射，是实现高保真新视角合成的有前景方法，但仍面临渲染速度慢和内存占用高的瓶颈。本文提出一种新的高斯原语混合点阵（HybridSplat）机制。核心思想是在渲染时将视角依赖的反射信息烘焙至每个高斯原语中，并采用基于瓦片的高斯点阵技术渲染反射。随后，通过统一的混合点阵框架将反射高斯原语与基础高斯原语融合，实现高保真场景重建。此外，我们进一步引入管线级加速与反射敏感的高斯剪枝策略，显著降低模型规模，从而在保持反射渲染质量的同时大幅提升渲染速度并减少内存占用。在Ref-NeRF、NeRF-Casting等复杂反射场景上的广泛评估表明，我们的HybridSplat实现了约7倍的渲染速度提升，且高斯原语数量仅为类似基于射线追踪的高斯点阵基线的4倍，成为复杂反射场景下的新基准方法。
原文摘要 · Abstract (English)
Rendering complex reflection of real-world scenes using 3D Gaussian splatting has been a quite promising solution for photorealistic novel view synthesis, but still faces bottlenecks especially in rendering speed and memory storage. This paper proposes a new Hybrid Splatting(HybridSplat) mechanism for Gaussian primitives. Our key idea is a new reflection-baked Gaussian tracing, which bakes the view-dependent reflection within each Gaussian primitive while rendering the reflection using tile-based Gaussian splatting. Then we integrate the reflective Gaussian primitives with base Gaussian primitives using a unified hybrid splatting framework for high-fidelity scene reconstruction. Moreover, we further introduce a pipeline-level acceleration for the hybrid splatting, and reflection-sensitive Gaussian pruning to reduce the model size, thus achieving much faster rendering speed and lower memory storage while preserving the reflection rendering quality. By extensive evaluation, our HybridSplat accelerates about 7x rendering speed across complex reflective scenes from Ref-NeRF, NeRF-Casting with 4x fewer Gaussian primitives than similar ray-tracing based Gaussian splatting baselines, serving as a new state-of-the-art method especially for complex reflective scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。