实现实时动态3D高斯场景的全局光照，支持交互式材质与多光源。
Real-time Global Illumination for Dynamic 3D Gaussian Scenes
- 基于3D高斯表面光传输模型，设计快速随机光线追踪算法。
- 在混合高斯与网格场景中实现40+帧/秒的实时渲染与多重间接光照。
- 适合需要动态光照的实时渲染应用，如游戏、VR和交互式可视化。
我们提出一种实时全局光照方法及动态3D高斯模型与网格的渲染管线。基于为3D高斯构建的表面光传输模型，通过快速复合随机光线追踪算法和优化的3D高斯光栅化器，解决关键性能瓶颈。该管线融合多种实时技术，显著加速渲染并生成高质量光照效果。所提方法可实现实时渲染动态场景，支持交互式材质编辑与多样多光源设置，准确捕捉3D高斯与网格间的多重反弹光传输（间接照明）。此外，我们开发了带交互式界面的实时渲染器，在包含3D高斯与网格的场景中实现了超过40帧/秒的流畅表现，验证了该方法的实用性与高效性。本工作揭示了3D高斯在动态光照实时应用中的潜力，为性能优化提供了新思路。
原文摘要 · Abstract (English)
We present a real-time global illumination approach along with a pipeline for dynamic 3D Gaussian models and meshes. Building on a formulated surface light transport model for 3D Gaussians, we address key performance challenges with a fast compound stochastic ray-tracing algorithm and an optimized 3D Gaussian rasterizer. Our pipeline integrates multiple real-time techniques to accelerate performance and achieve high-quality lighting effects. Our approach enables real-time rendering of dynamic scenes with interactively editable materials and dynamic lighting of diverse multi-lights settings, capturing mutual multi-bounce light transport (indirect illumination) between 3D Gaussians and mesh. Additionally, we present a real-time renderer with an interactive user interface, validating our approach and demonstrating its practicality and high efficiency with over 40 fps in scenes including both 3D Gaussians and mesh. Furthermore, our work highlights the potential of 3D Gaussians in real-time applications with dynamic lighting, offering insights into performance and optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。