用神经网络实时生成六向光照贴图,让烟雾动态交互更逼真。
Real-time Neural Six-way Lightmaps
- 通过大步长光线追踪生成引导图,指导神经网络预测光照贴图。
- 支持相机移动、灯光变化和烟雾与障碍物互动,实现实时渲染。
- 兼容现有游戏引擎,适合游戏与VR/AR等实时场景使用。
参与介质是虚拟环境中常见且引人注目的视觉效果。然而,由于体积渲染方程计算开销大,实现实时渲染极具挑战。尽管六向光照贴图技术在视频游戏中广泛用于烟雾渲染,通过相机朝向的贴图近似光照效果,但其仅适用于预模拟动画序列,且忽略相机运动。本文提出一种神经六向光照贴图方法,实现动态与真实感之间的平衡。首先,利用大采样距离的光线追踪从相机视角生成引导图,近似烟雾散射与轮廓;随后,训练神经网络根据该引导图预测对应的六向光照贴图。生成的光照贴图可无缝集成至现有游戏引擎流程。该方法支持视觉吸引力强的渲染效果,并实现实时用户交互,包括烟雾-障碍物交互、相机移动和光照变化。通过一系列全面基准测试,验证了本方法在游戏与VR/AR等实时应用中的适用性。
原文摘要 · Abstract (English)
Participating media are a pervasive and intriguing visual effect in virtual environments. Unfortunately, rendering such phenomena in real-time is notoriously difficult due to the computational expense of estimating the volume rendering equation. While the six-way lightmaps technique has been widely used in video games to render smoke with a camera-oriented billboard and approximate lighting effects using six precomputed lightmaps, achieving a balance between realism and efficiency, it is limited to pre-simulated animation sequences and is ignorant of camera movement. In this work, we propose a neural six-way lightmaps method to strike a long-sought balance between dynamics and visual realism. Our approach first generates a guiding map from the camera view using ray marching with a large sampling distance to approximate smoke scattering and silhouette. Then, given a guiding map, we train a neural network to predict the corresponding six-way lightmaps. The resulting lightmaps can be seamlessly used in existing game engine pipelines. This approach supports visually appealing rendering effects while enabling real-time user interactivity, including smoke-obstacle interaction, camera movement, and light change. By conducting a series of comprehensive benchmarks, we demonstrate that our method is well-suited for real-time applications, such as games and VR/AR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。