用神经网络压缩动态光照下的多时序光图,大幅降低存储开销。
Neural Dynamic GI: Random-Access Neural Compression for Temporal Lightmaps in Dynamic Lighting Environments

- 用多维特征图+轻量神经网络融合时间信息,替代多组光图存储。
- 训练中模拟块压缩,使最终特征图可进一步压缩,提升压缩比。
- 结合虚拟纹理实现实时解压,适合实时渲染与动态光照场景研究。
实时渲染中高质量全局光照通常依赖预计算的光图技术。在动态光照环境下,为静态物体支持全局光照需预先计算多个不同光照条件下的光图,导致显著的存储与内存开销。为此,我们提出神经动态光照(NDGI),一种专为时序光图集设计的新压缩技术。该方法利用多维特征图与轻量级神经网络整合时间信息,避免显式存储多组光图,大幅降低光图存储体积。此外,我们在训练过程中引入块压缩(BC)模拟策略,使生成的特征图具备更好的压缩性,进一步提升压缩率。为实现高效实时解压,我们还集成了虚拟纹理(VT)系统。相比现有方法,本方案在保持高质量动态光照的同时,仅需极低存储与内存开销,且实时解压开销可控。为促进后续研究,我们将公开在多个场景下预计算的时序光图数据集,涵盖丰富的时序变化。
原文摘要 · Abstract (English)
High-quality global illumination (GI) in real-time rendering is commonly achieved using precomputed lighting techniques, with lightmap as the standard choice. To support GI for static objects in dynamic lighting environments, multiple lightmaps at different lighting conditions need to be precomputed, which incurs substantial storage and memory overhead. To overcome this limitation, we propose Neural Dynamic GI (NDGI), a novel compression technique specifically designed for temporal lightmap sets. Our method utilizes multi-dimensional feature maps and lightweight neural networks to integrate the temporal information instead of storing multiple sets explicitly, which significantly reduces the storage size of lightmaps. Additionally, we introduce a block compression (BC) simulation strategy during the training process, which enables BC compression on the final generated feature maps and further improves the compression ratio. To enable efficient real-time decompression, we also integrate a virtual texturing (VT) system with our neural representation. Compared with prior methods, our approach achieves high-quality dynamic GI while maintaining remarkably low storage and memory requirements, with only modest real-time decompression overhead. To facilitate further research in this direction, we will release our temporal lightmap dataset precomputed in multiple scenes featuring diverse temporal variations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。