arXiv:2508.08826cs.GRcs.AI2025-08

用几何感知注意力网络实时预测间接光照,提升复杂场景真实感。

Geometry-Aware Global Feature Aggregation for Real-Time Indirect Illumination

  • 通过几何引导的全局注意力聚合信息,捕捉远距离光照
  • 支持多色光源与纹理表面间颜色渗透,还原真实光反射效果
  • 模型泛化性强,新场景无需重训练也能良好表现

实时全局光照渲染对虚拟环境中实现真实感体验至关重要。本文提出一种基于学习的屏幕空间估计算法,用于预测漫反射间接光照,并与直接光照融合生成高动态范围(HDR)结果。该方法克服了神经网络在建模长距离间接光照时的挑战,可推广至复杂光照与场景。从求解器到渲染方程的思路出发,设计了一种新型网络架构:采用改进的注意力机制,以空间几何特征为指导聚合全局信息;同时采用单色设计,独立编码每个颜色通道。大量实验表明,本方法在性能上优于以往学习型技术。尤其擅长处理多色光源、环境光等复杂照明条件,能有效捕捉远距离间接光照,并准确模拟纹理表面间的相互反射(如颜色渗透效应),且对训练数据外的新场景具有强泛化能力。

原文摘要 · Abstract (English)

Real-time rendering with global illumination is crucial to afford the user realistic experience in virtual environments. We present a learning-based estimator to predict diffuse indirect illumination in screen space, which then is combined with direct illumination to synthesize globally-illuminated high dynamic range (HDR) results. Our approach tackles the challenges of capturing long-range/long-distance indirect illumination when employing neural networks and is generalized to handle complex lighting and scenarios. From the neural network thinking of the solver to the rendering equation, we present a novel network architecture to predict indirect illumination. Our network is equipped with a modified attention mechanism that aggregates global information guided by spacial geometry features, as well as a monochromatic design that encodes each color channel individually. We conducted extensive evaluations, and the experimental results demonstrate our superiority over previous learning-based techniques. Our approach excels at handling complex lighting such as varying-colored lighting and environment lighting. It can successfully capture distant indirect illumination and simulates the interreflections between textured surfaces well (i.e., color bleeding effects); it can also effectively handle new scenes that are not present in the training dataset.

实时渲染间接光照神经渲染几何感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。