arXiv:2506.15815cs.GRcs.CV2025-06

用神经网络压缩衍射表面数据,实现高保真渲染且内存减少100倍

GratNet: A Photorealistic Neural Shader for Diffractive Surfaces

  • 基于MLP构建隐式神经表示,从数据压缩角度建模衍射反射特性
  • 在PSNR、SSIM和FLIP指标下复现真实反射效果,性能远超传统方法
  • 适合需要高效渲染复杂纳米结构的计算机图形学与光学设计研究者

结构色通常通过波动光学建模,以实现自然、准周期性及复杂纳米结构的真实感渲染。此类模型常依赖密集的预处理数据来准确捕捉衍射表面反射率的细微变化,这种强数据依赖性亟需隐式神经表示,但现有文献尚未充分解决。本文提出一种基于多层感知机(MLP)的数据驱动衍射表面渲染方法,兼具高精度与高效率。我们从数据压缩视角出发,设计了贴合衍射反射数据域与范围特性的训练与建模策略,有效避免过拟合并具备鲁棒的重采样能力。采用峰值信噪比(PSNR)、结构相似性指数(SSIM)和翻转差异评估器(FLIP)作为评价指标,验证了对真实反射结果的高质量重建。相比近期最先进的离线波光学前向建模方法,本方法在主观效果上相当,但性能显著提升:一般情况下,原始数据集内存占用降低两个数量级。最后,我们展示了该方法在实际表面渲染中的应用效果。

原文摘要 · Abstract (English)

Structural coloration is commonly modeled using wave optics for reliable and photorealistic rendering of natural, quasi-periodic and complex nanostructures. Such models often rely on dense, preliminary or preprocessed data to accurately capture the nuanced variations in diffractive surface reflectances. This heavy data dependency warrants implicit neural representation which has not been addressed comprehensively in the current literature. In this paper, we present a multi-layer perceptron (MLP) based method for data-driven rendering of diffractive surfaces with high accuracy and efficiency. We primarily approach this problem from a data compression perspective to devise a nuanced training and modeling method which is attuned to the domain and range characteristics of diffractive reflectance datasets. Importantly, our approach avoids over-fitting and has robust resampling behavior. Using Peak-Signal-to-Noise (PSNR), Structural Similarity Index Measure (SSIM) and a flipping difference evaluator (FLIP) as evaluation metrics, we demonstrate the high-quality reconstruction of the ground-truth. In comparison to a recent state-of-the-art offline, wave-optical, forward modeling approach, our method reproduces subjectively similar results with significant performance gains. We reduce the memory footprint of the raw datasets by two orders of magnitude in general. Lastly, we depict the working of our method with actual surface renderings.

神经渲染衍射表面数据压缩光学建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。