用6维隐变量实现高效光谱渲染,让普通RGB渲染器也能出真实色彩。
Compact Hadamard Latent Codes for Efficient Spectral Rendering
- 设计可线性操作的哈达玛隐码,让光照与反射乘积近似为编码相乘。
- 仅需6维编码、2次RGB渲染即可还原高分辨率光谱图像,比传统方法快数倍。
- 兼容旧版RGB素材,适合做影视/游戏中的高质量光影特效开发。
光谱渲染能精准再现波长相关的视觉效果,但计算成本高,因着色需在多个波长采样上进行,且随采样数线性增长。同时需要全程使用光谱纹理和光源。本文提出哈达玛光谱编码,一种紧凑的隐式表示,使标准RGB渲染器即可实现光谱渲染。通过少量RGB渲染通道(如k=6时为2帧)加解码步骤,近似生成光谱图像。核心要求是隐空间的线性性:光谱的缩放与相加对应编码的缩放与相加,而光谱的逐元素乘积(如反射率乘以光照)由编码的逐元素乘积近似。我们证明,当隐维度k小于光谱采样数n时,任意光谱下精确低维代数保持表示不存在。因此引入学习型非负线性编码器与解码器,精确保持缩放与相加,同时在哈达玛乘积下逼近乘法性。实验显示,使用k=6时,相比RGB基线显著降低颜色误差,且远快于原始的n样本光谱渲染;使用k=9可获得更高精度参考结果。此外,我们设计轻量神经上采样网络,将原有RGB资产直接映射至隐码,实现旧内容无缝集成,渲染图像保持感知准确颜色。
原文摘要 · Abstract (English)
Spectral rendering accurately reproduces wavelength-dependent appearance but is computationally expensive, as shading must be evaluated at many wavelength samples and scales roughly linearly with the number of samples. It also requires spectral textures and lights throughout the rendering pipeline. We propose Hadamard spectral codes, a compact latent representation that enables spectral rendering using standard RGB rendering operations. Spectral images are approximated with a small number of RGB rendering passes, followed by a decoding step. Our key requirement is latent linearity: scaling and addition in spectral space correspond to scaling and addition of codes, and the element-wise product of spectra (for example reflectance times illumination) is approximated by the element-wise product of their latent codes. We show that an exact low-dimensional algebra-preserving representation cannot exist for arbitrary spectra when the latent dimension k is smaller than the number of spectral samples n. We therefore introduce a learned non-negative linear encoder and decoder architecture that preserves scaling and addition exactly while encouraging approximate multiplicativity under the Hadamard product. With k = 6, we render k/3 = 2 RGB images per frame using an unmodified RGB renderer, reconstruct the latent image, and decode to high-resolution spectra or XYZ or RGB. Experiments on 3D scenes demonstrate that k = 6 significantly reduces color error compared to RGB baselines while being substantially faster than naive n-sample spectral rendering. Using k = 9 provides higher-quality reference results. We further introduce a lightweight neural upsampling network that maps RGB assets directly to latent codes, enabling integration of legacy RGB content into the spectral pipeline while maintaining perceptually accurate colors in rendered images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。