提出新型球面函数,高效建模高频率视觉效应。
Beyond Spherical Harmonics: Rethinking Appearance Models for Radiance Reconstruction

- 用新型球面函数替代传统SH,提升表达能力。
- 重建镜面反光等效果更清晰,内存效率最高提升5倍。
- 适合需要精细外观建模的渲染与重建任务。
视点依赖的外观建模在新视角合成与重建中仍是难题。准确表示复杂角度效应通常需要大量内存和计算资源。现有学习方法多依赖球谐函数(SH),但捕捉高频率现象如镜面反射需高阶展开,导致内存和计算成本上升。因此多数方法采用低阶SH,限制了复杂视点依赖效应的建模能力,造成结果过于平滑或扩散。为此,本文系统评估多种球面函数在场景重建中的表现,部分函数首次引入图形学与计算机视觉领域。基于实验洞察,我们提出一种新的球面形式——归一化各向异性球面Gabor函数,可在保持紧凑表示的同时,高效建模和学习高频率外观效应。相比现有方法,该函数在重建镜面亮点等视点依赖现象上质量更高,内存占用最多降低5倍,评估速度也更快。我们在辐射场重建任务中验证了其性能。
原文摘要 · Abstract (English)
View-dependent appearance modeling remains a challenging problem in novel-view synthesis and reconstruction. Accurately representing complex angular effects often requires substantial memory and computational resources. For new learning-based methods, a common approach is to rely on SH. However, capturing high-frequency phenomena such as specular reflections demands high-order expansions, which increase memory usage and computational cost. Consequently, most methods employ low-order SH, which limits the ability to model complex view-dependent effects, resulting in overly smooth or diffuse representations. To address these limitations, we systematically evaluate a wide range of spherical functions in the context of scene reconstruction. Some of them are introduced to graphics and computer vision for the first time in this paper. Based on the insights from the experiment, we develop a novel spherical formulation, the Normalized Anisotropic Spherical Gabor function that enables efficient modeling and learning of high-frequency appearance effects while maintaining compact representation. Compared to existing approaches, our function achieves higher-quality reconstruction of view-dependent phenomena such as glints, while being up to five times more memory-efficient and more efficient to evaluate. We validate its performance in radiance-field reconstruction tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。