无需重训练,一秒内实现高精度物体光照切换。
TranSplat: Instant Object Relighting in Gaussian Splatting via Spherical Harmonic Radiance Transfer
- 用球谐函数系数直接调参,跳过耗时的逆向渲染。
- 真实感光照切换,对镜面材质也表现良好,1秒内完成。
- 适合快速内容创作和交互式场景编辑的用户。
我们提出 TranSplat,一种在高斯点阵(Gaussian Splatting, GS)框架内实现即时、精准物体重光照的方法。不依赖昂贵的逆向渲染流程,而是提出一种无需BRDF的辐射率转移策略,通过源与目标环境图的每法线入射光比值,解析地调节物体2D高斯贴片的球谐(SH)外观系数。为处理视图依赖和光泽外观而无需显式材质估计,引入一种考虑光泽度的双路径SH转移机制,自适应反射域中的高阶SH带宽。此外,提出轻量级的SH域自阴影模块,确保物理真实的遮挡效果,无需显式网格光线投射。作为后处理步骤,TranSplat对一对源与目标场景无需额外GS重训练。在合成与真实物体上的评估表明,其精度达到当前最优,在大多数条件下超越近期基于逆向渲染与扩散模型的GS重光照方法,且所有重光照操作均在1秒内完成。尽管受限于径向对称的BRDF近似和SH基底的低通特性,TranSplat仍能生成感知真实的渲染结果,尤其适用于复杂光泽材质,为GS重光照提供了一条高效轻量的新路径。
原文摘要 · Abstract (English)
We present TranSplat, a method for instant, accurate object relighting within the Gaussian Splatting (GS) framework. Rather than relying on costly inverse rendering routines, we propose a BRDF-free radiance transfer strategy that analytically modulates the spherical harmonic (SH) appearance coefficients of an object's 2D Gaussian surfels using per-normal irradiance ratios derived from source and target environment maps. To handle view-dependent and glossy appearances without explicit material estimation, we introduce a specularity-aware dual-path SH transfer strategy that adapts higher-order SH bands in the reflection domain. Additionally, we propose a lightweight SH-domain self-shadowing module to ensure physically realistic occlusion without explicit mesh raycasting. Operating as a post-processing step, TranSplat requires no additional GS retraining for a pair of source and target scenes. Evaluations on synthetic and real-world objects demonstrate state-of-the-art accuracy, outperforming recent inverse-rendering and diffusion-based GS relighting methods across most conditions, all while completing relighting operations in under one second. Although bounded by radially symmetric BRDF approximations and the low-pass nature of the SH basis, TranSplat produces perceptually realistic renderings even for glossy, complex materials, establishing a valuable, lightweight path forward for GS relighting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。