让反光动态场景重建更真实，突破3D高斯溅射的反光难题。
SpectroMotion: Dynamic 3D Reconstruction of Specular Scenes
- 用残差修正与可变形环境图提升动态反光表面法向精度。
- 采用粗到精训练策略，显著改善几何与反光颜色还原效果。
- 唯一能生成逼真动态反光场景的3DGS方法，适合渲染领域研究者。
我们提出SpectroMotion，一种结合3D高斯溅射（3DGS）、物理基础渲染（PBR）与形变场的新方法，用于动态反光场景的3D重建。此前扩展3DGS以建模动态场景的方法难以准确表现反光表面。本方法通过引入残差校正技术，在形变过程中实现精确表面法向计算，并辅以随时间变化的可变形环境图，适应动态光照条件。采用粗到精训练策略，显著提升场景几何与反光颜色预测能力。SpectroMotion是目前唯一能合成逼真现实动态反光场景的3DGS方法，在复杂、动态、反光场景的渲染上超越现有最先进方法。
原文摘要 · Abstract (English)
We present SpectroMotion, a novel approach that combines 3D Gaussian Splatting (3DGS) with physically-based rendering (PBR) and deformation fields to reconstruct dynamic specular scenes. Previous methods extending 3DGS to model dynamic scenes have struggled to represent specular surfaces accurately. Our method addresses this limitation by introducing a residual correction technique for accurate surface normal computation during deformation, complemented by a deformable environment map that adapts to time-varying lighting conditions. We implement a coarse-to-fine training strategy significantly enhancing scene geometry and specular color prediction. It is the only existing 3DGS method capable of synthesizing photorealistic real-world dynamic specular scenes, outperforming state-of-the-art methods in rendering complex, dynamic, and specular scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。