用偏振信息指导3D高斯点云,实现真实反光场景的实时高保真重建。
PolarGuide-GSDR: 3D Gaussian Splatting Driven by Polarization Priors and Deferred Reflection for Real-World Reflective Scenes
- 先用3D高斯几何先验解偏振模糊,再用优化后的偏振信息引导法向与球谐表示
- 无需环境图或材质假设,实现镜面反射分离与全场景重建,性能优于现有方法
- 首个将偏振先验直接嵌入3D高斯优化的框架,适合复杂反光场景建模
偏振感知神经辐射场(NeRF)可合成镜面反射场景的新视角,但存在训练慢、渲染效率低及对材质/视角假设依赖强的问题。而3D高斯点云(3DGS)虽支持实时渲染,却难以从反射-几何纠缠中准确重建反射,且引入延迟反射模块后依赖环境图。为此,我们提出PolarGuide-GSDR,构建偏振与3DGS间的双向耦合机制:首先利用3DGS几何先验解决偏振模糊,再以优化后的偏振信息引导3DGS的法向与球谐表示。该方法无需环境图或严格材质假设,实现高保真反射分离与全场景重建。在公开与自采数据集上验证,PolarGuide-GSDR在镜面重建、法向估计与新视角合成上均达当前最优,同时保持实时渲染能力。据我们所知,这是首个将偏振先验直接嵌入3DGS优化的框架,显著提升可解释性与实时性能,适用于复杂反射场景建模。
原文摘要 · Abstract (English)
Polarization-aware Neural Radiance Fields (NeRF) enable novel view synthesis of specular-reflection scenes but face challenges in slow training, inefficient rendering, and strong dependencies on material/viewpoint assumptions. However, 3D Gaussian Splatting (3DGS) enables real-time rendering yet struggles with accurate reflection reconstruction from reflection-geometry entanglement, adding a deferred reflection module introduces environment map dependence. We address these limitations by proposing PolarGuide-GSDR, a polarization-forward-guided paradigm establishing a bidirectional coupling mechanism between polarization and 3DGS: first 3DGS's geometric priors are leveraged to resolve polarization ambiguity, and then the refined polarization information cues are used to guide 3DGS's normal and spherical harmonic representation. This process achieves high-fidelity reflection separation and full-scene reconstruction without requiring environment maps or restrictive material assumptions. We demonstrate on public and self-collected datasets that PolarGuide-GSDR achieves state-of-the-art performance in specular reconstruction, normal estimation, and novel view synthesis, all while maintaining real-time rendering capabilities. To our knowledge, this is the first framework embedding polarization priors directly into 3DGS optimization, yielding superior interpretability and real-time performance for modeling complex reflective scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。