arXiv:2507.06103cs.CV2025-07被引 4

提出新方法分离反射与真实几何,让3D高斯点云更真实渲染有反光的场景。

Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Rendering

  • 用双分支结构和球谐函数分离反射与透射成分,提升细节捕捉能力。
  • 在真实场景中实现清晰的反射重建,相比传统方法减少表面模糊与错位。
  • 适合需要高保真反射渲染的领域,如虚拟现实、工业设计与视觉编辑。

准确渲染具有反射表面的场景仍是新视角合成中的重大挑战,现有方法如神经辐射场(NeRF)和3D高斯点云(3DGS)常将反射误判为物理几何,导致重建质量下降。以往方法依赖不完整且非普适的几何约束,造成高斯点位置与实际场景几何错位。在包含复杂几何的真实场景中,高斯点累积进一步加剧表面伪影并引发模糊重建。为此,本文提出基于3DGS的几何感知反射建模框架Ref-Unlock,显式分离透射与反射成分,以更好捕捉复杂反射并增强真实场景中的几何一致性。该方法采用双分支表示结构结合高阶球谐函数,以捕获高频反射细节;引入反射去除模块,提供伪无反射监督以指导清洁分解。同时,结合伪深度图与几何感知双边平滑性约束,提升分解过程中的3D几何一致性与稳定性。大量实验表明,Ref-Unlock显著优于经典基于GS的反射方法,并达到与基于NeRF模型相当的性能,同时支持由视觉基础模型驱动的灵活反射编辑。本方法为真实场景中反射内容的高效、通用渲染提供了新方案。代码已公开于https://ref-unlock.github.io/。

原文摘要 · Abstract (English)

Accurately rendering scenes with reflective surfaces remains a significant challenge in novel view synthesis, as existing methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) often misinterpret reflections as physical geometry, resulting in degraded reconstructions. Previous methods rely on incomplete and non-generalizable geometric constraints, leading to misalignment between the positions of Gaussian splats and the actual scene geometry. When dealing with real-world scenes containing complex geometry, the accumulation of Gaussians further exacerbates surface artifacts and results in blurred reconstructions. To address these limitations, in this work, we propose Ref-Unlock, a novel geometry-aware reflection modeling framework based on 3D Gaussian Splatting, which explicitly disentangles transmitted and reflected components to better capture complex reflections and enhance geometric consistency in real-world scenes. Our approach employs a dual-branch representation with high-order spherical harmonics to capture high-frequency reflective details, alongside a reflection removal module providing pseudo reflection-free supervision to guide clean decomposition. Additionally, we incorporate pseudo-depth maps and a geometry-aware bilateral smoothness constraint to enhance 3D geometric consistency and stability in decomposition. Extensive experiments demonstrate that Ref-Unlock significantly outperforms classical GS-based reflection methods and achieves competitive results with NeRF-based models, while enabling flexible vision foundation models (VFMs) driven reflection editing. Our method thus offers an efficient and generalizable solution for realistic rendering of reflective scenes. Our code is available at https://ref-unlock.github.io/.

3D高斯反射分离几何一致性渲染优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。