arXiv:2509.22276cs.CV2025-09中稿 · Eurographics 2026,…

让3D高斯点云更懂材质,精准重建反光物体表面。

GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstruction

  • 联合优化深度与法向渲染质量,提升材质感知能力。
  • 在常见数据集上实现媲美顶尖方法的网格重建精度。
  • 无需复杂神经组件,适合大规模场景快速重建。

我们提出一种基于3D高斯点云的材料感知优化框架GS-2M,用于从多视角图像中实现高保真网格重建。现有方法通常分步处理,难以重建高反射表面,常依赖外部模型先验。本方法通过联合优化影响渲染深度和法向质量的属性,在保持几何细节的同时有效应对反射表面。尽管当前方法已能协同求解,但普遍采用复杂神经组件,限制了其可扩展性。为此,我们提出一种基于多视角光度变化的粗糙度监督策略,结合精心设计的损失函数与优化流程,使统一框架在不使用神经组件的情况下,仍能达到与顶尖方法相当的重建效果,即使在反射表面上也能生成准确三角网格。我们在多个常用数据集上验证了方法的有效性,并与先进表面重建方法进行了定性对比。

原文摘要 · Abstract (English)

We propose a material-aware optimization framework for high-fidelity mesh reconstruction from multi-view images based on 3D Gaussian Splatting, referred to as GS-2M. Previous works handle these tasks separately and struggle to reconstruct highly reflective surfaces, often relying on priors from external models to enhance the decomposition results. Conversely, our method addresses these two problems by jointly optimizing attributes relevant to the quality of rendered depth and normals, maintaining geometric details while being resilient to reflective surfaces. Although contemporary works effectively solve these tasks together, they often employ sophisticated neural components to learn scene properties, which hinders their performance at scale. To further eliminate these neural components, we propose a novel roughness supervision strategy based on multi-view photometric variation. When combined with a carefully designed loss and optimization process, our unified framework produces reconstruction results comparable to state-of-the-art methods, delivering accurate triangle meshes even for reflective surfaces. We validate the effectiveness of our approach with widely used datasets from previous works and qualitative comparisons with state-of-the-art surface reconstruction methods. Project page: https://ndming.github.io/publications/gs2m/.

3D重建高斯点云材质感知反光表面

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。