arXiv:2608.10602cs.CVcs.GR2026-08

通过可微分表面优化,实现3D高精度可控重建。

Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization

论文配图:Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization
图 1 · 摘自论文原文
  • 将高斯点锚定在可微分表面,联合优化几何与外观。
  • 在有限视角下恢复缺失结构,误差显著降低。
  • 适合需要高质量3D重建的科研与工业应用。

3D高斯泼溅(3DGS)最近实现了实时新视角合成并达到优异质量,但在视角受限时难以准确恢复表面,且高斯原语固有的不规则性导致几何误差难以手动修正。为此,我们提出高斯雕刻(Gaussian Sculpting),一种完全可微的端到端框架,用于高质量表面重建。核心思想是将高斯点锚定在不断演化的可微分表面,使其引导有符号距离场(SDF)优化,而非仅在后处理阶段提取表面。为实现联合优化中的稳定梯度隔离,设计双层训练策略:外层优化由SDF表示的几何,内层固定几何更新高斯点。进一步对高斯参数施加约束,确保与底层表面一致,从而提升优化过程中的几何与外观保真度。此外,引入基于八叉树式划分的多分辨率细分方案,在保留细节的同时降低内存消耗。在物体级场景上的实验表明,该方法有效消除冗余表面,恢复因视角受限造成的缺失结构,并在较低分辨率下仍实现强重建质量。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has recently enabled real-time novel view synthesis with impressive quality. However, it struggles to recover accurate surfaces under limited viewpoints and due to the inherent irregularity of Gaussian primitives. The resulting geometric errors are notoriously difficult to correct manually. To address these issues, we propose Gaussian Sculpting, a fully differentiable end-to-end framework for high-quality surface reconstruction. Our key insight is to anchor Gaussians onto an evolving differentiable surface, allowing them to guide signed distance field (SDF) optimization instead of extracting the surface only during post-processing. To enable stable gradient isolation during joint optimization, we design a bi-level training strategy in which the outer loop optimizes the geometry represented by the SDF, while the inner loop updates the Gaussians with the geometry fixed. We further impose constraints on Gaussian parameters to ensure consistency with the underlying surface, thereby improving both geometric and appearance fidelity during optimization. In addition, we introduce a multi-resolution subdivision scheme based on octree-like partitioning to preserve fine details while reducing memory consumption. Experiments on object-level scenes demonstrate that our method effectively removes redundant surfaces, recovers missing structures caused by limited viewpoints, and achieves strong reconstruction quality even at relatively low resolutions.

3D重建可微分几何高斯泼溅

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。