arXiv:2508.05950cs.CVcs.AI2025-08

无需真实法向标签,用3D高斯点云实现弱监督单图法向估计。

Reprojection-Guided 3D Gaussian Splatting Diffusion for Weakly Supervised Single-Image Normal Estimation

  • 通过可微渲染与重投影约束,统一几何表示与图像重建。
  • 联合优化使法向估计在保持几何一致性的同时恢复高频细节。
  • 适合缺乏标注数据的3D重建与逆向渲染任务。

我们提出CLONE,一种基于3D高斯点云的连续隐式优化框架,用于法向估计。核心思想是构建图像-几何-图像一致性策略,将显式几何表示与可微渲染结合,从而在无真实法向标签的情况下实现弱监督学习。CLONE包含四个组件:首先,引入可学习调制核的可微光照交互模型,对3DGS参数空间进行统一重参数化;其次,条件性单步确定性精修网络融合去噪架构与可微重投影约束,自适应恢复高斯原语固有的平滑性所丢失的高频细节;第三,跨域门控融合机制自适应整合两种互补的法向估计,协调几何一致但过平滑的3DGS结果与细节丰富但可能几何不一致的精修结果;最后,所有组件在统一的光度重投影目标下联合优化,并引入几何一致性正则项,构成完全可微的端到端闭环优化,无需依赖外部法向标签。

原文摘要 · Abstract (English)

We propose CLONE, a Continuous Latent Optimization framework for Normal Estimation via 3D Gaussian splatting. The core idea is to construct an image-geometry-image consistency strategy that unifies explicit geometric representation with differentiable rendering, thereby enabling weakly supervised learning without normal ground truth. Specifically, CLONE comprises four components. First, by introducing a differentiable light interaction model with a learnable modulation kernel, we perform a unified reparameterization of the 3DGS parameter space. Second, the conditional single-step deterministic refinement network integrates denoising architectures with differentiable reprojection constraints to refine the initial normals, thereby adaptively recovering the high-frequency details erased by the inherently smooth Gaussian primitives. Third, the cross-domain gating fusion mechanism adaptively combines the two complementary normal estimates, reconciling the geometrically consistent yet over-smooth 3DGS estimate with the detailed yet potentially geometry-inconsistent refinement. Finally, all components are jointly optimized under a unified photometric reprojection objective with geometric consistency regularizations in a fully differentiable pathway, achieving an end-to-end optimization closed loop without relying on external normal labels.

法向估计3D高斯弱监督可微渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。