通过风险分解优化,提升单图3D重建的精度与细节。
ERGO: Excess-Risk-Guided Optimization for High-Fidelity Monocular 3D Gaussian Splatting
- 基于过量风险分解动态调整损失权重,适应合成视图噪声。
- 在两个数据集上实现更优的几何保真度与纹理质量。
- 适合关注单目3D生成质量的科研与工业开发者。
从单张图像生成3D内容因遮挡区域缺乏几何与纹理信息而本质困难。尽管先进生成模型可合成辅助视图提供监督,但这些视图必然存在几何不一致与纹理错位,导致3D重建中伪影传播放大。为有效利用这些不完美监督信号,本文提出一种由过量风险引导的自适应优化框架ERGO。ERGO将3D高斯点阵的优化损失分解为两部分:过量风险(衡量当前参数与最优参数的差距)与贝叶斯误差(建模合成视图中的不可约噪声)。该分解使ERGO能动态估计每视图的过量风险,并自适应调节损失权重。此外,引入几何感知与纹理感知目标,与风险驱动的加权机制协同,形成全局-局部优化范式。实验表明,ERGO在谷歌扫描物体数据集(Google Scanned Objects)和OmniObject3D数据集上均显著优于现有方法,在抑制监督噪声的同时,持续提升重建3D内容的几何保真度与纹理质量。
原文摘要 · Abstract (English)
Generating 3D content from a single image remains a fundamentally challenging and ill-posed problem due to the inherent absence of geometric and textural information in occluded regions. While state-of-the-art generative models can synthesize auxiliary views to provide additional supervision, these views inevitably contain geometric inconsistencies and textural misalignments that propagate and amplify artifacts during 3D reconstruction. To effectively harness these imperfect supervisory signals, we propose an adaptive optimization framework guided by excess risk decomposition, termed ERGO. Specifically, ERGO decomposes the optimization losses in 3D Gaussian splatting into two components, i.e., excess risk that quantifies the suboptimality gap between current and optimal parameters, and Bayes error that models the irreducible noise inherent in synthesized views. This decomposition enables ERGO to dynamically estimate the view-specific excess risk and adaptively adjust loss weights during optimization. Furthermore, we introduce geometry-aware and texture-aware objectives that complement the excess-risk-derived weighting mechanism, establishing a synergistic global-local optimization paradigm. Consequently, ERGO demonstrates robustness against supervision noise while consistently enhancing both geometric fidelity and textural quality of the reconstructed 3D content. Extensive experiments on the Google Scanned Objects dataset and the OmniObject3D dataset demonstrate the superiority of ERGO over existing state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。