arXiv:2505.18649cs.CV2025-05

用分阶段方法提升3D高分辨率场景重建质量

SuperGS: Consistent and Detailed 3D Super-Resolution Scene Reconstruction via Gaussian Splatting

  • 分两阶段训练:先低分辨率初始化,再高分辨率优化
  • 多视角一致稠密化策略,减少伪标签歧义与冗余
  • 通过不确定性建模引导优化,适合高质量3D重建需求

近期,3D高斯点阵(3DGS)在新视角合成(NVS)中表现出色,具备实时渲染和高质量优势。然而,由于输入视图分辨率较低,导致其在高分辨率新视角合成(HRNVS)中面临挑战。为此,我们提出SuperGS,基于Scaffold-GS设计了从粗到精的两阶段训练框架。在低分辨率阶段,引入潜在特征场表示低分辨率场景,作为超分辨率优化的初始和基础信息。在高分辨率阶段,提出一种多视角一致性稠密化策略,基于误差图反投影高分辨率深度图,并采用多视角投票机制,缓解由2D先验模型提供的伪标签带来的多视角不一致性问题,同时避免高斯冗余。此外,通过变分特征学习建模不确定性,用于引导场景表示优化并调整伪标签的监督作用,确保场景重建的一致性与细节。大量实验表明,SuperGS在前向和360度数据集上均优于现有最先进方法。

原文摘要 · Abstract (English)

Recently, 3D Gaussian Splatting (3DGS) has excelled in novel view synthesis (NVS) with its real-time rendering capabilities and superior quality. However, it encounters challenges for high-resolution novel view synthesis (HRNVS) due to the coarse nature of primitives derived from low-resolution input views. To address this issue, we propose SuperGS, an expansion of Scaffold-GS designed with a two-stage coarse-to-fine training framework. In the low-resolution stage, we introduce a latent feature field to represent the low-resolution scene, which serves as both the initialization and foundational information for super-resolution optimization. In the high-resolution stage, we propose a multi-view consistent densification strategy that backprojects high-resolution depth maps based on error maps and employs a multi-view voting mechanism, mitigating ambiguities caused by multi-view inconsistencies in the pseudo labels provided by 2D prior models while avoiding Gaussian redundancy. Furthermore, we model uncertainty through variational feature learning and use it to guide further scene representation refinement and adjust the supervisory effect of pseudo-labels, ensuring consistent and detailed scene reconstruction. Extensive experiments demonstrate that SuperGS outperforms state-of-the-art HRNVS methods on both forward-facing and 360-degree datasets.

3D重建高分辨率点阵渲染多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。