提出分层引导框架,让稀疏视角下的3D高斯点云重建更清晰稳定。
HeroGS: Hierarchical Guidance for Robust 3D Gaussian Splatting under Sparse Views
- 从图像、特征到参数三层建立分层引导机制
- 在稀疏视图下实现高保真重建,背景模糊问题显著改善
- 适合低光照或相机数量受限场景的3D重建任务
3D高斯点云渲染(3DGS)在新视角合成中表现优异,兼具逼真视觉效果与实时效率。然而其性能高度依赖密集相机覆盖;在稀疏视角条件下,监督不足导致高斯分布不规则,表现为全局稀疏、背景模糊及高频区域失真。为此,本文提出HeroGS:分层引导的鲁棒3D高斯点云渲染框架,通过图像、特征和参数三个层级建立统一引导机制。在图像层面,将稀疏监督转化为伪密集引导,全局规整高斯分布,奠定优化基础。在特征层面,引入特征自适应增删(FADP),利用低级特征增强高频细节,并自适应地在背景区域增加高斯点。在参数层面,通过参数冻结与协同剪枝(CPG)提升几何一致性,有效移除不一致点。该分层引导策略有效约束并优化整体分布,显著提升结构保真度与渲染质量。大量实验表明,HeroGS在稀疏视角下均超越现有最优方法,实现高保真重建。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has recently emerged as a promising approach in novel view synthesis, combining photorealistic rendering with real-time efficiency. However, its success heavily relies on dense camera coverage; under sparse-view conditions, insufficient supervision leads to irregular Gaussian distributions, characterized by globally sparse coverage, blurred background, and distorted high-frequency areas. To address this, we propose HeroGS, Hierarchical Guidance for Robust 3D Gaussian Splatting, a unified framework that establishes hierarchical guidance across the image, feature, and parameter levels. At the image level, sparse supervision is converted into pseudo-dense guidance, globally regularizing the Gaussian distributions and forming a consistent foundation for subsequent optimization. Building upon this, Feature-Adaptive Densification and Pruning (FADP) at the feature level leverages low-level features to refine high-frequency details and adaptively densifies Gaussians in background regions. The optimized distributions then support Co-Pruned Geometry Consistency (CPG) at parameter level, which guides geometric consistency through parameter freezing and co-pruning, effectively removing inconsistent splats. The hierarchical guidance strategy effectively constrains and optimizes the overall Gaussian distributions, thereby enhancing both structural fidelity and rendering quality. Extensive experiments demonstrate that HeroGS achieves high-fidelity reconstructions and consistently surpasses state-of-the-art baselines under sparse-view conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。