arXiv:2503.00881cs.CVcs.AI2025-03CVPR被引 11

统一框架实现高质量渲染与精确重建,通过自适应正则化提升性能。

Evolving High-Quality Rendering and Reconstruction in a Unified Framework with Contribution-Adaptive Regularization

  • 用自适应贡献正则化统一优化渲染与重建任务
  • 在真实时间速度下达到顶尖的渲染质量与几何精度
  • 适合需要高效高保真3D重建的研究与应用

从多视角图像构建3D场景是计算机视觉与图形学的核心挑战,需兼顾高保真渲染与精确几何重建。近年来,3D高斯溅射(3DGS)因其高质量渲染和快速推理受到关注,但其无序点云结构导致几何重建困难。现有方法多聚焦于几何正则化,如基于基元或双模型框架,前者存在渲染与重建的内在冲突,后者计算与存储开销大。为此,本文提出CarGS,一种统一框架,利用贡献自适应正则化实现同步高质量渲染与表面重建。核心思想是通过紧凑的MLP从几何正则化中提取知识,学习高斯基元的自适应贡献。此外,引入基于几何线索的密度增长策略,结合法向量与符号距离场(SDF),增强高频细节捕捉能力。该设计促进两任务协同学习,无需双模型结构,保障效率。大量实验表明,其在渲染保真度和重建准确率上均达当前最优(SOTA),同时保持实时速度与最小存储开销。

原文摘要 · Abstract (English)

Representing 3D scenes from multiview images is a core challenge in computer vision and graphics, which requires both precise rendering and accurate reconstruction. Recently, 3D Gaussian Splatting (3DGS) has garnered significant attention for its high-quality rendering and fast inference speed. Yet, due to the unstructured and irregular nature of Gaussian point clouds, ensuring accurate geometry reconstruction remains difficult. Existing methods primarily focus on geometry regularization, with common approaches including primitive-based and dual-model frameworks. However, the former suffers from inherent conflicts between rendering and reconstruction, while the latter is computationally and storage-intensive. To address these challenges, we propose CarGS, a unified model leveraging Contribution-adaptive regularization to achieve simultaneous, high-quality rendering and surface reconstruction. The essence of our framework is learning adaptive contribution for Gaussian primitives by squeezing the knowledge from geometry regularization into a compact MLP. Additionally, we introduce a geometry-guided densification strategy with clues from both normals and Signed Distance Fields (SDF) to improve the capability of capturing high-frequency details. Our design improves the mutual learning of the two tasks, meanwhile its unified structure does not require separate models as in dual-model based approaches, guaranteeing efficiency. Extensive experiments demonstrate the ability to achieve state-of-the-art (SOTA) results in both rendering fidelity and reconstruction accuracy while maintaining real-time speed and minimal storage size.

3D重建高斯溅射统一框架实时渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。