arXiv:2412.13547cs.CV2024-12中稿 · CVPR被引 17

提速3D高斯拟合,4K图像秒级渲染。

Turbo-GS: Accelerating 3D Gaussian Fitting for High-Quality Radiance Fields

  • 用稀疏采样渲染减少计算开销,只处理部分像素。
  • 训练速度提升数倍,4K场景仅需几分钟完成拟合。
  • 适合需要快速高质量3D重建的研究与工业应用。

新视角合成在计算机视觉中至关重要,应用于3D重建、混合现实和机器人等领域。近年来,3D高斯喷溅(3DGS)成为顶尖方案,可在实时条件下实现高质量新视角生成。然而,3DGS模型训练仍十分缓慢,尤其在高分辨率图像下,通常需要数小时才能拟合包含200个视图的场景。本文旨在加速拟合过程,通过降低计算开销并提升学习效率。具体地,提出一种稀疏渲染技术,仅渲染图像子集以显著减少计算成本;设计一种收敛感知预算控制机制,平衡新增高斯分布与现有分布优化之间的关系;同时引入位置与外观误差联合指导细化过程,提升细化效率并防止梯度消失。实验表明,本方法可在保持甚至提升新视角渲染质量的前提下,实现4K分辨率下的快速拟合。大量实验验证了该方法在优化速度上显著优于现有方法,且渲染保真度优异。

原文摘要 · Abstract (English)

Novel-view synthesis plays a crucial role in computer vision with applications in 3D reconstruction, mixed reality, and robotics. Recent approaches, such as 3D Gaussian Splatting (3DGS), have emerged as state-of-the-art solutions, offering high-quality novel view synthesis in real time. However, training 3DGS models remains slow, particularly for high-resolution images, often requiring hours to fit a scene with 200 views. In this work, we aim to accelerate the fitting process by reducing computational overhead and improving learning efficiency. Specifically, we introduce a dilated rendering technique that renders only a subset of pixels instead of the full image, significantly reducing computational costs. To enhance learning efficiency, we develop a convergence-aware budget control mechanism that balances the addition of new Gaussians with the optimization of existing ones. Additionally, to improve densification efficiency and prevent gradient vanishing, we incorporate both positional and appearance errors to improve the effectiveness of densification. With these improvements, we achieve fast 4K-resolution fitting while maintaining, or even improving, novel view rendering quality. Extensive experiments demonstrate that our method achieves significantly faster optimization than existing approaches while preserving high rendering fidelity.

3D重建高斯喷溅实时渲染加速训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。