通过让已收敛的高斯点进入休眠状态,实现单目3D重建的快速训练。
GSta: Efficient Training Scheme with Siestaed Gaussians for Monocular 3D Scene Reconstruction
- 动态检测并冻结已收敛的高斯点,减少无效计算。
- 训练速度提升5倍,磁盘占用缩小16倍,峰值内存减半。
- 适用于机器人等对效率要求高的实时3D重建场景。
高斯点渲染(Gaussian Splatting, GS)因其快速收敛、高质量视图生成而广受欢迎,但其存储和内存开销大,训练速度仍落后于基于哈希网格的辐射场方法(如Instant-NGP),限制了在机器人场景中的部署。本文提出GSta,基于位置与颜色梯度范数动态识别已收敛的高斯点,将其置于休眠状态并停止更新。同时引入基于子集图像PSNR的早停机制,并结合学习率调度器,显著提升训练效率。在保持高质量的同时,实现更快收敛速度、更低内存与存储需求。实验表明,结合Trick-GS后,相比原始GS,训练速度提升5倍,磁盘占用减少16倍,峰值内存降低50%,且精度相当。
原文摘要 · Abstract (English)
Gaussian Splatting (GS) is a popular approach for 3D reconstruction, mostly due to its ability to converge reasonably fast, faithfully represent the scene and render (novel) views in a fast fashion. However, it suffers from large storage and memory requirements, and its training speed still lags behind the hash-grid based radiance field approaches (e.g. Instant-NGP), which makes it especially difficult to deploy them in robotics scenarios, where 3D reconstruction is crucial for accurate operation. In this paper, we propose GSta that dynamically identifies Gaussians that have converged well during training, based on their positional and color gradient norms. By forcing such Gaussians into a siesta and stopping their updates (freezing) during training, we improve training speed with competitive accuracy compared to state of the art. We also propose an early stopping mechanism based on the PSNR values computed on a subset of training images. Combined with other improvements, such as integrating a learning rate scheduler, GSta achieves an improved Pareto front in convergence speed, memory and storage requirements, while preserving quality. We also show that GSta can improve other methods and complement orthogonal approaches in efficiency improvement; once combined with Trick-GS, GSta achieves up to 5x faster training, 16x smaller disk size compared to vanilla GS, while having comparable accuracy and consuming only half the peak memory. More visualisations are available at https://anilarmagan.github.io/SRUK-GSta.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。