用新型点表示加速3D网格重建,速度提升25%,内存减少30%。
DyGASR: Dynamic Generalized Exponential Splatting with Surface Alignment for Accelerated 3D Mesh Reconstruction
- 改用广义指数函数替代传统高斯点,减少粒子数量并动态优化信号表示
- 引入表面正则化使点云法向与场景表面垂直,解决网格重建失败问题
- 动态调整分辨率,训练初期低分辨率逐步提升,显著加快重建速度
近年来,3D高斯点阵(3DGS)在视图合成质量和渲染速度方面取得显著进展,极大提升了辐射场重建效果。然而,从海量微小3D高斯点中提取网格仍面临巨大挑战,主要源于高斯点数量庞大且其固有的低通特性难以表达锐利信号。为此,我们提出DyGASR,采用广义指数函数替代传统3D高斯,减少粒子数量并动态优化信号表征。此外,发现仅使用广义指数点阵(GES)重建网格常失败,因分布中心可能未精确对齐场景表面。为此,借鉴Sugar方法,引入广义表面正则化(GSR),将每个点云的最小缩放向量设为零,并确保法向垂直于表面,从而提升后续泊松表面网格重建效果。同时,提出一种动态分辨率调节策略,采用余弦调度在训练阶段由低到高逐步提升图像分辨率,避免全程保持全分辨率,显著提升重建速度。大量实验表明,该方法在多个场景数据集上优于现有3DGS基网格重建方法,实现25%的速度提升和30%的内存降低。
原文摘要 · Abstract (English)
Recent advancements in 3D Gaussian Splatting (3DGS), which lead to high-quality novel view synthesis and accelerated rendering, have remarkably improved the quality of radiance field reconstruction. However, the extraction of mesh from a massive number of minute 3D Gaussian points remains great challenge due to the large volume of Gaussians and difficulty of representation of sharp signals caused by their inherent low-pass characteristics. To address this issue, we propose DyGASR, which utilizes generalized exponential function instead of traditional 3D Gaussian to decrease the number of particles and dynamically optimize the representation of the captured signal. In addition, it is observed that reconstructing mesh with Generalized Exponential Splatting(GES) without modifications frequently leads to failures since the generalized exponential distribution centroids may not precisely align with the scene surface. To overcome this, we adopt Sugar's approach and introduce Generalized Surface Regularization (GSR), which reduces the smallest scaling vector of each point cloud to zero and ensures normal alignment perpendicular to the surface, facilitating subsequent Poisson surface mesh reconstruction. Additionally, we propose a dynamic resolution adjustment strategy that utilizes a cosine schedule to gradually increase image resolution from low to high during the training stage, thus avoiding constant full resolution, which significantly boosts the reconstruction speed. Our approach surpasses existing 3DGS-based mesh reconstruction methods, as evidenced by extensive evaluations on various scene datasets, demonstrating a 25\% increase in speed, and a 30\% reduction in memory usage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。