通过优化高斯特征提升3D重建精度,大幅减少伪影和存储需求。
FeatureGS: Eigenvalue-Feature Optimization in 3D Gaussian Splatting for Geometrically Accurate and Artifact-Reduced Reconstruction
- 引入基于特征值的几何损失项,优化高斯分布对物体表面的对齐
- 几何精度提升30%,高斯数量减少90%,有效抑制浮点伪影
- 适合需要精确几何结构与低内存占用的3D重建场景
3D高斯喷溅(3DGS)在使用3D高斯进行3D场景重建方面表现出强大能力,但其高斯中心与表面未准确对齐,且常产生浮点伪影,导致高斯数量增多、存储开销上升。为此,我们提出FeatureGS,将基于特征值的3D形状特征作为额外几何损失项引入3DGS优化过程,旨在提升几何准确性并降低局部3D邻域的结构熵。我们提出了四种基于高斯自身及邻域的‘平面性’、‘全向变异性’和‘特征熵’的几何损失形式。在DTU基准数据集15个场景上评估显示:几何精度以切比雪夫距离衡量提升30%,高斯总数减少90%,同时保持相近的光度渲染质量(峰值信噪比)。其中,基于高斯‘平面性’的损失获得最高几何精度,而基于邻域‘全向变异性’的损失最有效抑制伪影并减少高斯数量。FeatureGS实现了几何准确、伪影少、内存效率高的3D重建,使高斯中心可直接用于几何表示。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has emerged as a powerful approach for 3D scene reconstruction using 3D Gaussians. However, neither the centers nor surfaces of the Gaussians are accurately aligned to the object surface, complicating their direct use in point cloud and mesh reconstruction. Additionally, 3DGS typically produces floater artifacts, increasing the number of Gaussians and storage requirements. To address these issues, we present FeatureGS, which incorporates an additional geometric loss term based on an eigenvalue-derived 3D shape feature into the optimization process of 3DGS. The goal is to improve geometric accuracy and enhance properties of planar surfaces with reduced structural entropy in local 3D neighborhoods.We present four alternative formulations for the geometric loss term based on 'planarity' of Gaussians, as well as 'planarity', 'omnivariance', and 'eigenentropy' of Gaussian neighborhoods. We provide quantitative and qualitative evaluations on 15 scenes of the DTU benchmark dataset focusing on following key aspects: Geometric accuracy and artifact-reduction, measured by the Chamfer distance, and memory efficiency, evaluated by the total number of Gaussians. Additionally, rendering quality is monitored by Peak Signal-to-Noise Ratio. FeatureGS achieves a 30 % improvement in geometric accuracy, reduces the number of Gaussians by 90 %, and suppresses floater artifacts, while maintaining comparable photometric rendering quality. The geometric loss with 'planarity' from Gaussians provides the highest geometric accuracy, while 'omnivariance' in Gaussian neighborhoods reduces floater artifacts and number of Gaussians the most. This makes FeatureGS a strong method for geometrically accurate, artifact-reduced and memory-efficient 3D scene reconstruction, enabling the direct use of Gaussian centers for geometric representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。