通过熵值优化邻域密度,提升3D高斯溅射的几何精度与渲染质量。
EntON: Eigenentropy-Optimized Neighborhood Densification in 3D Gaussian Splatting
- 基于邻域协方差矩阵特征熵,动态判断是否分裂或删除高斯点
- 在DTU和TUM2TWIN数据集上提升几何精度33%,渲染质量7%
- 减少50%高斯点数,训练时间缩短23%,适合追求效率的3D重建场景
我们提出一种新型的特征熵优化邻域稠密化策略EntON,用于3D高斯溅射(3DGS)中的几何精确且高质量的3D重建。标准3DGS生成的高斯点中心与物体表面对齐不佳,而聚焦表面的方法常牺牲光照准确性。与依赖视图空间位置梯度的传统策略不同,本方法引入几何感知机制:计算每个高斯点邻域内k近邻的协方差矩阵特征值对应的特征熵,量化局部结构有序性。该熵值被整合进交替优化框架中:优化过程中交替执行 (i) 基于梯度的稠密化以精修区域,(ii) 特征熵感知稠密化,优先在低熵(有序、平坦)区域分裂以捕捉精细几何细节,并剔除高熵(无序、球形)区域的高斯点。在小型DTU和大型TUM2TWIN两个基准数据集上的定量与定性评估表明,该策略使几何精度最高提升33%,渲染质量提升7%,同时将高斯点数量减少50%,训练时间降低23%。整体上,EntON在几何精度、渲染质量与效率之间实现了良好平衡,避免了不必要的场景膨胀。
原文摘要 · Abstract (English)
We present a novel Eigenentropy-optimized neighboorhood densification strategy EntON in 3D Gaussian Splatting (3DGS) for geometrically accurate and high-quality rendered 3D reconstruction. While standard 3DGS produces Gaussians whose centers and surfaces are poorly aligned with the underlying object geometry, surface-focused reconstruction methods frequently sacrifice photometric accuracy. In contrast to the conventional densification strategy, which relies on the magnitude of the view-space position gradient, our approach introduces a geometry-aware strategy to guide adaptive splitting and pruning. Specifically, we compute the 3D shape feature Eigenentropy from the eigenvalues of the covariance matrix in the k-nearest neighborhood of each Gaussian center, which quantifies the local structural order. These Eigenentropy values are integrated into an alternating optimization framework: During the optimization process, the algorithm alternates between (i) standard gradient-based densification, which refines regions via view-space gradients, and (ii) Eigenentropy-aware densification, which preferentially densifies Gaussians in low-Eigenentropy (ordered, flat) neighborhoods to better capture fine geometric details on the object surface, and prunes those in high-Eigenentropy (disordered, spherical) regions. We provide quantitative and qualitative evaluations on two benchmark datasets: small-scale DTU dataset and large-scale TUM2TWIN dataset, covering man-made objects and urban scenes. Experiments demonstrate that our Eigenentropy-aware alternating densification strategy improves geometric accuracy by up to 33% and rendering quality by up to 7%, while reducing the number of Gaussians by up to 50% and training time by up to 23%. Overall, EnTON achieves a favorable balance between geometric accuracy, rendering quality and efficiency by avoiding unnecessary scene expansion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。