arXiv:2504.05740cs.GRcs.CV2025-04被引 4

通过分阶段优化,让3D高斯点云更紧凑且细节丰富。

Micro-splatting: Multistage Isotropy-informed Covariance Regularization Optimization for High-Fidelity 3D Gaussian Splatting

  • 分两阶段动态生长与精简点云,只在复杂区域增加点。
  • 点数减少60%,训练时间缩短20%,仍保持顶级画质。
  • 无需后处理或额外网络,适合实时渲染应用。

高保真3D高斯点云方法虽能捕捉精细纹理,但常忽视模型紧凑性,导致点云数量庞大、内存占用高、训练耗时长且需复杂后处理。本文提出Micro-Splatting:一种统一的训练中流水线,可在不依赖后处理或辅助神经模块的前提下,同时实现视觉细节保留与模型复杂度大幅降低。第一阶段(生长)引入基于迹的协方差正则化,维持近似各向同性的高斯分布,缓解高频区域的低通滤波效应,并提升球谐函数色彩拟合能力;结合梯度引导的自适应加密策略,仅在视觉复杂区域细分点云,平滑区域保持稀疏。第二阶段(精简)采用简单的透明度重要性评分剔除低贡献点,并通过轻量级空间与特征阈值合并冗余邻点,生成紧凑而细节丰富的模型。在四个物体中心基准上,Micro-Splatting将点数和模型大小减少最多60%,训练时间缩短20%,同时在实时渲染中达到或超越当前最优的PSNR、SSIM和LPIPS指标。结果表明,该方法在单一端到端框架下实现了紧凑性与高保真度的平衡。

原文摘要 · Abstract (English)

High-fidelity 3D Gaussian Splatting methods excel at capturing fine textures but often overlook model compactness, resulting in massive splat counts, bloated memory, long training, and complex post-processing. We present Micro-Splatting: Two-Stage Adaptive Growth and Refinement, a unified, in-training pipeline that preserves visual detail while drastically reducing model complexity without any post-processing or auxiliary neural modules. In Stage I (Growth), we introduce a trace-based covariance regularization to maintain near-isotropic Gaussians, mitigating low-pass filtering in high-frequency regions and improving spherical-harmonic color fitting. We then apply gradient-guided adaptive densification that subdivides splats only in visually complex regions, leaving smooth areas sparse. In Stage II (Refinement), we prune low-impact splats using a simple opacity-scale importance score and merge redundant neighbors via lightweight spatial and feature thresholds, producing a lean yet detail-rich model. On four object-centric benchmarks, Micro-Splatting reduces splat count and model size by up to 60% and shortens training by 20%, while matching or surpassing state-of-the-art PSNR, SSIM, and LPIPS in real-time rendering. These results demonstrate that Micro-Splatting delivers both compactness and high fidelity in a single, efficient, end-to-end framework.

3D重建高斯点云高效渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。