arXiv:2501.07478cs.GRcs.CV2025-01被引 11

将3D高斯溅射场景转为高精度点云或带色网格,兼容主流3D软件。

3DGS-to-PC: Convert a 3D Gaussian Splatting Scene into a Dense Point Cloud or Mesh

  • 从每个高斯分布概率采样点,结合马氏距离去噪,保证点云质量
  • 重算高斯颜色以匹配点云外观,避免渲染色彩失真
  • 支持点云与网格生成,无需重新训练,可无缝接入现有流程

3D高斯溅射(3DGS)能生成高细节的3D重建,但需专用渲染器可视化。点云则广泛兼容多数3D处理软件,但将3DGS转为点云极具挑战。本文提出3DGS-to-PC,一种灵活可定制的框架,可将3DGS场景转化为高精度密集点云。通过概率采样各高斯分布的点,并用马氏距离阈值剔除极端离群点,确保形状忠实还原。每个高斯使用球谐函数适应视角变化的颜色,但单个点贡献的色彩较弱。为此,我们通过定制图像渲染重算高斯颜色,使其对所有视图中贡献最大的像素负责。该方法还支持基于预测表面高斯点的泊松曲面重建,生成带色网格,无需重新训练。该工具高度可定制,可轻松集成至现有3DGS管线,是转换3DGS数据为点云与表面格式的强大手段。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) excels at producing highly detailed 3D reconstructions, but these scenes often require specialised renderers for effective visualisation. In contrast, point clouds are a widely used 3D representation and are compatible with most popular 3D processing software, yet converting 3DGS scenes into point clouds is a complex challenge. In this work we introduce 3DGS-to-PC, a flexible and highly customisable framework that is capable of transforming 3DGS scenes into dense, high-accuracy point clouds. We sample points probabilistically from each Gaussian as a 3D density function. We additionally threshold new points using the Mahalanobis distance to the Gaussian centre, preventing extreme outliers. The result is a point cloud that closely represents the shape encoded into the 3D Gaussian scene. Individual Gaussians use spherical harmonics to adapt colours depending on view, and each point may contribute only subtle colour hints to the resulting rendered scene. To avoid spurious or incorrect colours that do not fit with the final point cloud, we recalculate Gaussian colours via a customised image rendering approach, assigning each Gaussian the colour of the pixel to which it contributes most across all views. 3DGS-to-PC also supports mesh generation through Poisson Surface Reconstruction, applied to points sampled from predicted surface Gaussians. This allows coloured meshes to be generated from 3DGS scenes without the need for re-training. This package is highly customisable and capability of simple integration into existing 3DGS pipelines. 3DGS-to-PC provides a powerful tool for converting 3DGS data into point cloud and surface-based formats.

3D重建点云生成高斯溅射网格重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。