arXiv:2409.12886cs.CV2024-09被引 17

用高斯点显式表示3D边缘,速度快且精度高。

EdgeGaussians -- 3D Edge Mapping via Gaussian Splatting

  • 将3D边缘点与方向显式建模为高斯点及其主轴。
  • 在相同精度下,训练速度比现有方法快一个数量级。
  • 适合需要高效3D边缘重建的应用场景。

由于其几何意义和在3D世界中的普遍性,边缘是计算机视觉中极为有用的基元。3D边缘由线条和曲线构成,现有方法通常以多视角图像或点云为输入进行重建。当前最先进的基于图像的方法首先学习一个3D神经隐式边缘场,然后从中采样特定等值面(0或1)上的3D边缘点以拟合边缘。然而,这类方法存在两个关键缺陷:一、由于浮点精度限制和训练不准确,精确采样等值面点不现实,实际采样范围较宽,导致点偏离真实边缘,需额外后处理;二、隐式表示计算成本高,训练耗时长。本文提出一种更简单、高效且保持精度的3D边缘映射方法。该方法显式学习3D边缘点及其方向,避免了复杂采样过程。将每个3D边缘点视为一个3D高斯点,其方向作为高斯主轴。该表示不仅几何意义明确,还兼容高斯点渲染(Gaussian Splatting)的高效优化策略。实验表明,所提方法在边缘精度和完整性上达到当前最优水平,同时训练速度提升一个数量级。代码已开源:https://github.com/kunalchelani/EdgeGaussians。

原文摘要 · Abstract (English)

With their meaningful geometry and their omnipresence in the 3D world, edges are extremely useful primitives in computer vision. 3D edges comprise of lines and curves, and methods to reconstruct them use either multi-view images or point clouds as input. State-of-the-art image-based methods first learn a 3D edge point cloud then fit 3D edges to it. The edge point cloud is obtained by learning a 3D neural implicit edge field from which the 3D edge points are sampled on a specific level set (0 or 1). However, such methods present two important drawbacks: i) it is not realistic to sample points on exact level sets due to float imprecision and training inaccuracies. Instead, they are sampled within a range of levels so the points do not lie accurately on the 3D edges and require further processing. ii) Such implicit representations are computationally expensive and require long training times. In this paper, we address these two limitations and propose a 3D edge mapping that is simpler, more efficient, and preserves accuracy. Our method learns explicitly the 3D edge points and their edge direction hence bypassing the need for point sampling. It casts a 3D edge point as the center of a 3D Gaussian and the edge direction as the principal axis of the Gaussian. Such a representation has the advantage of being not only geometrically meaningful but also compatible with the efficient training optimization defined in Gaussian Splatting. Results show that the proposed method produces edges as accurate and complete as the state-of-the-art while being an order of magnitude faster. Code is released at https://github.com/kunalchelani/EdgeGaussians.

3D重建高斯溅射边缘检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。