arXiv:2607.14470cs.CVcs.RO2026-07

用几何方法快速高效重建3D表面,内存占用极低。

G$^2$SR: Geometric Methods for Fast and Memory-Efficient Gaussian-based Surface Reconstruction

论文配图:G$^2$SR: Geometric Methods for Fast and Memory-Efficient Gaussian-based Surface Reconstruction
图 1 · 摘自论文原文
  • 基于多视角几何关系,直接解析推导3D点云,无需复杂网络。
  • 每秒处理69-89次重建,仅需203MB显存,速度快且内存小。
  • 适合移动设备上实时3D建模,尤其适用于机器人在线导航。

少视角表面重建从少量带姿态的RGB图像中恢复场景可见表面,为机器人在线探索与交互提供3D模型。在移动端,重建需快速、几何准确且内存占用小,以保障安全高效运行。3D高斯泼溅(3DGS)虽能提供高保真场景表示,但仅从少数视角构建时存在病态问题:多个不同表面可产生相同图像,导致传统光度法易出现“漂浮物”伪影。端到端方法通过大型(通常为Transformer结构)网络回归高斯点,计算和内存开销大,且泛化能力差。本文提出G2SR,利用任务中的良好定义核心:给定跨视角2D高斯点对应关系,其3D位置可由多视图几何解析求解。G2SR采用轻量神经前端检测并追踪图像平面上的2D高斯点,再通过解析后端将每个点三角化为度量尺度的3D高斯点。在ScanNet、Replica和DTU数据集上,G2SR在几何精度上达到或超越现有端到端方法,对2~3视图输入(分辨率384×512),每秒可完成69-89次重建,仅需203MB GPU内存(减少5-107倍),为在线高斯基表面重建提供了实用路径。

原文摘要 · Abstract (English)

Few-view surface reconstruction recovers the visible surfaces of a scene from a few posed RGB images, providing the 3D models that robots need to explore and interact online. On mobile platforms, the reconstruction must be fast and geometrically accurate while keeping a small memory footprint to ensure safe and efficient operation. 3D Gaussian Splatting (3DGS) offers a high-fidelity scene representation, but building it from a few views is ill-posed, as many distinct surfaces reproduce the same images, making traditional photometric methods prone to "floater" artifacts. End-to-end methods resolve the ambiguity by regressing splats with large, usually Transformer-based, networks that require heavy compute and memory while generalizing poorly to new scenes. We propose G2SR, which exploits a well-posed core of the task: given cross-view 2D splat correspondences, 3D splats follow analytically from multi-view geometry. G2SR employs a lightweight neural frontend to detect and track 2D Gaussian splats on the image plane and an analytic backend to triangulate each into a metric-scale 3D splat. On ScanNet, Replica, and DTU, G2SR matches or exceeds the geometric accuracy of state-of-the-art end-to-end methods while running at 69-89 reconstructions per second within 203 MB of GPU memory (5-107x less) for 2- and 3-view inputs at 384 x 512 resolution, offering a practical path to online Gaussian-based surface reconstruction.

3D重建高斯泼溅轻量化几何推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。