arXiv:2509.06685cs.CV2025-09

用单目相机+惯性传感器实现大场景高精度3D高斯点云重建,效率更高。

MOGS: Monocular Object-guided Gaussian Splatting in Large Scenes

  • 基于视觉惯性里程计构建稀疏度量点,结合物体语义先验生成稠密深度
  • 在公开数据集上训练时间减少30.4%,内存降低19.8%,效果媲美激光雷达
  • 适合自动驾驶等需快速部署的大场景3D重建任务

最近的3D高斯点云(3DGS)技术实现了惊人的照片级真实感,将其扩展至大场景为自动驾驶等应用中的语义推理与预测带来新机遇。当前主流大场景系统多基于激光雷达(LiDAR)管道,依赖高成本的多通道传感器,其密集点云对内存和计算造成压力,限制了可扩展性、车队部署与优化速度。本文提出MOGS,一种单目3DGS框架,以物体引导的度量稠密深度替代主动式激光雷达深度,该深度由稀疏视觉-惯性(VI)结构光运动(SfM)线索推导而来。核心思想是利用图像语义假设每个物体的形状先验,通过稀疏但度量可靠的SfM点锚定,并将度量约束传播至整个物体以生成稠密深度。针对物体内部SfM覆盖不足及跨物体几何不一致两大挑战,MOGS引入:(1) 多尺度形状共识模块,自适应融合小片段为受SfM支持的粗粒度物体并拟合参数化形状模型;(2) 跨物体深度精修模块,在组合目标函数(几何一致性、先验锚定、边缘感知平滑性)下优化每像素深度。在公开数据集上的实验表明,仅使用低成本的VI传感器套件,MOGS将训练时间最多降低30.4%,内存消耗减少19.8%,同时在大场景中实现与昂贵激光雷达方法相当的高质量渲染效果。

原文摘要 · Abstract (English)

Recent advances in 3D Gaussian Splatting (3DGS) deliver striking photorealism, and extending it to large scenes opens new opportunities for semantic reasoning and prediction in applications such as autonomous driving. Today's state-of-the-art systems for large scenes primarily originate from LiDAR-based pipelines that utilize long-range depth sensing. However, they require costly high-channel sensors whose dense point clouds strain memory and computation, limiting scalability, fleet deployment, and optimization speed. We present MOGS, a monocular 3DGS framework that replaces active LiDAR depth with object-anchored, metrized dense depth derived from sparse visual-inertial (VI) structure-from-motion (SfM) cues. Our key idea is to exploit image semantics to hypothesize per-object shape priors, anchor them with sparse but metrically reliable SfM points, and propagate the resulting metric constraints across each object to produce dense depth. To address two key challenges, i.e., insufficient SfM coverage within objects and cross-object geometric inconsistency, MOGS introduces (1) a multi-scale shape consensus module that adaptively merges small segments into coarse objects best supported by SfM and fits them with parametric shape models, and (2) a cross-object depth refinement module that optimizes per-pixel depth under a combinatorial objective combining geometric consistency, prior anchoring, and edge-aware smoothness. Experiments on public datasets show that, with a low-cost VI sensor suite, MOGS reduces training time by up to 30.4% and memory consumption by 19.8%, while achieving high-quality rendering competitive with costly LiDAR-based approaches in large scenes.

3D重建单目视觉高斯点云自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。