arXiv:2508.02261cs.CV2025-08AAAI被引 8

用深度引导初始化和分离聚合,提升单目语义场景补全的精度与效率

SplatSSC: Decoupled Depth-Guided Gaussian Splatting for Semantic Scene Completion

  • 基于深度图生成稀疏初始高斯点,替代随机初始化
  • 在Occ-ScanNet上实现6.3%的IoU提升,内存和延迟降低超9.3%
  • 适合追求高效高精度3D场景重建的研究者与开发者

单目3D语义场景补全(SSC)旨在从单张图像中推断出稠密的几何与语义信息,具有挑战性但前景广阔。现有以物体为中心的方法虽利用灵活的3D高斯原语提升了效率,但仍依赖大量随机初始化的原语,导致初始化低效及异常原语引入错误伪影。本文提出SplatSSC,通过深度引导初始化策略与原理化的高斯聚合器解决上述问题。该方法采用包含分组多尺度融合(GMF)模块的专用深度分支,整合多尺度图像与深度特征,生成稀疏但具代表性的初始高斯原语。为抑制异常原语带来的噪声,设计了解耦高斯聚合器(DGA),在高斯到体素投射过程中分离几何与语义预测,增强鲁棒性。结合专用概率尺度损失,本方法在Occ-ScanNet数据集上达到当前最优性能,相比之前方法提升超过6.3%的IoU与4.1%的mIoU,同时将延迟与内存开销降低超过9.3%。

原文摘要 · Abstract (English)

Monocular 3D Semantic Scene Completion (SSC) is a challenging yet promising task that aims to infer dense geometric and semantic descriptions of a scene from a single image. While recent object-centric paradigms significantly improve efficiency by leveraging flexible 3D Gaussian primitives, they still rely heavily on a large number of randomly initialized primitives, which inevitably leads to 1) inefficient primitive initialization and 2) outlier primitives that introduce erroneous artifacts. In this paper, we propose SplatSSC, a novel framework that resolves these limitations with a depth-guided initialization strategy and a principled Gaussian aggregator. Instead of random initialization, SplatSSC utilizes a dedicated depth branch composed of a Group-wise Multi-scale Fusion (GMF) module, which integrates multi-scale image and depth features to generate a sparse yet representative set of initial Gaussian primitives. To mitigate noise from outlier primitives, we develop the Decoupled Gaussian Aggregator (DGA), which enhances robustness by decomposing geometric and semantic predictions during the Gaussian-to-voxel splatting process. Complemented with a specialized Probability Scale Loss, our method achieves state-of-the-art performance on the Occ-ScanNet dataset, outperforming prior approaches by over 6.3% in IoU and 4.1% in mIoU, while reducing both latency and memory cost by more than 9.3%.

3D重建语义补全高斯溅射深度引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。