arXiv:2506.08710cs.CV2025-06NeurIPS被引 16

构建首个大规模3D语言高斯点云评测基准,验证通用方法优势。

SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting

  • 在1060个场景的3D空间中系统评估三类语言高斯点云方法
  • 通用方法在新场景上实现快速推理与更优分割性能
  • 发布4.9万场景的GaussianWorld-49K数据集,支持强数据先验学习

3D高斯点云(3DGS)是高效表达场景几何、外观和语义的编码方式。将语言信息融入3D场景有助于提升3D场景理解能力。现有语言高斯点云研究分为三类:(i)基于每场景优化,(ii)免优化,(iii)可泛化方法。但多数仅在少数场景的2D渲染视图上评估,且视角接近训练视图,限制了对整体3D理解能力的考察。为此,我们提出首个大规模基准,直接在3D空间中系统评估三类方法,覆盖1060个场景,涵盖三个室内数据集和一个室外数据集。实验表明,通用范式显著优于其他方法,尤其在突破场景特定限制、实现新场景快速前向推理及取得更优分割性能方面。我们进一步推出精心构建的GaussianWorld-49K数据集,包含约4.9万个来自多源的室内外场景,验证了通用方法可有效利用强数据先验。代码、基准与数据集已开源:https://scenesplatpp.gaussianworld.ai/

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding. Current Language Gaussian Splatting line of work fall into three main groups: (i) per-scene optimization-based, (ii) per-scene optimization-free, and (iii) generalizable approach. However, most of them are evaluated only on rendered 2D views of a handful of scenes and viewpoints close to the training views, limiting ability and insight into holistic 3D understanding. To address this gap, we propose the first large-scale benchmark that systematically assesses these three groups of methods directly in 3D space, evaluating on 1060 scenes across three indoor datasets and one outdoor dataset. Benchmark results demonstrate a clear advantage of the generalizable paradigm, particularly in relaxing the scene-specific limitation, enabling fast feed-forward inference on novel scenes, and achieving superior segmentation performance. We further introduce GaussianWorld-49K a carefully curated 3DGS dataset comprising around 49K diverse indoor and outdoor scenes obtained from multiple sources, with which we demonstrate the generalizable approach could harness strong data priors. Our codes, benchmark, and datasets are released at https://scenesplatpp.gaussianworld.ai/.

3D高斯场景理解语言引导数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。