arXiv:2604.26262cs.CV2026-04中稿 · CVPR

让3D高斯点云自动分区域,还能保持细节真实

Semantic Foam: Unifying Spatial and Semantic Scene Decomposition

  • 用空间网格划分+语义特征场,直接控制每块区域
  • 在多个数据集上物体分割准确率超越当前最佳方法
  • 适合需要交互式编辑的实时3D应用开发人员

现代场景重建方法如3D高斯溅射可在实时速度下实现照片级真实感新视角合成,但其在交互式图形应用中的采用受限。主要瓶颈在于与这些表示形式的交互难度远高于传统人工制作的3D资产。尽管此前研究尝试对这类模型施加语义分解,但在分割质量和一致性方面仍存在显著挑战。为此,我们提出Semantic Foam,扩展近期提出的Radiant Foam表示以用于语义分解任务。该方法将Radiant Foam的Voronoi网格天然的空间体积分解与细胞级别的显式语义特征场相结合。这种显式结构支持直接的空间正则化,可有效避免由遮挡或跨视角不一致监督引发的伪影——这是其他基于点的表示常见的问题。实验结果表明,我们的方法在物体级别分割性能上达到或优于目前最优方法,如Gaussian Grouping和SAGA。

原文摘要 · Abstract (English)

Modern scene reconstruction methods, such as 3D Gaussian Splatting, deliver photo-realistic novel view synthesis at real-time speeds, yet their adoption in interactive graphics applications has been limited. A major bottleneck is the difficulty of interacting with these representations compared to traditional, human-authored 3D assets. While previous research has attempted to impose semantic decomposition on these models, significant challenges remain regarding segmentation quality and consistency. To address this, we introduce Semantic Foam, extending the recently proposed Radiant Foam representations to semantic decomposition tasks. Our approach integrates the natural spatial volumetric decomposition of Radiant Foam's Voronoi mesh with an explicit semantic feature field parameterized at the cell level. This explicit structure enables direct spatial regularization, which prevents artifacts caused by occlusion or inconsistent supervision across views - common pitfalls for other point-based representations. Experimental results show that our method achieves comparable or superior object-level segmentation performance compared to state-of-the-art methods like Gaussian Grouping and SAGA.

3D重建语义分割高斯溅射实时渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。