通过结构先验提升稀疏视角3D高斯点云重建质量
COSMOS: Coherent Supergaussian Modeling with Spatial Priors for Sparse-View 3D Splatting
- 用局部几何与外观特征定义超高斯分组,引入3D结构先验
- 融合全局与局部注意力机制,提升重建一致性
- 无需深度监督,在稀疏视图下表现优于现有方法
3D高斯点阵(3DGS)作为一种新兴的3D重建方法,提供显式的点基表示并支持高质量实时渲染。然而在稀疏输入视角下训练时,3DGS容易过拟合并导致结构退化,影响新视角泛化能力。这主要源于其优化仅依赖光度损失,缺乏3D结构先验。为此,本文提出相干超高斯建模与空间先验方法(COSMOS)。受3D分割中“超点”概念启发,COSMOS基于局部几何线索和外观特征重新定义高斯点的超群组,引入3D结构先验。通过跨超群组的全局自注意力与个体高斯间的稀疏局部注意力,整合全局与局部空间信息。这些结构感知特征用于预测高斯属性,实现更一致的3D重建。此外,基于超群组的分组机制施加组内位置正则化,维持结构连贯性并抑制漂浮点,从而增强稀疏视图下的训练稳定性。在Blender和DTU数据集上的实验表明,COSMOS在无外部深度监督的情况下,优于当前最优方法。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has recently emerged as a promising approach for 3D reconstruction, providing explicit, point-based representations and enabling high-quality real time rendering. However, when trained with sparse input views, 3DGS suffers from overfitting and structural degradation, leading to poor generalization on novel views. This limitation arises from its optimization relying solely on photometric loss without incorporating any 3D structure priors. To address this issue, we propose Coherent supergaussian Modeling with Spatial Priors (COSMOS). Inspired by the concept of superpoints from 3D segmentation, COSMOS introduces 3D structure priors by newly defining supergaussian groupings of Gaussians based on local geometric cues and appearance features. To this end, COSMOS applies inter group global self-attention across supergaussian groups and sparse local attention among individual Gaussians, enabling the integration of global and local spatial information. These structure-aware features are then used for predicting Gaussian attributes, facilitating more consistent 3D reconstructions. Furthermore, by leveraging supergaussian-based grouping, COSMOS enforces an intra-group positional regularization to maintain structural coherence and suppress floaters, thereby enhancing training stability under sparse-view conditions. Our experiments on Blender and DTU show that COSMOS surpasses state-of-the-art methods in sparse-view settings without any external depth supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。