arXiv:2503.16338cs.CV2025-03NeurIPS被引 30

用图网络建模多视角高斯关系,提升3D重建效率与泛化性

Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Images

  • 构建高斯图捕捉多视角间高斯点的关联关系
  • 减少40%以上高斯数量,渲染速度更快且图像质量更优
  • 适合需要高效通用3D重建的工业级应用

3D高斯泼溅(3DGS)在新视角合成上表现优异。传统方法需逐场景优化,近期一些前馈方法通过可学习网络生成像素对齐的高斯表示,具备跨场景泛化能力。然而这些方法简单拼接多视角高斯点,未充分建模不同图像间高斯的关联,导致伪影和内存开销。本文提出高斯图网络(GGN),通过构建高斯图建模多视角高斯组间的关联关系。为支持高斯层级的消息传递,我们重构了基础图运算以实现高斯特征融合。此外设计高斯池化层,聚合多种高斯组实现高效表示。在大规模RealEstate10K和ACID数据集上的实验表明,相比当前最优方法,本模型使用更少高斯点,在保持更高图像质量的同时实现更快渲染速度。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis performance. While conventional methods require per-scene optimization, more recently several feed-forward methods have been proposed to generate pixel-aligned Gaussian representations with a learnable network, which are generalizable to different scenes. However, these methods simply combine pixel-aligned Gaussians from multiple views as scene representations, thereby leading to artifacts and extra memory cost without fully capturing the relations of Gaussians from different images. In this paper, we propose Gaussian Graph Network (GGN) to generate efficient and generalizable Gaussian representations. Specifically, we construct Gaussian Graphs to model the relations of Gaussian groups from different views. To support message passing at Gaussian level, we reformulate the basic graph operations over Gaussian representations, enabling each Gaussian to benefit from its connected Gaussian groups with Gaussian feature fusion. Furthermore, we design a Gaussian pooling layer to aggregate various Gaussian groups for efficient representations. We conduct experiments on the large-scale RealEstate10K and ACID datasets to demonstrate the efficiency and generalization of our method. Compared to the state-of-the-art methods, our model uses fewer Gaussians and achieves better image quality with higher rendering speed.

3D重建高斯泼溅图神经网络高效建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。