动态分配高斯点,让3D重建更精准省资源。
SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis

- 按区域动态分配高斯点数,而非固定数量
- 用更少高斯点实现更好渲染效果,细节更真实
- 适合需要高效、通用新视角生成的场景
通用新视角合成旨在无需场景优化的情况下,从未校准输入图像中渲染未见视角。基于3D高斯泼溅的前馈方法已取得良好效率与渲染质量。然而,多数方法对每个像素或体素分配固定数量的高斯点,忽略了真实场景的空间复杂度差异。这种均匀分配在平滑区域浪费资源,在精细结构和高频细节处又容量不足。为此,我们提出SplatWeaver,一种可前馈动态分配高斯点数的通用新视角合成框架。SplatWeaver引入基数高斯专家与像素级路由机制:每个专家专精生成0至M个高斯点,路由机制协同决定各空间位置应分配的点数。同时,结合高频先验与引导模块及路由正则化,稳定专家选择并促进复杂度感知分配。利用高频线索,路由过程鼓励在纹理与精细结构区域增加高斯点,抑制平滑区域冗余。大量实验表明,SplatWeaver在多种场景下持续优于现有方法,以更少高斯点实现更逼真的新视角渲染。
原文摘要 · Abstract (English)
Generalizable novel view synthesis aims to render unseen views from uncalibrated input images without requiring per-scene optimization. Recent feed-forward approaches based on 3D Gaussian Splatting have achieved promising efficiency and rendering quality. However, most of them assign a fixed number of Gaussians to each pixel or voxel, ignoring the spatially varying complexity of real-world scenes. Such uniform allocation often wastes Gaussian primitives in smooth regions while providing insufficient capacity for fine structures, complex geometry, and high-frequency details. This motivates us to predict region-dependent primitive cardinalities rather than impose a fixed primitive budget everywhere, enabling a more expressive 3D scene representation. Therefore, we propose SplatWeaver, a generalizable novel view synthesis framework that is able to dynamically allocate Gaussian primitives over different regions in a feed-forward manner. Specifically, SplatWeaver introduces cardinality Gaussian experts and a pixel-level routing scheme, wherein each expert specializes in producing a specific number of primitives from 0 to M, and the routing scheme coordinates these experts to adaptively determine how many Gaussian primitives should be allocated to each spatial location. Moreover, SplatWeaver incorporates a high-frequency prior with attendant guidance module and routing regularization to stabilize expert selection and promote complexity-aware allocation. By leveraging high-frequency cues, the routing process is encouraged to assign more Gaussian primitives to fine structures and textured regions, while suppressing redundancy in smooth areas. Extensive experiments across diverse scenarios show that SplatWeaver consistently outperforms state-of-the-art methods, delivering more faithful novel-view renderings with fewer Gaussian primitives. Project Page: https://yecongwan.github.io/SplatWeaver/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。