用体素对齐取代像素对齐,提升3D高斯点云渲染质量与多视角一致性。
VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Prediction
- 以体素网格为单位预测高斯分布,避免2D特征匹配误差
- 在多个基准上达到顶尖性能,渲染结果更真实一致
- 适合需要高质量3D重建和稳定视图合成的研究者
前馈式3D高斯点云(3DGS)已成为新颖视图合成的有效方法。现有方法主要依赖于像素对齐的高斯预测范式,即每个2D像素映射到一个3D高斯。我们重新思考这一普遍采用的设定,发现其存在固有缺陷:重建模型高度依赖输入视角数量,导致密度分布偏向特定视角,并在源视角存在遮挡或纹理不足时引入对齐误差。为此,我们提出VolSplat,一种新的多视角前馈范式,将像素对齐替换为体素对齐的高斯。通过直接从预测的3D体素网格中生成高斯,它克服了像素对齐对易出错的2D特征匹配的依赖,确保多视角一致性。同时,可根据3D场景复杂度自适应控制密度,生成更精确的高斯,提升几何一致性与新视角渲染质量。在多个常用基准上的实验表明,VolSplat实现最先进性能,且结果更合理、视角间更一致。视频演示、代码与训练模型已发布于项目主页:https://lhmd.top/volsplat。
原文摘要 · Abstract (English)
Feed-forward 3D Gaussian Splatting (3DGS) has emerged as a highly effective solution for novel view synthesis. Existing methods predominantly rely on a \emph{pixel-aligned} Gaussian prediction paradigm, where each 2D pixel is mapped to a 3D Gaussian. We rethink this widely adopted formulation and identify several inherent limitations: it renders the reconstructed 3D models heavily dependent on the number of input views, leads to view-biased density distributions, and introduces alignment errors, particularly when source views contain occlusions or low texture. To address these challenges, we introduce VolSplat, a new multi-view feed-forward paradigm that replaces pixel alignment with voxel-aligned Gaussians. By directly predicting Gaussians from a predicted 3D voxel grid, it overcomes pixel alignment's reliance on error-prone 2D feature matching, ensuring robust multi-view consistency. Furthermore, it enables adaptive control over density based on 3D scene complexity, yielding more faithful Gaussians, improved geometric consistency, and enhanced novel-view rendering quality. Experiments on widely used benchmarks demonstrate that VolSplat achieves state-of-the-art performance, while producing more plausible and view-consistent results. The video results, code and trained models are available on our project page: https://lhmd.top/volsplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。