arXiv:2506.07670cs.CV2025-06被引 3

提升稀疏宽基线视角下的3D高斯点云渲染质量

ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Views

  • 两阶段框架:先生成3D高斯点,再用扩散模型优化
  • 相比最新方法,PSNR平均提升1 dB,尤其改善纹理缺失
  • 适合需要高质量跨视角生成的科研与工业应用

前馈式3D高斯点云渲染(3DGS)在窄基线条件下表现优异,但在宽基线场景中因纹理不足和视图间几何不一致导致性能下降。本文提出ProSplat,一种面向宽基线稀疏视角的两阶段前馈框架。第一阶段通过3DGS生成3D高斯点;第二阶段利用单步扩散模型对渲染结果进行增强,结合最大重叠参考视图注入(MORI)和距离加权对极注意力(DWEA)。MORI通过选择重叠度最高的参考视图补充缺失纹理与颜色,DWEA则利用对极约束强化几何一致性。此外,采用分治训练策略,通过联合优化使两阶段数据分布对齐。在RealEstate10K和DL3DV-10K数据集的宽基线设置下评估,ProSplat相比近期SOTA方法平均提升1 dB PSNR。

原文摘要 · Abstract (English)

Feed-forward 3D Gaussian Splatting (3DGS) has recently demonstrated promising results for novel view synthesis (NVS) from sparse input views, particularly under narrow-baseline conditions. However, its performance significantly degrades in wide-baseline scenarios due to limited texture details and geometric inconsistencies across views. To address these challenges, in this paper, we propose ProSplat, a two-stage feed-forward framework designed for high-fidelity rendering under wide-baseline conditions. The first stage involves generating 3D Gaussian primitives via a 3DGS generator. In the second stage, rendered views from these primitives are enhanced through an improvement model. Specifically, this improvement model is based on a one-step diffusion model, further optimized by our proposed Maximum Overlap Reference view Injection (MORI) and Distance-Weighted Epipolar Attention (DWEA). MORI supplements missing texture and color by strategically selecting a reference view with maximum viewpoint overlap, while DWEA enforces geometric consistency using epipolar constraints. Additionally, we introduce a divide-and-conquer training strategy that aligns data distributions between the two stages through joint optimization. We evaluate ProSplat on the RealEstate10K and DL3DV-10K datasets under wide-baseline settings. Experimental results demonstrate that ProSplat achieves an average improvement of 1 dB in PSNR compared to recent SOTA methods.

3D高斯视角合成扩散模型宽基线

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。