arXiv:2602.22571cs.CV2026-02被引 3

用迭代前向更新实现稀疏视角下高效高质3D重建,保持秒级推理速度。

GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Views

  • 通过前向残差更新逐步优化3D场景,无需反向传播。
  • 在多个数据集上提升PSNR达+2.1 dB,保持秒级推理时间。
  • 无需相机位姿或测试时优化,适合实时应用与生成先验注入。

前向式3D重建相比逐场景优化具有显著推理加速优势,但现有方法在稀疏视图下仍存在性能瓶颈,尤其面对域外数据时表现不佳,且引入生成先验后推理时间常失控。根源在于现有前向流程采用一次性预测范式:模型容量受限、缺乏推理时精炼能力,难以持续融合生成先验。本文提出GIFSplat,一种纯前向的迭代优化框架,用于从稀疏无姿态视图重建3D高斯点云。通过少量仅前向传播的残差更新,基于渲染证据逐步优化场景,兼顾效率与质量。同时,将冻结扩散先验以高斯级提示形式提炼至增强的新视角渲染中,不依赖梯度回传或视图集持续扩张,实现每场景生成先验适配的同时保持前向效率。在DL3DV、RealEstate10K和DTU数据集上,GIFSplat始终优于最先进前向基线,最高提升PSNR达+2.1 dB,且推理时间维持在秒级,无需相机位姿或任何测试时梯度优化。

原文摘要 · Abstract (English)

Feed-forward 3D reconstruction offers substantial runtime advantages over per-scene optimization, which remains slow at inference and often fragile under sparse views. However, existing feed-forward methods still have potential for further performance gains, especially for out-of-domain data, and struggle to retain second-level inference time once a generative prior is introduced. These limitations stem from the one-shot prediction paradigm in existing feed-forward pipeline: models are strictly bounded by capacity, lack inference-time refinement, and are ill-suited for continuously injecting generative priors. We introduce GIFSplat, a purely feed-forward iterative refinement framework for 3D Gaussian Splatting from sparse unposed views. A small number of forward-only residual updates progressively refine current 3D scene using rendering evidence, achieve favorable balance between efficiency and quality. Furthermore, we distill a frozen diffusion prior into Gaussian-level cues from enhanced novel renderings without gradient backpropagation or ever-increasing view-set expansion, thereby enabling per-scene adaptation with generative prior while preserving feed-forward efficiency. Across DL3DV, RealEstate10K, and DTU, GIFSplat consistently outperforms state-of-the-art feed-forward baselines, improving PSNR by up to +2.1 dB, and it maintains second-scale inference time without requiring camera poses or any test-time gradient optimization.

3D重建高斯溅射生成先验前向推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。