arXiv:2603.25265cs.CV2026-03中稿 · ECCV

让3D高斯点云随视角自适应调整,提升生成质量且保持实时渲染。

ViewSplat: View-Adaptive 3D Gaussian Splatting for Feed-Forward Synthesis

  • 用视图条件的MLP动态修正高斯点属性,实现视图自适应渲染。
  • 在未对齐图像上重建,推理速度15帧/秒,渲染达90帧/秒。
  • 适合需要高质量、低延迟3D生成的交互式应用。

我们提出ViewSplat,一种面向无姿态图像的新视角合成方法。尽管现有前馈式3D高斯溅射显著加速了3D场景重建,但仍存在基础保真度差距。我们将其归因于单步前馈网络难以回归满足所有视角的静态高斯原型。为此,我们从静态原型回归转向视图自适应溅射。不采用固定高斯表示,本方法学习视图自适应隐式表示:首先预测基础高斯原型及场景条件的视图MLP权重;渲染时,这些MLP以目标视图坐标为输入,预测每个高斯属性(3D位置、尺度、旋转、透明度、颜色)的视图相关残差更新。该机制称为视图自适应溅射,使每个原型可修正初始估计误差,有效捕捉高保真外观。大量实验表明,ViewSplat在保持快速推理和实时渲染的同时达到当前最优保真度;大模型变体推理速度为15 FPS,渲染速度达90 FPS。

原文摘要 · Abstract (English)

We present ViewSplat, a view-adaptive 3D Gaussian splatting network for novel view synthesis from unposed images. While recent feed-forward 3D Gaussian splatting has significantly accelerated 3D scene reconstruction by bypassing per-scene optimization, a fundamental fidelity gap remains. We attribute this gap to the limited capacity of single-step feed-forward networks to regress static Gaussian primitives that satisfy all viewpoints. To address this limitation, we shift the paradigm from static primitive regression to view-adaptive splatting. Instead of a rigid Gaussian representation, our pipeline learns a view-adaptive latent representation. Specifically, ViewSplat initially predicts base Gaussian primitives alongside the weights of scene-conditioned View MLPs. During rendering, these MLPs take target-view coordinates as input and predict view-dependent residual updates for each Gaussian attribute (i.e., 3D position, scale, rotation, opacity, and color). This mechanism, which we term view-adaptive splatting, allows each primitive to rectify initial estimation errors, effectively capturing high-fidelity appearances. Extensive experiments demonstrate that ViewSplat achieves state-of-the-art fidelity while maintaining fast inference and real-time rendering; our large backbone variant runs at 15 FPS during inference and 90 FPS during rendering. Our project page is available at https://cvlab-uos.github.io/ViewSplat.

3D生成高斯溅射实时渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。