用几何引导的隐式解码,让单图3D高斯点云更贴合物体表面。
InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis

- 基于深度结构定位支持点,再用查询条件隐式预测高斯属性
- 在跨数据集视角合成中达到当前最优,支持零样本泛化
- 适合需要高质量单图3D重建的应用场景
单图像前馈3D高斯点云(3DGS)旨在直接从一张输入图像生成可渲染的3D场景表示,避免多视角采集和逐场景优化的成本。然而,现有方法通常受限于像素对齐的表示方式,即高斯分布从固定的图像网格位置预测。这种像素对齐的基元虽能生成良好近景视图,但与底层场景表面耦合较弱,在大视角变换下难以保持结构一致性。本文提出InfiniSplat,一种前馈单图像3DGS框架,将表示从像素对齐转向表面对齐。InfiniSplat首先利用几何引导采样,根据深度诱导的局部表面结构放置2D支撑点,再通过查询条件隐式解码器,从这些支撑点处查询的图像特征中预测高斯属性。通过将支撑点位置基于几何信息确定,并解耦高斯预测与固定像素中心,InfiniSplat生成更贴合场景表面的高斯布局,减少由网格离散化引起的分散基元。在多个跨数据集的NVS评估中,InfiniSplat优于现有单图像前馈基线,展现出从Hypersim室内合成训练到复杂开放世界场景的零样本泛化能力。
原文摘要 · Abstract (English)
Single-image feed-forward 3D Gaussian Splatting (3DGS) aims to directly generate a renderable 3D scene representation from one input image, avoiding the cost of multi-view capture and per-scene optimization. However, existing methods are often constrained by a pixel-aligned representation, where Gaussians are predicted from fixed image-grid locations. Such pixel-aligned primitives can produce promising nearby-view renderings, but they remain weakly coupled to underlying scene surfaces and struggle to preserve coherent structures under large viewpoint shifts. We present InfiniSplat, a feed-forward single-image 3DGS framework that moves from a pixel-aligned representation toward a surface-aligned representation. InfiniSplat constructs this representation by first using geometry-guided sampling to place 2D supports according to depth-induced local surface structure, and then applying a query-conditioned implicit decoder to predict Gaussian attributes from the image features queried at these supports. By grounding support locations in geometry while decoupling Gaussian prediction from fixed pixel centers, InfiniSplat produces Gaussian layouts that better follow scene surfaces and reduce scattered primitives caused by grid discretization. Across multiple cross-dataset NVS evaluations, InfiniSplat achieves state-of-the-art performance compared with single-image feed-forward baselines, and demonstrates zero-shot generalization from Hypersim indoor synthetic training to complex open-world scenes. Project page: https://zju3dv.github.io/InfiniSplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。