arXiv:2608.07937cs.CV2026-08中稿 · the British Machin…

无需相机位姿和真实深度,用联合训练的几何模块实现高效3D高斯点云重建。

FlexSplat: Flexible Feed-Forward 3D Gaussian Splatting without Point Cloud Correspondence

  • 通过联合训练几何变换器预测相机参数与深度,驱动高斯参数化与跨视角注意力。
  • 在ShapeNet-SRN和GSO数据集上达到接近有位姿方法的重建质量,PSNR差距小于0.7 dB。
  • 不依赖输入图像分辨率或视图数量,高斯数量固定,适合任意多视角输入。

我们提出FlexSplat,一种从非校准、以物体为中心的多视角图像集合进行新视角合成的前馈框架。近期基于查询的方法将3D高斯视为可通过多视图可变形注意力优化的Transformer查询,但假设已知相机位姿。FlexSplat消除了这一假设:通过联合训练几何变换器预测每张图像的相机参数与深度,进而支撑深度引导的高斯参数化及跨视角可变形交叉注意力,将所有输入视图的信息聚合为单一视图一致的基元集。不确定性加权的深度一致性目标使联合训练的几何模块适应重建任务,解码过程中的跨视图共识则吸收了估计相机与深度的残余误差。该表示使用固定数量的高斯基元,与输入分辨率解耦,不随图像网格或视图数增长。在ShapeNet-SRN和Google Scanned Objects(GSO)数据集上,FlexSplat在无需相机位姿和真实深度的情况下,达到或接近有位姿状态性能,且在GSO上感知质量(LPIPS)最优。结果表明,联合训练的几何前端足以实现无标定操作,同时保持与有位姿方法相差不到0.7 dB的PSNR,并匹配其感知质量。

原文摘要 · Abstract (English)

We present FlexSplat, a feed-forward framework for novel view synthesis (NVS) from uncalibrated, object-centric multi-view image collections. A recent line of query-based methods reconstructs a compact set of 3D Gaussians by treating them as transformer queries that are refined with multi-view deformable attention; these methods, however, assume that camera poses are given. FlexSplat removes this assumption: a geometry transformer is trained jointly with the Gaussian decoder to predict per-image camera parameters and depth, which in turn ground a depth-guided Gaussian parameterization and a multi-view deformable cross-attention that aggregates evidence across all input views into a single, view-consistent set of primitives. An uncertainty-weighted depth-consistency objective lets the jointly trained geometry adapt to the reconstruction task, while the cross-view consensus formed during decoding absorbs the residual error of the estimated cameras and depth. The representation uses a compact Gaussian budget that is decoupled from the input resolution - unlike pixel-aligned methods, the primitive count does not grow with the image grid - and is not dictated by the number of views. On ShapeNet-SRN and Google Scanned Objects (GSO), FlexSplat matches or approaches posed state-of-the-art reconstructors while requiring neither camera poses nor ground-truth depth, and matches the best perceptual (LPIPS) quality among the compared methods on GSO. Our results indicate that a jointly trained geometry front-end is sufficient to bring calibration-free operation to query-based Gaussian reconstruction while staying within 0.7 dB PSNR of posed methods and matching their perceptual quality.

3D高斯新视角合成无标定重建前馈模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。