arXiv:2608.21849cs.CV2026-08

用3D几何先验提升稀疏视角下3D高斯溅射的视频重建质量

GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors

论文配图:GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
图 1 · 摘自论文原文
  • 引入相机条件几何先验,用首尾帧锚定空间结构
  • 在稀疏视角下实现更高像素与结构保真度(PSNR/SSIM提升)
  • 适合需要多视角一致性的3D视频重建场景

3D高斯溅射(3DGS)在新视角合成中表现优异,但在稀疏视角下常出现明显伪影。尽管近期视频扩散模型提供了强大的时空先验,但直接微调用于3DGS修复效果不佳,因其缺乏对多相机几何结构的认知,导致多视角不一致。本文提出一种新型3D感知视频修复框架,以增强稀疏3DGS重建质量。我们构建了大规模3DGS视频数据集,支持专项微调;为弥合2D视频生成与3D多视角约束之间的差距,提出相机条件几何先验。通过将首帧和末帧作为边界锚点,并编码对应相机关系,显式注入空间结构至生成流程。该边界锚定、相机感知的先验引导网络实现几何一致的修复,保持跨视角连贯性。大量实验表明,在视频先验修复方法中,本方法在像素级与结构级保真度(PSNR/SSIM)上表现最佳,显著提升多视角一致性,同时在感知质量(LPIPS)上保持竞争力。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has achieved remarkable success in novel view synthesis; however, reconstructions under sparse views often exhibit noticeable artifacts. While recent video diffusion models provide strong spatio-temporal priors for 3DGS restoration, directly fine-tuning them for restoration is suboptimal, as they lack awareness of the underlying multi-camera geometry, resulting in multi-view inconsistencies. In this work, we propose a novel 3D-aware video restoration framework designed to enhance the quality of sparse 3DGS reconstruction. Specifically, we construct a large-scale 3DGS video dataset to enable specialized fine-tuning. To bridge the gap between 2D video generation and 3D multi-view constraints, we introduce a camera-conditioned geometric prior. By using the first and last frames as boundary anchors and encoding the corresponding camera relationships, we explicitly inject spatial structure into the video generation pipeline. This boundary-anchored, camera-aware prior guides the network toward geometrically grounded restoration that remains coherent across viewpoints. Extensive experiments show that, among video-prior restoration methods, our approach attains the best pixel- and structure-level fidelity (PSNR/SSIM) and improves multi-view consistency, while remaining competitive in perceptual quality (LPIPS).

3D重建视频生成扩散模型几何先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。