arXiv:2511.11175cs.CV2025-11被引 2

解决多视角视频不同步问题,提升动态场景重建质量

Dynamic Gaussian Scene Reconstruction from Unsynchronized Videos

  • 分步对齐:先粗后精估计各相机时间偏移
  • 实现亚帧级对齐精度,显著提升重建效果
  • 可嵌入现有4DGS框架,适合真实场景应用

多视角视频重建在影视制作、虚拟现实和运动分析中具有重要作用。尽管近期的4D高斯泼溅(4DGS)技术在动态场景重建上表现优异,但通常依赖输入视频流的时间同步假设。然而现实中,因相机触发延迟或独立录制,视角间常存在时间错位,导致重建质量下降。为此,本文提出一种新颖的时序对齐策略,用于从非同步多视角视频中实现高质量4DGS重建。方法包含粗到精的对齐模块,先估计帧级时间偏移,再细化至亚帧精度。该策略可作为即插即用模块集成到现有4DGS框架中,增强其处理异步数据的鲁棒性。实验表明,该方法能有效处理时间错位视频,并显著优于基线方法。

原文摘要 · Abstract (English)

Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demonstrated impressive capabilities in dynamic scene reconstruction, they typically rely on the assumption that input video streams are temporally synchronized. However, in real-world scenarios, this assumption often fails due to factors like camera trigger delays or independent recording setups, leading to temporal misalignment across views and reduced reconstruction quality. To address this challenge, a novel temporal alignment strategy is proposed for high-quality 4DGS reconstruction from unsynchronized multi-view videos. Our method features a coarse-to-fine alignment module that estimates and compensates for each camera's time shift. The method first determines a coarse, frame-level offset and then refines it to achieve sub-frame accuracy. This strategy can be integrated as a readily integrable module into existing 4DGS frameworks, enhancing their robustness when handling asynchronous data. Experiments show that our approach effectively processes temporally misaligned videos and significantly enhances baseline methods.

4D高斯视频重建时间对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。