arXiv:2506.09518cs.CV2025-06NeurIPS被引 13

提出新方法实现动态场景高效3D重建,提升画面连贯性与精度。

HAIF-GS: Hierarchical and Induced Flow-Guided Gaussian Splatting for Dynamic Scene

  • 用稀疏锚点驱动变形,减少静态区域冗余更新。
  • 自监督诱导光流引导,无需真实运动标签。
  • 分层传播锚点,更好建模复杂非刚性形变,适合动态重建研究者。

从单目视频重建动态3D场景仍是3D视觉中的基础挑战。尽管3D高斯点阵(3DGS)在静态场景中可实现实时渲染,但将其扩展至动态场景困难,主要源于难以学习结构化且时间一致的运动表示。现有方法存在三大缺陷:高斯点冗余更新、运动监督不足、复杂非刚性形变建模弱,共同导致重建不连贯且低效。为此,我们提出HAIF-GS,一种通过稀疏锚点驱动变形的统一框架,实现结构化与一致性的动态建模。首先,通过锚点过滤器识别运动相关区域,抑制静态区域冗余更新;其次,设计自监督诱导光流引导变形模块,利用多帧特征聚合诱导锚点运动,无需显式光流标签;最后,引入分层锚点传播机制,根据运动复杂度提升锚点分辨率,并传递多层级变换。在合成与真实世界基准上的大量实验表明,HAIF-GS显著优于现有动态3DGS方法,在渲染质量、时间连贯性和重建效率上均表现更优。

原文摘要 · Abstract (English)

Reconstructing dynamic 3D scenes from monocular videos remains a fundamental challenge in 3D vision. While 3D Gaussian Splatting (3DGS) achieves real-time rendering in static settings, extending it to dynamic scenes is challenging due to the difficulty of learning structured and temporally consistent motion representations. This challenge often manifests as three limitations in existing methods: redundant Gaussian updates, insufficient motion supervision, and weak modeling of complex non-rigid deformations. These issues collectively hinder coherent and efficient dynamic reconstruction. To address these limitations, we propose HAIF-GS, a unified framework that enables structured and consistent dynamic modeling through sparse anchor-driven deformation. It first identifies motion-relevant regions via an Anchor Filter to suppress redundant updates in static areas. A self-supervised Induced Flow-Guided Deformation module induces anchor motion using multi-frame feature aggregation, eliminating the need for explicit flow labels. To further handle fine-grained deformations, a Hierarchical Anchor Propagation mechanism increases anchor resolution based on motion complexity and propagates multi-level transformations. Extensive experiments on synthetic and real-world benchmarks validate that HAIF-GS significantly outperforms prior dynamic 3DGS methods in rendering quality, temporal coherence, and reconstruction efficiency.

动态重建3D高斯光流引导锚点传播

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。