arXiv:2605.10307cs.CVcs.GR2026-05中稿 · TCSVT

让3D场景重建更懂物体运动,提升动态场景精度与速度

PaMoSplat: Part-Aware Motion-Guided Gaussian Splatting for Dynamic Scene Reconstruction

论文配图:PaMoSplat: Part-Aware Motion-Guided Gaussian Splatting for Dynamic Scene Reconstruction
图 1 · 摘自论文原文
  • 用分割掩码生成3D物体部件,结合光流引导部件运动
  • 相比现有方法,渲染质量更高、追踪更准、收敛更快
  • 适合需要精细动态建模和编辑的科研与工业应用

动态场景重建是计算机视觉与机器人领域的核心挑战。尽管基于3DGS的方法取得进展,但在复杂大运动场景中仍难以实现高保真渲染与精准追踪。为此,我们提出PaMoSplat,一种融合部件感知与运动先验的动态高斯点云框架。该方法基于两点观察:1)部件是场景形变的基本单元;2)光流能有效指导部件运动。首先通过图聚类将多视角分割掩码升维至3D空间,构建连贯的高斯部件;后续时间戳采用差分进化算法,利用多视角光流估计部件刚性运动,提供优化的良好初始化。此外,引入自适应迭代次数机制、可学习刚性度及光流监督的渲染损失,加速并优化训练过程。在多种场景(包括真实环境)上的全面评估表明,PaMoSplat在渲染质量、追踪精度和收敛速度上均优于现有方法,并支持4D场景编辑等多部件级下游应用。

原文摘要 · Abstract (English)

Dynamic scene reconstruction represents a fundamental yet demanding challenge in computer vision and robotics. While recent progress in 3DGS-based methods has advanced dynamic scene modeling, obtaining high-fidelity rendering and accurate tracking in scenarios with substantial, intricate motions remains significantly challenging. To address these challenges, we propose PaMoSplat, a novel dynamic Gaussian splatting framework incorporating part awareness and motion priors. Our approach is grounded in two key observations: 1) Parts serve as primitives for scene deformation, and 2) Motion cues from optical flow can effectively guide part motion. Specifically, PaMoSplat initializes by lifting multi-view segmentation masks into 3D space via graph clustering, establishing coherent Gaussian parts. For subsequent timestamps, we leverage a differential evolutionary algorithm to estimate the rigid motion of these parts using multi-view optical flow cues, providing a robust warm-start for further optimization. Additionally, PaMoSplat introduces an adaptive iteration count mechanism, internal learnable rigidity, and flow-supervised rendering loss to accelerate and optimize the training process. Comprehensive evaluations across diverse scenes, including real-world environments, demonstrate that PaMoSplat delivers superior rendering quality, improved tracking precision, and faster convergence compared to existing methods. Furthermore, it enables multiple part-level downstream applications, such as 4D scene editing.

动态重建高斯点云部件感知光流引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。