arXiv:2510.02732cs.CV2025-10被引 2

让3D动态重建更高效:根据运动复杂度智能分配控制点

From Tokens to Nodes: Semantic-Guided Motion Control for Dynamic 3D Gaussian Splatting

  • 用语义和运动先验建立像素块与控制点的对应关系
  • 动态区域密集布点,静态背景减少冗余,提升精度与效率
  • 适合关注3D动态场景重建、实时渲染的研究者

单目视频的动态3D重建仍面临视图受限导致的运动模糊和建模时变场景的计算压力。现有稀疏控制方法虽将数百万高斯点压缩至数千个控制点以降低计算量,但仅基于几何分配点,造成静态区域冗余、动态区域不足。本文提出一种运动自适应框架,使控制点密度匹配运动复杂度。利用视觉基础模型提供的语义与运动先验,建立块-令牌-节点对应关系,并通过运动自适应压缩,在动态区域集中控制点,抑制静态背景冗余。通过迭代体素化与运动趋势评分实现灵活的表示密度调整,直接解决控制点分布与运动复杂度不匹配的根本问题。为捕捉时序演化,引入基于样条的轨迹参数化,由2D轨迹初始化,替代传统MLP变形场,实现更平滑的运动表达与更稳定的优化。大量实验表明,该方法在重建质量与效率上显著优于当前最优方法。

原文摘要 · Abstract (English)

Dynamic 3D reconstruction from monocular videos remains difficult due to the ambiguity inferring 3D motion from limited views and computational demands of modeling temporally varying scenes. While recent sparse control methods alleviate computation by reducing millions of Gaussians to thousands of control points, they suffer from a critical limitation: they allocate points purely by geometry, leading to static redundancy and dynamic insufficiency. We propose a motion-adaptive framework that aligns control density with motion complexity. Leveraging semantic and motion priors from vision foundation models, we establish patch-token-node correspondences and apply motion-adaptive compression to concentrate control points in dynamic regions while suppressing redundancy in static backgrounds. Our approach achieves flexible representational density adaptation through iterative voxelization and motion tendency scoring, directly addressing the fundamental mismatch between control point allocation and motion complexity. To capture temporal evolution, we introduce spline-based trajectory parameterization initialized by 2D tracklets, replacing MLP-based deformation fields to achieve smoother motion representation and more stable optimization. Extensive experiments demonstrate significant improvements in reconstruction quality and efficiency over existing state-of-the-art methods.

3D重建动态建模运动控制高斯溅射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。