控制高斯点数量,实现边缘设备上的高质量4D重建。
Constrained Dynamic Gaussian Splatting
- 用可微分预算控制器动态调控高斯点数量,融合几何、运动和感知信息。
- 在固定预算下实现超过3倍的压缩率,误差低于2%。
- 适合资源受限场景下的实时3D重建应用,如移动设备或嵌入式系统。
动态高斯点渲染虽能实现高保真4D重建,但部署受限于根本矛盾:无约束增密导致内存爆炸,而启发式剪枝无法在预设高斯点预算下达到最优渲染质量。本文提出约束型动态高斯点渲染(CDGS),将动态场景重建建模为预算约束优化问题,在训练中严格遵循用户定义的高斯点数量。核心思想是引入可微分预算控制器作为优化驱动力,基于多模态统一重要性评分融合几何、运动与感知线索,实现精准容量调控。为最大化固定预算效率,进一步解耦静态与动态元素优化,采用自适应分配机制根据运动复杂度动态分配容量。结合三阶段训练策略与双模式混合压缩方案,CDGS不仅严格满足硬件约束(误差<2%),更显著提升码率-失真性能的帕累托前沿。大量实验表明,该方法在不同容量限制下均达最优渲染质量,相比顶尖方法压缩超3倍。
原文摘要 · Abstract (English)
While Dynamic Gaussian Splatting enables high-fidelity 4D reconstruction, its deployment is severely hindered by a fundamental dilemma: unconstrained densification leads to excessive memory consumption incompatible with edge devices, whereas heuristic pruning fails to achieve optimal rendering quality under preset Gaussian budgets. In this work, we propose Constrained Dynamic Gaussian Splatting (CDGS), a novel framework that formulates dynamic scene reconstruction as a budget-constrained optimization problem to enforce a strict, user-defined Gaussian budget during training. Our key insight is to introduce a differentiable budget controller as the core optimization driver. Guided by a multi-modal unified importance score, this controller fuses geometric, motion, and perceptual cues for precise capacity regulation. To maximize the utility of this fixed budget, we further decouple the optimization of static and dynamic elements, employing an adaptive allocation mechanism that dynamically distributes capacity based on motion complexity. Furthermore, we implement a three-phase training strategy to seamlessly integrate these constraints, ensuring precise adherence to the target count. Coupled with a dual-mode hybrid compression scheme, CDGS not only strictly adheres to hardware constraints (error < 2%}) but also pushes the Pareto frontier of rate-distortion performance. Extensive experiments demonstrate that CDGS delivers optimal rendering quality under varying capacity limits, achieving over 3x compression compared to state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。