用稀疏动态点云实现高效动态场景重建,模型更小速度更快。
SD-GS: Structured Deformable 3D Gaussians for Efficient Dynamic Scene Reconstruction
- 采用分层可变形锚点网格,以少量点支撑复杂时空结构。
- 在高动态区自适应增点,静态区减少冗余,锚点数少60%。
- 适合需要实时渲染的动态场景建模,如虚拟拍摄与数字人。
现有的4D高斯框架在动态场景重建中虽具优异视觉质量和渲染速度,但存储成本与复杂物理运动表征能力之间存在固有矛盾,限制了实际应用。为此,我们提出SD-GS,一种紧凑高效的动态高斯点积框架,主要贡献有二:首先引入可变形锚点网格,一种分层且内存高效的场景表示,每个锚点在其局部时空区域内生成多个3D高斯,并作为三维场景的几何骨干;其次提出感知形变的稠密化策略,自适应地在低重建质量的高动态区域增加锚点,同时减少静态区域的冗余,以更少的锚点实现更优视觉质量。实验表明,相比当前最优方法,SD-GS平均模型尺寸减少60%,帧率提升100%,显著提升计算效率,同时保持或超越视觉质量。
原文摘要 · Abstract (English)
Current 4D Gaussian frameworks for dynamic scene reconstruction deliver impressive visual fidelity and rendering speed, however, the inherent trade-off between storage costs and the ability to characterize complex physical motions significantly limits the practical application of these methods. To tackle these problems, we propose SD-GS, a compact and efficient dynamic Gaussian splatting framework for complex dynamic scene reconstruction, featuring two key contributions. First, we introduce a deformable anchor grid, a hierarchical and memory-efficient scene representation where each anchor point derives multiple 3D Gaussians in its local spatiotemporal region and serves as the geometric backbone of the 3D scene. Second, to enhance modeling capability for complex motions, we present a deformation-aware densification strategy that adaptively grows anchors in under-reconstructed high-dynamic regions while reducing redundancy in static areas, achieving superior visual quality with fewer anchors. Experimental results demonstrate that, compared to state-of-the-art methods, SD-GS achieves an average of 60\% reduction in model size and an average of 100\% improvement in FPS, significantly enhancing computational efficiency while maintaining or even surpassing visual quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。