arXiv:2503.16422cs.CV2025-03NeurIPS被引 17

让动态场景渲染快过1000帧每秒,同时大幅减少存储和计算开销。

1000+ FPS 4D Gaussian Splatting for Dynamic Scene Rendering

  • 通过时空变化评分剔除寿命短的高斯点,减少冗余表示。
  • 用活跃高斯掩码避免无效计算,实现9倍提速和41倍压缩。
  • 适合需要实时动态场景渲染的研究者与工业应用开发者。

4D Gaussian Splatting(4DGS)作为重建动态场景的新方法受到广泛关注,但其通常占用大量存储且渲染速度慢。本文分析发现两个关键时间冗余来源:(Q1) 短寿命高斯点:4DGS使用大量生命周期短的高斯点表示场景动态,导致高斯点数量过多;(Q2) 静默高斯点:渲染时仅少数高斯点对每帧有贡献,但所有高斯点仍需参与光栅化,造成冗余计算。为此,我们提出4DGS-1K,可在现代GPU上实现超过1000 FPS的渲染速度。针对(Q1),引入时空变化评分作为剪枝准则,有效移除短寿命高斯点,鼓励使用长寿命高斯点表达动态;针对(Q2),通过存储连续帧的活跃高斯掩码,显著减少渲染中的冗余计算。相比原始4DGS,本方法在复杂动态场景下实现41倍存储压缩和9倍光栅化加速,同时保持相近视觉质量。

原文摘要 · Abstract (English)

4D Gaussian Splatting (4DGS) has recently gained considerable attention as a method for reconstructing dynamic scenes. Despite achieving superior quality, 4DGS typically requires substantial storage and suffers from slow rendering speed. In this work, we delve into these issues and identify two key sources of temporal redundancy. (Q1) \textbf{Short-Lifespan Gaussians}: 4DGS uses a large portion of Gaussians with short temporal span to represent scene dynamics, leading to an excessive number of Gaussians. (Q2) \textbf{Inactive Gaussians}: When rendering, only a small subset of Gaussians contributes to each frame. Despite this, all Gaussians are processed during rasterization, resulting in redundant computation overhead. To address these redundancies, we present \textbf{4DGS-1K}, which runs at over 1000 FPS on modern GPUs. For Q1, we introduce the Spatial-Temporal Variation Score, a new pruning criterion that effectively removes short-lifespan Gaussians while encouraging 4DGS to capture scene dynamics using Gaussians with longer temporal spans. For Q2, we store a mask for active Gaussians across consecutive frames, significantly reducing redundant computations in rendering. Compared to vanilla 4DGS, our method achieves a $41\times$ reduction in storage and $9\times$ faster rasterization speed on complex dynamic scenes, while maintaining comparable visual quality. Please see our project page at https://4DGS-1K.github.io.

4D高斯动态渲染实时优化可视化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。