arXiv:2605.11427cs.CV2026-05

让动态3D场景流媒体可渐进加载,首帧延迟从超10秒降至1.7秒。

PD-4DGS:Progressive Decomposition of 4D Gaussian Splatting for Bandwidth-Adaptive Dynamic Scene Streaming

论文配图:PD-4DGS:Progressive Decomposition of 4D Gaussian Splatting for Bandwidth-Adaptive Dynamic Scene Streaming
图 1 · 摘自论文原文
  • 将4D高斯点分解为静态骨架、全局变形和局部精修三层,支持逐层传输
  • 在2Mbps网络下,比特率降低60%以上,首帧延迟从73-930秒降至1.7秒
  • 无需每场景调参,适配移动端动态场景实时渲染

4D高斯点(4DGS)实现了高质量动态新视角合成,但现有模型为单一比特流,客户端需下载完整内容才能渲染,导致移动网络下黑屏等待数十至数百秒,无法兼容现代自适应码率传输。虽有渐进式3DGS压缩缓解静态场景问题,但仅作用于空间锚点,无法分割主导动态场景体积的时序形变网络。本文提出首个4DGS渐进压缩与按需传输框架PD-4DGS。通过层级形变分解(HDD),将4DGS中隐含的粗到细运动层次外化为三个独立可传输层——静态骨架、全局形变与局部精修——使任意前缀比特流即可渲染,单次训练生成可扩展的DASH/HLS兼容流。结合高斯熵属性率失真损失与时间掩码一致性正则项,压缩基础层并抑制低码率闪烁;采用容量加权回放调度,由学习到的激活率rho门控,避免形变网络欠训练且无需场景级超参数。在Dycheck iPhone基准上,PD-4DGS在保持渲染质量前提下,比特流减少超过60%,2Mbps链路下首帧延迟从73–930秒降至约1.7秒,首次实现4DGS真正按需渐进流媒体。

原文摘要 · Abstract (English)

4D Gaussian Splatting (4DGS) enables high-quality dynamic novel view synthesis, yet current models remain monolithic bitstreams that clients must download in full before any frame can be rendered, causing black-screen waits of tens to hundreds of seconds on mobile bandwidth and leaving 4DGS incompatible with modern adaptive-bitrate delivery. Progressive 3DGS compression alleviates this for static scenes, but it acts only on spatial anchors and cannot partition the temporal deformation networks that dominate dynamic-scene size. We present PD-4DGS, the first framework for progressive compression and on-demand transmission of 4DGS. Hierarchical Deformation Decomposition (HDD) externalises the coarse-to-fine motion hierarchy already latent in 4DGS into three independently transmittable layers -- a static scaffold, a global deformation, and a local refinement -- so that any prefix of the bitstream is already renderable, turning a single training run into a scalable, DASH/HLS-compatible bitstream. A Gaussian-entropy attribute rate-distortion loss together with a temporal mask consistency regulariser shrink the base layer while suppressing low-bitrate flicker; a capacity-weighted rollout schedule, gated online by a learnt activation rate rho, then prevents deformation-network under-training without any per-scene hyperparameter. On the Dycheck iPhone benchmark, PD-4DGS cuts the streamed bitstream by >60% at matched rendering fidelity and reduces first-frame latency from 73--930 s to ~1.7 s on a 2 Mbps link, uniquely enabling true on-demand progressive streaming for 4DGS.

4D高斯动态渲染流媒体渐进压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。