用量化残差编码实现动态场景超高压缩流传输,兼顾画质与速度。
QuARC-GS: Quantized Anchored Residual Coding for Compact Dynamic Scene Streaming with Gaussian Splatting

- 以首帧+压缩残差表示动态场景,降低存储负担。
- 残差压缩通过运动/外观/稠密化三策略协同优化,最高节省11倍存储。
- 适合需要低延迟高画质动态3D视频流的系统开发者。
基于神经辐射场(NeRFs)和高斯点阵等3D场景表示技术在新视角合成方面已取得显著进展,可实现任意视角下的高质量渲染。近期该技术被扩展至动态3D场景,但持续在线自由视角视频(FVV)流传输仍面临挑战,尤其在长视频场景下,源于详细场景表示的高存储需求及高速重建/渲染要求。为此,我们提出量化锚点残差编码高斯流(QuARC-GS),一种面向在线动态场景重建的量化感知4D场景优化框架,可在保持重建速度与质量的同时实现超高压缩。QuARC-GS使用单个基准帧和高度压缩的逐帧残差表示场景。具体地,通过两种互补策略对每帧残差进行压缩,分别针对运动、外观和稠密化。引入量化感知锚点变形机制,抑制无效运动更新,保留关键形变,在低存储条件下维持重建质量。同时设计变化门控稠密化策略,仅在真实时间变化区域添加新高斯点,有效消除冗余外观更新,降低存储开销。广泛数据集上的实验证明,相较于最先进方法,QuARC-GS在保持竞争性重建质量和训练速度的同时,每帧存储降低最高达11倍。
原文摘要 · Abstract (English)
3D scene representation techniques such as neural radiance fields (NeRFs) and Gaussian splatting have made substantial progress in novel view synthesis, achieving high-quality renderings from arbitrary view angles. More recently, such techniques have been extended to dynamic 3D scenes; however, achieving sustainable online free-viewpoint video (FVV) streaming remains challenging, especially for longer videos, due to significant storage demands of detailed scene representations and high reconstruction/rendering speed needs. To address these challenges, we propose Quantized Anchored Residual Coding Gaussian Streaming (QuARC-GS), a quantization-aware 4D scene optimization framework for online dynamic scene reconstruction that achieves ultra-high compression while maintaining reconstruction speed and quality. QuARC-GS represents a scene using a single canonical frame and highly compressed per-frame residuals. Specifically, we compress each residual through two complementary strategies targeting motion, appearance, and densification. We introduce quantization-aware anchor deformation, which suppresses insignificant motion updates while preserving meaningful deformations, maintaining reconstruction quality under low-storage streaming. Furthermore, we design a change-gated densification strategy that allocates new Gaussians only in regions exhibiting genuine temporal changes, effectively eliminating redundant appearance updates and reducing storage overhead. Extensive experiments on widely used datasets demonstrate that QuARC-GS enables competitive reconstruction quality and training speed while cutting per-frame storage by up to 11$\times$ compared to the state-of-the-art.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。