arXiv:2605.09279cs.GRcs.CV2026-05International Conf…

通过自适应颜色校正,实现高效3D高斯点云视频流传输。

CAGS: Color-Adaptive Volumetric Video Streaming with Dynamic 3D Gaussian Splatting

论文配图:CAGS: Color-Adaptive Volumetric Video Streaming with Dynamic 3D Gaussian Splatting
图 1 · 摘自论文原文
  • 基于向量量化构建多细节层级,用低分辨率参考图修复颜色失真。
  • 在波动带宽下比现有系统提升5~20 dB的图像质量,速度更快。
  • 兼容多种高斯表示,适合远程沉浸、机器人遥操作等场景。

体素视频(VV)流传输支持对远程3D环境的实时沉浸式访问,广泛应用于远程存在、生态监测和机器人遥操作。这些应用将VV流视为与物理环境的实时交互接口,对逼真场景重建、低延迟交互和异构网络下的鲁棒性提出新要求。3D高斯点阵(3DGS)因其出色的视觉质量和渲染性能被广泛用于实时逼真渲染,但其带来高带宽消耗问题。此外,现有基于密度的细节层级(LoD)方法不适用于高斯表示,导致明显间隙和严重画质下降。近期研究尝试属性压缩以降低带宽,初步分析表明激进压缩主要引发颜色失真,可通过参考图像在渲染端有效修正。受此启发,本文提出一种新型颜色自适应方案:采用向量量化(VQ)建立多细节层级,并利用低分辨率参考图像在客户端进行颜色恢复。进一步提出CAGS系统,可在不同高斯表示下运行,服务器端生成参考图像,客户端完成颜色还原。在原型系统上的大量实验表明,CAGS在波动带宽下相比现有自适应流系统提升5~20 dB PSNR,显著优于现有可扩展高斯压缩方法,且具备跨表示泛化能力。

原文摘要 · Abstract (English)

Volumetric video (VV) streaming enables real-time, immersive access to remote 3D environments, powering telepresence, ecological monitoring, and robotic teleoperation. These applications turn VV streaming into a real-time interface to remote physical environments, imposing new system-level demands for photorealistic scene representation, low-latency interaction, and robust performance under heterogeneous networks. 3D Gaussian Splatting (3DGS) has been widely used for real-time photorealistic rendering, offering superior visual quality and rendering performance, but it faces challenges due to bandwidth consumption. Furthermore, as the foundation of adaptive VV streaming, existing Levels of Detail (LoD) methods based on density are not well-suited to Gaussian representations, leading to visible gaps and severe quality degradation. Recent studies have also explored attribute compression techniques to reduce bandwidth consumption. Our preliminary studies reveal that aggressive attribute compression primarily causes color distortion, which can be effectively corrected in the rendered image using a reference image. Motivated by these findings, we propose a novel Color-Adaptive scheme for adaptive VV streaming that uses vector quantization (VQ) to establish LoDs and correct color distortions with low-resolution reference images. We further present CAGS, an adaptive VV streaming system compatible with diverse Gaussian representations, which integrates the Color-Adaptive scheme by rendering reference images on the streaming server and performing color restoration on the client. Extensive experiments on our prototype system demonstrate that CAGS outperforms the existing adaptive streaming systems in PSNR by 5$\sim$20 dB under fluctuating bandwidth, operates significantly faster than existing scalable Gaussian compression methods, and generalizes across different Gaussian representations.

3D高斯视频流自适应编码颜色校正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。