arXiv:2510.10492eess.IVcs.CV2025-10被引 1

用人体先验压缩3D人像视频,超低码率下保持高质量

Towards Efficient 3D Gaussian Human Avatar Compression: A Prior-Guided Framework

  • 分离外观与运动:用静态模板+参数化变形实现高效建模
  • 每帧仅需94个参数传输,压缩后码率极低
  • 适合元宇宙中低带宽下的沉浸式人像视频应用

本文提出一种高效的3D人像视频编码框架,利用紧凑的人体先验和从标准姿态到目标姿态的变换,实现超低码率下的高质量3D人像视频压缩。该框架首先通过无网络的关节式点云渲染训练一个标准姿态的高斯人像作为外观基础;同时,采用人体先验模板以紧凑参数化表示捕捉时序身体动作。这种外观与时序演化的解耦设计减少了冗余:标准人像在序列中复用,仅需压缩一次;而每帧仅需94个参数传递,比特率极低。每帧目标人像通过线性混合皮肤(Linear Blend Skinning)变形生成,保证时间一致性与新视角合成质量。实验表明,该方法在主流多视角人像视频数据集上显著优于传统2D/3D编码器及现有可学习动态3D高斯点云压缩方法,在率失真性能上取得突破,为元宇宙场景中的无缝沉浸式多媒体体验提供可能。

原文摘要 · Abstract (English)

This paper proposes an efficient 3D avatar coding framework that leverages compact human priors and canonical-to-target transformation to enable high-quality 3D human avatar video compression at ultra-low bit rates. The framework begins by training a canonical Gaussian avatar using articulated splatting in a network-free manner, which serves as the foundation for avatar appearance modeling. Simultaneously, a human-prior template is employed to capture temporal body movements through compact parametric representations. This decomposition of appearance and temporal evolution minimizes redundancy, enabling efficient compression: the canonical avatar is shared across the sequence, requiring compression only once, while the temporal parameters, consisting of just 94 parameters per frame, are transmitted with minimal bit-rate. For each frame, the target human avatar is generated by deforming canonical avatar via Linear Blend Skinning transformation, facilitating temporal coherent video reconstruction and novel view synthesis. Experimental results demonstrate that the proposed method significantly outperforms conventional 2D/3D codecs and existing learnable dynamic 3D Gaussian splatting compression method in terms of rate-distortion performance on mainstream multi-view human video datasets, paving the way for seamless immersive multimedia experiences in meta-verse applications.

3D人像视频压缩高斯点云元宇宙

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。