arXiv:2502.14099cs.CV2025-02

提出一种点云的分辨率与质量联合可扩展编码方法,用单一码流支持多级重建。

Point Cloud Geometry Scalable Coding Using a Resolution and Quality-conditioned Latents Probability Estimator

  • 设计条件化潜在变量概率估计器,统一建模不同质量与分辨率下的特征分布。
  • 在JPEG Pleno学习型点云编码标准中实现单码流多级解码,率失真损失仅增加1.2%。
  • 适合需要灵活适配网络与设备差异的点云传输场景,如VR/AR和远程呈现。

当前用户在不同网络、硬件和显示条件下消费多媒体内容,传统方案需为每种需求独立编码多个码流,导致存储与计算开销大。为此,本文提出一种名为SRQH(可扩展分辨率与质量超先验)的联合质量与分辨率可扩展编码方案,突破以往方法无法建模不同率失真权衡或分辨率下潜在特征关系的局限。实验表明,将SRQH集成至新兴的JPEG Pleno学习型点云编码标准中,可在仅增加1.2%率失真代价及有限复杂度的前提下,实现单码流支持多种质量和分辨率的解码,显著优于需为每种配置单独编码的非可扩展方案。

原文摘要 · Abstract (English)

In the current age, users consume multimedia content in very heterogeneous scenarios in terms of network, hardware, and display capabilities. A naive solution to this problem is to encode multiple independent streams, each covering a different possible requirement for the clients, with an obvious negative impact in both storage and computational requirements. These drawbacks can be avoided by using codecs that enable scalability, i.e., the ability to generate a progressive bitstream, containing a base layer followed by multiple enhancement layers, that allow decoding the same bitstream serving multiple reconstructions and visualization specifications. While scalable coding is a well-known and addressed feature in conventional image and video codecs, this paper focuses on a new and very different problem, notably the development of scalable coding solutions for deep learning-based Point Cloud (PC) coding. The peculiarities of this 3D representation make it hard to implement flexible solutions that do not compromise the other functionalities of the codec. This paper proposes a joint quality and resolution scalability scheme, named Scalable Resolution and Quality Hyperprior (SRQH), that, contrary to previous solutions, can model the relationship between latents obtained with models trained for different RD tradeoffs and/or at different resolutions. Experimental results obtained by integrating SRQH in the emerging JPEG Pleno learning-based PC coding standard show that SRQH allows decoding the PC at different qualities and resolutions with a single bitstream while incurring only in a limited RD penalty and increment in complexity w.r.t. non-scalable JPEG PCC that would require one bitstream per coding configuration.

点云编码可扩展性深度学习JPEG Pleno

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。